For windowed mode, hover the mouse at top of screen to make the control bar appear, then click the full screen toggle.