Press the Stair button (E).
That area could stand to be cleaned up because it's inconsistent. The first time, you enter with a button in the main menu bar, and you leave the same way, leading people to look in the wrong spot when returning. You also never leave with Go Upstairs (Q).
