Yep, talk to them in the Frost Hound and dismiss them from there. They'll hang out until you need them again.
Once you have the ability to interact with way statues and fast travel, you can also switch party members from any convenient entrance to the Ways Between.