having sex is how the party is progressed. if you want to be able to leave the party without having sex i don't think that's what was intended and probably was why there's an option to just decline attending the party in the first place
The private party isn't mandatory, and the scene where you're offered an opportunity to decline does allude to the fact you're agreeing to sex with thinly veiled language.