In fact, if you lose either of the battles during the quest it results in a bad end, and if you chose to stay during the uplifting process, you will lose five intelligence points.
Also any silicon modifications undergone while fighting the nurse droid are also permanent unless the "Suck Out" option is chosen. None of the stat modifications the Doll maker gives you are permanent, so you don't have to worry about that after the fight.