You're not imagining things; Mercenary and Tech Specialist are generally considered to be better. Smugglers are supposed to rely on Evasion for defence (as opposed to HP for Mercs and Shields for Techies), and damage-wise, they're built around inflicting Blind/Stun -> guaranteed Crits. Early game, there aren't any good +Evasion gear or Stun Chance weapons (at least, to my knowledge), so they have to rely on their first Special more than the other classes.