The two backgrounds that start with an offhand item (barbarian and soldier) will start the game with that offhand item equipped. This even occurs with the white mage and black mage classes that start with a two-handed primary weapon.
The four backgrounds that start with a non-light primary...