The only armor available at the bandit camp in the start is the 500g workers clothing. I prefer stealing a free armor at the farm on the way to Harbor Town. You need sneaking to get it though, so you either have to get a ring of sneaking, or learn the sneak skill.