As FloodSpectre said, the characters are persistent (even into multiplayer). I've started a couple of worlds and decided I didn't like that tileset or it was too quiet and restarted with a new world but kept the character.