Isn't he the one that follows you over the bridge ?
If so, you can just make him follow you and then hit him. Make sure he stays in melee form which he would if you're close enough. And slowly walk backwards with him chasing you until you reach the slave/rebel camps.

BTW: I'm thinking of the shaman of the fishing village.