Just head right across the road and directly into the forest there along the mountain wall, you'll get to them within 30 seconds of running.
|Elber|----------------|Road|-----------------------------------------|Cave with bandits|
Those bastards were awfully hard to locate. I ran literally half an hour around the countryside searching them. When I finally found them, i was so pissed off that i executed them in few seconds