Facing the river from his farm go left, following the left cliff face not the road will lead you to the Temple.
Enter and as you get to the first ramp down go along the left side but not down the ramp.