I found it pretty inconsistent difficulty-wise. At least the dragons are optional. Some of the other difficulty spikes are in the main story, and no way around them as far as I know.