The toughest one for me was a huge group of guards encountered when travelling between sections in Denerim. It was 6-8 fighters backed up by 6-8 archers, and it seemed pretty much impossible without decent aoe spells.