Ah man!
You're going to miss out on one of the best open ended games ever game.
Seriously.

Give it many tries. The game will grow on you.
I am not a master hand eye coordonated individual myself but have still managed to complete the game (I have not played NOTR though).