Yes they both want the book, but Rufus is in the upper monastery, which you can't get to until after you've already passed Vitrius's test.

So you have to have shown Vitrius the book before you can even give it to Rufus. It is impossible to give it to Rufus without having first shown it to Vitrius.