Why don't you allow 2-8, and let the player decide? I prefer a smaller party or solo actually, while many prefer a large party. This way IMO you will cater to a larger group of players. Again only my opinion.