Personally I think that if you go with harem, you should flesh out everyone and give all of the members enough "screentime". If there are too many members and you think that's too much work then maybe it's better to go with a love triangle or single heroine. For me the sweet spot is around 3-5...