the more neighbors you define, the harder it gets to do the frequency planning. two neighbors cell shouldn’t use co-channels or adj. channels, so it puts a lot of constraints to have too many neighbors.
Second thing : the MS takes more time to listen to all the neighbors, therefore the ho candidate selection is less reactive at BSC side.