Because each client has a limit to how many peers it can connect to. If 453 peers connect to you, doesn't that mean you are connected to 453 others? Normally the limit per torrent is around 100, therefore it's impossible to connect to everyone in the pool.

Trust me, connecting to more than 100 doesn't really help to increase your speed unless you get really lucky and connect to an extremely fast uploader.