If your CPU usage is low, but your network performance goes down when a lot of clients are active (and you KNOW that these clients and your Server should be able to handle a lot more bandwidth), my guess would be that (A) you have bottlenecks in your application, so
check all the places using critical sections, or ... (B) your network is congested, so make sure to
also check this FAQ topic for more info.