Handling imbalance based on how well the load balancers could balance load