A bit of news on the data center front, for those who may have missed it: Facebook recently announced the deployment of a new power-efficient load balancer called “Autoscale.” Here’s their blog post about it.
Basically, the quick and dirty summary of the design is to adapt the number of active servers so that it’s proportional to the workload, and adjust the load balancing to focus on keeping servers “busy enough” so that they don’t end up in a situation where lots of servers are very lightly loaded.
So, the ideas are very related to what’s been going on in academia over the last few years. Some of the ideas are likely inspired by Anshul Ghandi and Mor Harchol-Balter et al.’s work (who have been chatting with Facebook over the past few years), and it’s actually quite similar in the architecture to the “Net Zero Data Center Architecture” developed by HP (that incorporated some of our work, e.g. these papers, which are joint with Minghong Lin, who now works with the infrastructure team at Facebook).
While this isn’t the first tech company to release something like this, it’s always nice to see it happen. And, it will give me more ammo to use when chatting with people about the feasibility of this sort of design. It is amazing to me that I still get comments from folks about how “data center operators don’t care about energy”… So, to counter that view, here’re some highlights from the post:
“Improving energy efficiency and reducing environmental impact as we scale is a top priority for our data center teams.”
“during low-workload hours, especially around midnight, overall CPU utilization is not as efficient as we’d like. […] If the overall workload is low (like at around midnight), the load balancer will use only a subset of servers. Other servers can be left running idle or be used for batch-processing workloads.”
Anyway, congrats to Facebook for taking the plunge. I hope that I hear about many other companies doing the same in the coming years!