Web Search for a Planet is an overview of how Google manages their enormous throughput of extremely expensive queries. The answer may surprise you: tons of cheap PCs.
A similar paper is The Anatomy of a Large-Scale Hypertextual Web Search Engine, written by the founders themselves while still at Stanford. I can’t vouch for how much of it is still accurate, but it’s fascinating nonetheless.
Add a comment: