I’m a bit of a web performance nut.\u00a0 I like technology when it is used to solve real challenges and won’t use technology for technology’s sake.\u00a0 When you look at today’s scalability problems of all of the web 2.0 shops, one only needs to make one real generalization.<\/p>\n
What is the failing point of today’s sites?\u00a0 How many stories have you read in the media about some rising star that gets mentioned on yahoo or digg or slashdot?\u00a0 Generally, their site crashes under the crushing load (I’ve had sites slashdotted, its not as big a deal as they would have you believe).\u00a0 But, the problem we face is multifaceted.<\/p>\n
Developer learns php.\u00a0 Developer discovers MySQL.\u00a0 Developer stumbles across concept.\u00a0 Developer cobbles together code, buys hosting — sometimes on a virtual\/shared hosting environment, sometimes on a VPS, sometimes a dedicated server.\u00a0 But, the software that performs well for a few friends hitting the site and acting as beta testers is never really pushed.\u00a0 While the pages look nice, the engine behind them is usually poorly conceived, or worse, designed thinking that the single server or dual server web\/mysql combination is going to keep them alive.<\/p>\n
95% of the software designed and distributed under Open Source Licenses doesn’t understand the unique challenges behind a site that needs to handle 20 visitors versus 20000 visitors per hour.\u00a0 Tuning apache to handle high traffic, tuning mysql indexes and mysql’s configuration and writing applications designed for high traffic is not easy.\u00a0 Debugging and repairing those applications after they’ve been deployed is even harder.\u00a0 Repairing while maintaining backwards compatibility adds a whole new level of complexity.<\/p>\n
Design with scalability in mind.\u00a0 I saw a blog the other day where someone was replacing a 3 server setup behind a load balancer with a single machine because the complexity of 100% uptime made their job harder.\u00a0 Oh really?<\/p>\n
What happens when your traffic needs outgrow that one server?\u00a0 Whoops, I’m back to that load balanced solution that I just left.<\/p>\n
What are the phases that you need to look for?<\/p>\n
Is your platform ready for 100,000 users a day?\u00a0 If not, what do you need to do to make sure it is ready?\u00a0 Where are your bottlenecks? Where does your software break down?\u00a0 What is your expansion plan?\u00a0 When do you split your mysql writers and readers?\u00a0 Where does your appliction boundary start and end?\u00a0 What do you think breaks next?\u00a0 Where is our next bottleneck?<\/p>\n
What happens with a digg or slashdot that crushes a site?\u00a0 Usually, its a site that has all sorts of dynamic content with ill conceived mysql queries generated in realtime every pageload.\u00a0 I can remember a CMS framework that did 54 sql queries to display the front page.\u00a0\u00a0 That is just rediculous and I dumped that framework 5 minutes after seeing that.\u00a0 Pity, they did have a good concept.<\/p>\n
So, with scalability in mind, how does one engineer a solution?\u00a0 LAMP isn’t the answer.<\/p>\n
You pick a framework that doesn’t use the usual paradigms of an application.\u00a0 Why should you worry about a protocol, you should design the application divorced from the protocol.\u00a0 You develop an application that faces the web rather than talking direct to the web because other applications might talk to your application.\u00a0 When it comes time to scale, you add machines without having to worry about task distribution.\u00a0 Google does it, you should too.<\/p>\n