Greg Lindahl Chief Technology Officer, Blekko
Greg Lindahl is Founder & CTO at blekko, a new web-scale search engine, where he mainly works on infrastructure & blekko's novel NoSQL database engine. He was previously a founder at PathScale, where he was the architect of the InfiniPath low-latency InfiniBand HCA, used to build tightly-coupled supercomputing clusters. Prior to PathScale's founding in 2001, Greg worked on commodity Linux clusters at HPTi, including the 1999 Forecast Systems Lab system, which was the first time a Linux cluster won a conventional supercomputing procurement.
Monitoring and Debugging Big Clusters Running Real-Time NoSQL Apps
Running a big NoSQL cluster used for data-mining Map/Reduce jobs in production is challenging, but fairly common these days. Keeping up a hundred+ node NoSQL-based cluster serving sub-second responses to fickle web-users can be terrifying, for both operations and engineering staff. We've been operating such a system at blekko for two years now, and we've learned the hard way about the kinds of monitoring, debugging and debugability features needed to survive without pulling out too much of our hair. Come and learn from our mistakes!