Some news is bigger than others. For us at Ironpaper, Google's completion of a new search index is big news. Meet Caffeine, a modernized search index that was designed to handle a more complex and evolving web.
One of the key goals of Caffeine, Google's new search index, is to reduce the delay between discovery and refresh of their cache of the web. The new index will allow Google to analyze the web in small proportions and on a continuous basis--which will keep their cache more up-to-date. Every second, for example, Caffeine can cache hundreds of thousands of pages in simultaneously. Ultimately, their new search index will scale with the growth and be able to deliver more relevant search results on a greater portion of the web.