A Special Report On Managing Information From Economist

Feb 25th 2010 | From The Economist print edition The article has a short section on technology used for such applications, including this on R: "A free programming language called R lets companies examine and present big data sets, and free software called Hadoop now allows ordinary PCs to analyse huge quantities of data that previously required a supercomputer. It does this by parcelling out the tasks to numerous computers at once. This saves time and money. For example, the New York Times a few years ago used cloud computing and Hadoop to convert over 400,000 scanned images from its archives, from 1851 to 1922. By harnessing the power of hundreds of computers, it was able to do the job in 36 hours." It's nice to see the open-source combination of Hadoop and R getting recognition as the engine behind many such large-scale problems in predictive modeling. The Economist: A different game