Yahoo search source code, Vespa has become open source

Verizon, which bought Yahoo, instead of keeping Yahoo's promise of controlling search source code, called Vespa, eventually turned it into open source.

Tool to help query structured and unstructured data, organize and rank search results and write data. It is a system that runs calculations on large amounts of data in real time.

'To achieve both speed and scale, Vespa distributed computational data on multiple machines rather than using a machine like a bottle,' said Jon Bratseth, a well-known software architect at Yahoo. 'While normal applications pull data into stateless areas for processing, Vespa takes calculations back into data'. Vespa does so by managing multiple nodes and redistributing data when there are broken machines or adding new machines.

Vespa is used on Yahoo.com, Yahoo News, Yahoo Sports, Yahoo Finance, Yahoo Gemini and Flickr to handle search queries, content suggestions and ads. 'Vespa is the best software Yahoo has ever created', co-founder and COO npmjs Laurie Voss said . 'It's like ElasticSearch but it's a hundred times better'.

Yahoo search source code, Vespa has become open source Picture 1
The source code for finding Vespa has become open source

So far, Yahoo's biggest code success is Hadoop, an Apache framework that handles distributed data. Hadoop 'nurtures' the market for companies wishing to handle large-scale data like Cloudera, Hortonworks or MapR.

According to Bratseth, the Vespa has been improved over the years to meet new computing needs. It provides developers with the ability to work with large amounts of data, process calculations in the required time, provide a better user experience with lower costs.