Open source and big data are often mentioned together whenever new hot frameworks such as Apache Spark are mentioned. Spark is also known as a fast and general engine for big data processing, which makes it one of the top frameworks, related to new big data technologies, especially because it is also open source.
According to former Microsoft executive and current Talend CEO Mike Tuchen, open source is and will continue to change the way big data platforms function in the future. “We're seeing a changing of the guard. We expect the entire next-generation data platform will be open source," Tuchen said.
Among the customers of Talend, which will celebrate its 10th anniversary this year, are GE, Citi, Lufthansa, Orange, Virgin Mobile, etc. According to Tuchen, the company will be selling in 10 new countries besides the 5 countries it was selling by the end of 2015. To achieve its goal of expanding in 10 new countries the big data focused company will increase its number of employees to 750, 200 more compared to 2015.
Open source, which according to Tuchen is “the new normal,” gives users many advantages by allowing them to try the products before buying them, something that is not going unnoticed by many companies which are beginning to change the way they sell their products. Another advantage open source brings is the allowance of technology to grow and develop faster, as well as giving developers all around the world the opportunity to better communicate and share their knowledge. “The whole Hadoop ecosystem is moving faster than it could if it were just one vendor,” Tuchen said. “When you look at it that way, it’s hard to see how the world would ever change back.”
Giants like Google have already started to pay attention to open source. According to global media leader specializing in the general Homeland Security i-HLS, Google has recently announced that the company will use the Apache Incubator to make a big part of its code open source.
“Cloud Dataflow is a platform for processing large amounts of data in the cloud. It features an open source, Java-based SDK, which makes it easy to integrate with other cloud-centric analytics and Big Data tools,” according to The Var Guy who added that the platform makes it easier for companies to integrate new emerging technologies into existing ones. “That saves organizations from having to revamp their analytics infrastructure or code each time a new data processing framework appears,” Var writes.
It is yet to be seen if open source will eventually “kill” the closed source, but since many tech giants are starting to make more and more parts of their code open source, and are working on emerging new technologies into their frameworks, the possibility becomes even greater.
Image Source: www.irisns.com