By Anil Vaidya
Big Data & Machine Learning Juggernaut – II
The Dancing Landscape that I referred to in my previous blog is already on horizon. The Internet of Things (IOT) capabilities have brought in whole new world of data management. New tools, techniques and expertise are on rise. The IOT sensors capture required parameters the values of which get transmitted through various modes of technology, much of it via internet. The received data at the other end needs to be stored in some form and used for drawing inferences.
The Data Lakes and the Object Storage are the new ways of data storage. Such data runs into multiple of petabytes requiring hundreds of servers and their disks. The Big data is coming to reality in true sense with its full force of unstructured characteristic and the size besides velocity of generation and transmission. Multiple vendors have come up with their own technologies of storages and the computational facilities. They include major cloud providers such as Google, AWS and Azure besides many others. Not to be left behind there are hardware companies who offer building on-premises cloud facilities.
The Apache frameworks of Hadoop had seized the Big Data world to the extent that it had become synonymous with Big Data. People understood Hadoop as Big Data. In just few years these are getting replaced by Spark and Object storage facilities. Additionally lot of inferential frameworks for machine learning are progressing such as Tendsorflow and Caffee. Entire Big data computation is being now supported by the hardware evolving from CPU to GPU and now onto TPU by Google. It’s a phenomenal journey and rapidly unfolding technologies and their deployment strategies.
I strongly believe that if we are not quick enough to get aligned to the newer ways of doing things in this tech-world we will not have our rightfully earned place. We must get on with our own upliftment as quickly as possible.
Tags
- Uncategorized (5)
- Abbasali Gabula (1)
- Aditi Divatia (2)
- Anil Kulkarni (1)
- Anil Vaidya (14)
- Ashish Kumar Jha (1)
- Ashita Aggarwal (2)
- Atul Sethi (1)
- Balanced Leadership (1)
- Bindu Kulkarni (4)
- Deepa Krishnan (6)
- Equality (1)
- Harsh Mohan (1)
- Hemant Manuj (1)
- Jagdish Rattanani (2)
- Lata Dhir (1)
- M.Suresh Rao (4)
- Mita Dixit (3)
- Nirja Mattoo (1)
- Pallavi Mody (6)
- Preobroto Ganguly (1)
- R Jayaraman (38)
- R K Pattnaik (2)
- R. Jayaraman (1)
- R.Gopalakrishnan (2)
- Rajiv Agarwal (1)
- Rakhi Thakur (1)
- Ranjan Banerjee (2)
- Ratika Gore (2)
- Renuka Kamath (3)
- Rukaiya Joshi (1)
- Sajeev George (1)
- Sapna Malya (1)
- Sarabjeet Natesan (12)
- Sheila Roy (2)
- Snehal Shah (1)
- Sumita Datta (1)
- Suresh G. Lalwani (1)
- Surya Tahora (3)
- Sushmita Srivastava (1)
- Tulsi Jayakumar (4)
- Vanita Bhoola (2)
- Vasant Sivaraman (1)
- Vijay Sampath (3)
- Wisdom (1)
- Women's Day (1)
Most Viewed
Blog Archive
- June 2020 (1)
- May 2020 (1)
- October 2019 (1)
- August 2019 (1)
- May 2019 (1)
- February 2019 (2)
- December 2018 (1)
- November 2018 (1)
- September 2018 (4)
- August 2018 (3)
- July 2018 (1)
- June 2018 (4)
- May 2018 (2)
- March 2018 (3)
- December 2017 (6)
- September 2017 (6)
- August 2017 (1)
- July 2017 (4)
- May 2017 (4)
- April 2017 (4)
- March 2017 (5)
- January 2017 (3)
- December 2016 (3)
- November 2016 (9)
- October 2016 (17)
- September 2016 (48)
- August 2016 (7)
Add new comment