Skip to main content

Big Data- The Rise and the Future











By 2020, our data universe will be 35ZB. In 2009 it was 0.8ZB. It is growing by factor of 44 as per IDC
The data is growing faster and faster. In fact 80% of worlds data is unstructured and it is growing at the rate 15X to the structured data. Right now information is democratized and available to all. In fact Facebook generated alone 550TB of data per day
Most of the data is generated by individuals. This is the era of Human information. Human information is made up of ideas and information.
There are:
97,000 tweets per second
12 million texts per minute
294 billion emails every day
Most of the data is unstructured data. This unstructured data is growing exponentially each day, each year. This unstructured data is the focus of Big Data analytics.
Lot of applications and business models are being developed around this unstructured data.
Some examples are:
   1)       An application for Who is visiting my website?
   2)      An analysis for What are my customers saying about me?
   3)      An application to analysis what my customers like to buy?

So where is this data coming from? This wide range of unstructured data is generated from wide range of sources like mobile devices, social media, flash mobs and sensors etc.




Data drives the bottom line, and technology is no longer limiting your competitors.
Data-focused businesses have rejected the concept of compromising business objectives for the sake of technology. And they’ve been able to do so way ahead of the curve because they never had to change legacy thinking or infrastructure
Why Do organizations need Big Data solutions?
  1)      For transparency: If the business can interpret or analyze the unstructured data it creates transparency for the business. Business can justify its decision because it has the data to do it
  2)      Experimentation: armed with new information, businesses can do experimentation with their product line and marketing
  3)      Segmentation: Business can segment customers and can target products and services specially made for a particular segment. It increases the success rate and bring revenue.

  4)      Automate: Business can create algorithm to automate many human decisions


So what are the big data challenges? Well they are:
                                                                             
   1)      One of the main concern for an enterprise is how to retrieve or search relevant information faster?
   2)      How to gain value form this data? How to harness this data?
   3)      How to integrate structured and unstructured data access?
   4)What infrastructure is required to store, backup and secure this data?



What are the options we have?
        1)      New search and e-discovery tools
        2)      Platforms that can process structured and unstructured data 
        3)      Tools to unify information access
        4)      New state of the art storage solutions


So big data is here and its the future of business and technology.




















Labels:
Location: Bangalore, Karnataka, India

Comments

Post a Comment

Popular posts from this blog

Data Center Migration

Note: This blog is written with the help of my friend Rajanikanth
Data Center Migrations / Data Center Consolidations
Data Center Consolidations, Migrations are complex projects which impact entire orgnization they support. They usually dont happen daily but once in a decade or two. It is imperative to plan carefully, leverage technology improvements, virtualization, optimizations.
The single most important factor for any migration project is to have high caliber, high performing, experienced technical team in place. You are migrating business applications from one data center to another and there is no scope for failure or broken application during migration. So testing startegy should be in place for enterprise business applications to be migrated.
Typical DCC and Migrations business objectives
Business Drivers
·Improve utilization of IT assets ·DC space & power peaked out - business growth impacted ·Improve service levels and responsiveness to new applications ·Reduce support complexi…
Post a Comment
Read more

HP CSA Implementation

I know the above picture is little confusing but don’t worry I break it down and explain in detail. By the time I am done explaining you all will be happy. HARDWARE AND SOFTWARE REQUIREMENTS 1.VMware vSphere infrastructure / Microsoft Hyper V: For the sake of Simplicity we will use VMware vSphere. We Need vSphere 4.0 /5/5.5 and above and vCenter 4.0 and above ready and installed. This is the first step. 2.We need Software medias for HP Cloud Service Automation, 2.00, HP Server Automation, 9.02, HP Operations Orchestration (OO)9.00.04, HP Universal CMDB 9.00.02, HP Software Site Scope, 11.01,HP Insight Software6.2 Update 1 3.DNS, DHCP and NTP systems are already installed and configured. NTP information should be part of VM templates 4.SQL Server 2005 or Microsoft® SQL Server 2008 or Microsoft® SQL Server 2012 , Oracle 11g, both 32-bit and 64-bit versions may be used for CSA database.
5.We will install  HP Cloud Service Automation, 2.00, HP Server Automation, 9.02, HP Operations Orchestra…
Post a Comment
Read more

Openstack- Its importance in Cloud. The HP Helion Boost

Every enterprise expects few things from cloud computing, mainly:

· Auto scaling: The workload should increase and decrease as needed by the IT environment.

· Automatic repair: If there is any fault or crash of the application or the server, it automatically fix it

· Fault tolerant: The application or underlying technology is intelligent enough to make itself fault torrent

· Integrated lifecycle: It should have integrated lifecycle

· Unified management: Its easy to manage all different aspects of technology

· Less cost

· Speed


Its year 2014. till now only 5% to 7% enterprises are using cloud computing. Such a small number. Its a huge opportunity and a vast majority for anyone who is interested in providing cloud computing services.
Current IT environment is very complex. You just cant solve all your problems with cloud computing.
There are legacy systems, databases, data processors, different hardware and software. You name it , there are so many technology available in just o…
Post a Comment
Read more