Big Data Defined.
Big data refers to the unprecedented amount of data created through an increasingly connected and mobile world, cloud computing, and, above all, the Internet of Things. The volume and velocity of data available today was unthinkable even a few years ago and have overwhelmed traditional data processing and analytical techniques. In response, new databases and analytical tools were created with the capacity to deal with these extremely large data sets.
The Promise of Big Data.
Developing Your Big Data Strategy.
- What is your goal for big data initiative? How will this effort help you accomplish your mission? Do you want to deliver service efficiencies? Increase effectiveness? Discover relationships to better understand current operations? Predict future actions? Facilitate cross-team collaboration? Do you need a public access/open data effort? Do you need an enterprise strategy, or one limited to an agency or function? Many big data efforts fail to provide value due to poor alignment with the agency’s goals and mission.
- What is your data inventory? Baselining the relevant current data sets available to you is critical. Where does the data reside in your agency that is required to deliver on your goals? What formats are involved? Is it structured or unstructured? Does the data reside across agencies or locations? Does it reside on multiple sources, mediums? Is there a requirement for new data sources, or outside sources? Without access to the right data sets you will not be able to execute your plan.
- How will you collect the data? How will the data be collected, consolidated, and maintained? Is there a need for a continual data feed, scheduled updates, or is a one-time data dump sufficient for your goals?
- What is your existing capability? Do you have access to big data tools in-house? Do you have the necessary talent in-house to do the data collection and analysis tasks? Your staff may require training to effectively conduct the analyses you require.
- What is the output? Who are the consumers of the analysis? Do you require high-level dashboards or more detailed analytical products? What data visualization techniques are appropriate for the data collected? Presentation is a critical component to making big data understandable.