- What data is available?
- What do we expect to do with the data?
- How can we access the data?
- Who can access what aspects of the data types?
- Where does the data live?
- What is the retention policy on each data type?
- What is the storage model of the data? Is it encrypted at rest? Is it encrypted in transit?
- How is the data ingested?
Seeing the Big Picture: Give Me All of the Data
September 13, 2018 | Database
The collection of operational and and analytics information can be an addictive habit, especially in the case of an interesting and active network. However, this information can quickly and easily overwhelm an aggregation system when the constant fire hose of information begins. Assuming the desire is collection and utilization of this information, it becomes clear that a proper strategy is required. This strategy should be comprised of a number of elements, including consideration of needs and requirements before beginning a project of this scope. In practice, data gathering requirements will likely happen either in parallel or, as with many things in network, adjusted on-demand, much like building the airplane as it is in flight. Course correction should be an oft-used tool in any technologist's toolbox. New peaks and valleys, pitfalls, and advantages should be referenced in the constant evaluation that occurs in any dynamic environment. Critical parts of this strategy should be included in consideration for nearly all endeavors of this kind. But even before that, the reasoning and use cases should be identified. A few of the more important questions that need to be answered are: