One fundamental requirement of a truly digital business is a fluid data layer that can be used by any app or service, so that data can be recombined or joined automatically, without constant DBA intervention. It sounds good, but it’s not easy to do. Nonetheless, doing nothing isn’t an option. Any firm choosing that road will only find itself in a deeper hole competitively.
Before choosing a technology approach or platform, it’s necessary to understand current datasets, including their structure and storage environment. You can’t upgrade a network without complete visibility, and the same is true for the data layer. No technology plan will work without a comprehensive understanding of what in-house and third-party data the organization has. This is the starting point to getting a handle on what the data layer will contain, sources, and the scope of the issue.
This requires data discovery, or the creation of a corporate data directory that helps identify what exists and what type of technology will best fit current and future needs. The reality is that building a data layer doesn’t require a 100% “green field” approach. There are many existing IT and data assets that can be used as they are, if the right solution is deployed. Among many additional factors to be considered is where data can be stored per sovereignty or compliance strictures, which greatly influences the kinds of cloud infrastructure technologies that can be used.
Once created, the corporate data dictionary needs to be a living directory that incorporates changes and updates to corporate data resources as they occur. Change is a constant, and any data inventory will be rendered inaccurate in just a few months if it isn’t updated. This process will also continue even after the data layer is deployed.
A corporate data directory also makes it easier to highlight the datasets that are most valuable and widely used. This lets IT teams prioritize the datasets that must be included in the fluid data layer in the earliest stages (using input from key line-of-business departments and the DevOps team.)
Building such a data directory often requires more resources and specialized skills than internal IT teams have available. Many businesses engage a partner to do much of the work, benefiting from the experience and knowledge the partner has gained from similar projects. The result is more efficient project execution, with fewer glitches.
Maverick Technology Partners has worked on several organizations’ projects to build advanced data management solutions. For more information, please contact us at info@mavericktechpartners.com. For more information, check out our services page!