While attending and speaking at the TDWI Strategy Summit recently, I got to chatting over lunch with a couple data and analytics luminaries I’ve known for years: Professor Hugh Ryan (University of Georgia, Terry College of Business), and Marie Clark (GE entrepreneur in residence, and founder of Ambient Intelligence). We were noting how quick many organisations are to hand the keys to BI tools over to business professionals without them having a sufficient appreciation of the data itself, and in a moment of clumsily adapted political nostalgia, I blurted out: “Ask not what your data can do for you, ask what you can do for your data.” We had a quick laugh, then got down to outlining what this means.
Our contention is that business professionals can do themselves and their organisation’s data a great service by better curating, understanding, managing, and preparing their data before attempting any kind of analysis. It’s often been said that you can’t manage what you don’t measure, and it follows that you can’t monetise well what you’re not managing well. Nowhere is this more evident than in today’s data landscape.
Curating data
Business professionals are desperate to generate more economic value from the information assets available to them. This means that they shouldn’t just focus on their own data, but those available externally.
So first, do your data a favour by identifying external/alternative data assets that may enhance or be an improvement upon the value of those you already have. This may be in the form of enhanced customer data from any variety of data broker, competitor pricing data harvested from their websites, social media insights to augment your own customer support/feedback data, or global economic indicators to enhance your own forecast data.
Unfortunately, in a room of about 100 data and analytics leaders I presented to at the event, not one person acknowledged that their organisation has anyone dedicated to identifying and arranging access to external data sources. Yet each of their organisations has an entire department dedicated to procuring office furniture or other material assets.
Understanding your data
Also, do your data a favour by getting to know it better. This is a key first component of what’s called ‘data literacy’, or ‘data fluency’. Understand its origin or provenance, its age, its lineage, its limits, its regulatory usage restrictions, its biases, how it may be the combination of other data sources, and its real (not assumed) business meaning.
Making an organisation data literate: Jason Teoh from Openreach, part of BT, talks to Information Age
Does your data represent a complete set of something such as sales transactions, or only a subset such as sales of items that were not returned? In fact, most organisations have a dozen or more definitions of what constitutes a “customer” (e.g. individual, household, current/former, shipping, billing, etc.), and at least as many data sets for each version. Learn how others have used similar data, both inside and outside your organisation.
Moreover, understand how any given data set relates to others. Reading a conceptual or logical data model isn’t really that difficult, presuming one exists, and data profiling tools also exist to help understand the ranges, averages, outliers, and other measures of the data itself.
Managing your data
Be circumspect about moving or copying data. Every time data is extracted, copied or moved from one place to another, your organisation incurs certain risks and expenses. You incur the risk that the data becomes out of sync with the source, thereby rendering it inaccurate or incomplete; you increase your attack surface for data breaches, and you incur additional expenses to sync, store, and manage yet another data set.
So do your data another favour, and leave it where it lives, either in an accessible operational database, or more likely a data warehouse or data lake. Technologies abound for creating virtual databases that are easier to understand, manipulate and analyse than trying to navigate an enterprise data warehouse.
How to build a cloud data warehouse for the first time
Work with your IT or data organisation to set these up, and resist creating dangerous Excel extracts of valuable corporate data assets, regardless how expedient it may be to do so.
Preparing your data
Your data may not be ready to serve you in its current form. Don’t expect that raw data, or even data that exists in the data warehouse, will service your analytic needs as-is. So do your data a favour by integrating it with other data, subselect it, filter it, tag it , cleanse it, or otherwise transform it for simpler or improved analysis.
Ideally, you want to do this within the existing data warehouse environment if possible. Data leaders such as CDOs should ensure that these kinds of basic data prep services or technologies are available to business professionals, and that sufficient training on them exists.
The lean CDO: why it’s time to develop a minimum viable data product
Analysing Your Data
Additionally, do your data a favour by learning a bit more than basic analytic functions and operations. Also, learn how to develop and test hypotheses and which types of visual representations are appropriate for enabling different types of insights.
If you’re just knowledgeable on how to create pie charts and bar charts, or a basic linear regression, then you’re doing your data, and your organisation, a disservice. The better prepared you are to perform diagnostic, predictive or prescriptive analyses upon the data, the more your data will do for you and your organisation.
So before you jump headlong into any kind of analytics, ask what you can do for your data, and if you are a data & analytics leader such as a CDO, consider establishing an analytics center of excellence (ACE) and/or formal data literacy and certification program to prepare your business professionals to do more with their data.
