Tag Archives: Databases

Data, Intelligence & Knowledge Part 1 – Data Management.

At the heart of any direct or digital marketing communication is data. And all companies or organisations, large or small, who wish to communicate directly with customers or prospects collect and store data. But my experience of dealing with hundreds of businesses over the past 25 years is this core activity is usually undertaken with little planning or forethought, is executed in a haphazard manner and very rarely is the potential that the data offers the business unlocked to the full benefit of the business.

The first fundamental error too frequently made is deciding where responsibility for data management resides within an organisation. Too often it is seen to be an IT function because the initial challenge facing an organisation is how to hold the data. One of two approaches is taken:-

  • The Organisation is already collecting customer and prospect data in its accounting system, order system or other back office facility and so there is no immediate need to consider the marketing function. The organisation is “sure” it can extract the data in a usable form when it’s needed by marketing.
  • The Organisation decides to buy in or build a data repository for marketing activity. Whether it’s an excel spreadsheet, a marketing database, a data warehouse, a CRM system or a Big Data model, IT will thrive on creating the container to fit the data and spend significant budget building something that too often will constrain what data can be stored and how it is held. It’s an approach similar to the food manufacturer designing the packaging and then deciding how to cram the product into its container.

The second fundamental error is the belief that once the data repository has been built then the hard work has been done. In practice the effort and resource required to manage the data far outweighs the effort to build the repository in the first place.  I see far too many databases or CRM systems that fail to reach anywhere near their potential or on occasions don’t get past day one because no resource has been allocated to manage the data collection and on-going maintenance. 

The starting point for any organisation that wishes to undertake direct or digital marketing is to formulate a data strategy that clearly identifies what data is available to the organisation, what data needs to be held and how this data will be used going forwards. From this it becomes easier to define how the data will be held and gathered, and the resource and effort needed to undertake this function. And as with any business strategy, it needs to be reviewed and enhanced at regular intervals going forwards.

So what are the key components of a data strategy?

  • What customer or prospect data is available? You obviously need contact details, a fundamental for communications but what other data is known or could be available. It could be transactional/purchase data,  a history of communications from and to the customer or prospect, lifestyle data (B2C) or Company data such as turnover, employee numbers (B2B).
  • What data should we store and retain? The temptation is to keep all data but this can create a significant resource requirement in terms of storage and maintenance, particularly when social media data is involved. The Data Protection Act also requires us to only hold personal data that is relevant. Smart data”is better than big data.
  • How much data are we likely to gather? This is key to determining the data storage vehicle and the resource needed to maintain the data going forwards.
  • How will we store the data?  The choice here is endless and much depends on the answers to the above questions. And there are also decisions to be made as to whether off the shelf software is available that will match the data requirements (low up front cost, possible compromise as to what data is held and how), whether to produce a tailored in-house system (high up front cost, but system matches the data requirements) or whether to put the data management out with a third-party specialist (low up front cost but possible higher running costs).
  • How will we collect the data, input into the system and then maintain it? Included in this is the question of data quality. For example data trawled from the web or social media that is input by the user is often of poor quality, badly typed, abbreviated and difficult to utilise without significant data cleansing.
  • How do we keep the data up to date? People die, they move, they get married, they ask not to be contacted. Again the Data Protection Act requires us to keep personal data current.
  • What are we going to do with the data and will it serve this purpose?
  • How long will it take to build enough data to make it viable for the applications required of the data? Good data is like good wine, it comes into its own over time and with the right care will mature. Often databases will take several years to really start performing at their full potential.

But this structured approach to data planning is not what I see with the majority of UK Companies today. Running a Company that provides a full range of data strategy, management and analysis services, DDL Group spends more time with Clients sorting out bad data to make it accessible and usable for marketing campaigns than it does helping Companies with good data understand and unlock the power of the knowledge within the data to bring better ROI from its campaigns.

Only when your data model is correct will you be able to start unlocking the full potential of the intelligence held with the data which in turn will generate knowledge as to who your customers and potential customers are and more importantly how and why they buy from you. The ultimate aim of any marketeer is to have actionable intelligence about their customers that will help improve the customer relationship, increase retention and ultimately improve the return on marketing investment.


Data Cleaning – An Integral Part of Direct Marketing?

I am always surprised that undertaking a data audit and cleansing exercise before every direct marketing or digital marketing campaign is not a standard requirement when customer and prospect data is to be used. I hear comments such as:-

  • “We haven’t budgeted for data cleaning”
  • “We cleaned the data last year”
  • “We updated our database from the mailing returns”
  • We know our customers, they would have told us if their circumstances had changed”

Ignoring requirements upon us all under data protection legislation to keep data accurate and current, ignoring the environmental benefits, ignoring the impact on customers and prospects and their view as to the mailer’s competence, cost alone should be a driver to  undertake comprehensive data cleaning on every occasion. The savings made on print, fulfilment and postage costs both for the current campaign and future campaigns with the same data will outweigh the costs of data cleaning. In these difficult economic times where every penny has to be spent wisely and where return on investment is a key measure of success or failure of a campaign, data cleaning your customers and prospects regularly is essential.

So what are the key elements of any data cleaning exercise?

Address Validation & Correction. Comparing addresses against the Royal Mail Postal Address File (or “PAF”) to ensure the address and postcode are valid. This ensures your mailing arrives at its intended destination and on time. In addition discounts in relation to postage costs only apply to correctly addressed items.

Deduplication. Avoid sending the mailing more than once to the same recipient or possibly the same household. Its wasteful and looks bad. Deduplication is the process of identifying possible duplicates in the mailing and then actioning to reduce these duplicates to a single record.

Mortality Cleaning. Comparing the name and addresses against databases of people who have died(mortality registers) enables you to remove these from your database. Failure to do this can cause distress and hurt to he family of the intended recipient, and there is always an assumption on their part that you should have known. Businesses also stop trading, so checking your Company data against registers of dissolved businesses can also be undertaken.

Goneaways & Change of AddressPeople and businesses move and there are databases of people no longer at their old address to compare your records against. Why mail to someone who is not there? Some databases also know where the individual or business has move to and so a new address can be obtained to enable you to follow the customer or prospect to their new location.

MPS & TPS Cleaning. The Mailing Preference Scheme (“MPS”) and the Telephone Preference Scheme (“TPS”) are national registers where consumers can record whether they wish to receive certain types of communications by post or telephone. If you do not know whether your customer or prospect wishes to receive the intended communication then you should check against these registers and remove the record if the consumer has indicated no desire to receive it.

These are the key elements of any data cleansing exercise, there are other cleansing and data enhancements that can be made at the same time.

There are three prime benefits resulting from keeping data clean.

  • Economic. The costs for having data cleaned are not extortionate.  When compared with immediate savings that will be made from mailing your data, in most cases the savings will outweigh these costs. Further the costs are known in advance of committing to the cleansing through the use of a data audit. This process evaluates the data and works out what records it needs to modify or change and what the costs will be to achieve this. This audit is usually undertaken free of charge.
  • Environmental. Cleaning data reduces the environmental impact of a mailing. Removing records where the recipient has died, moved away or simply asked not to receive the marketing material reduces the amount of print and packaging used for the mailing. It also reduces the carbon footprint of the mail piece being delivered from mailer to recipient and then back again as a gone-away.
  • Brand Perception. Impact of your brand upon the recipient is not damaged by more than one mailing being received at the same time or by the mailing arriving late due to poor addressing, or through upsetting family members through not knowing the recipient had died.

In summary, my advice is to audit your data before every mailing and clean when and as indicated by the data audit. Remember not just to make the cleansing changes to the mailing about to take place but apply the changes back to your database to ensure all future direct marketing activity takes into account this new customer or prospect knowledge.