Catalogue cleansing · materials, vendors, services

Master data cleansing at any scale, from data audit to migration

We clean and standardise master data: taxonomy, templates, standard descriptions, duplicate and equivalent search. Our own AI tools speed up the work, and a master data specialist checks every group of records.

  • Free audit
  • Our own AI tools
  • Experienced master data specialists
  • Data ready for migration

Source records

  • ERPbrg 6205 2RS SKF
  • WarehouseBEARING 6205-2RS1 25X52X15
  • ProcurementBearing 6205 2RS (SKF)
Golden record

Bearing, ball, radial: 6205-2RS, 25×52×15 mm, SKF

  • 2 duplicates linked to the golden record
  • equivalent: NSK 6205DDU

What you get after cleansing

  • Standard descriptions and attributes by template for every class

  • Duplicates found and linked to the golden record

  • Users and systems find every item without ambiguity

  • A list of unnecessary purchase requests and the savings potential

  • A catalogue ready to load into SAP, ERP or MDM

Our clients include

  • Nornickel
  • Transneft
  • X5 Group
  • Weatherford
  • Vale
  • Shell
  • Statoil
  • Nordgold
  • Highland Gold
  • Binnopharm
  • EKF
  • Trident Energy
  • Greenatom
  • Klyuchavto
  • Tiger Realm Coal
  • RANEPA

Definition

What is master data cleansing?

Master data cleansing brings a catalogue to one set of rules. Every record gets a class, a set of attributes from a template and an unambiguous description. Duplicates are found and linked to a golden record, and missing data is added from manufacturer catalogues and technical standards.

Before cleansing

One item, three records

  • ERPbrg 6205 2RS SKF
  • WarehouseBEARING 6205-2RS1 25X52X15
  • ProcurementBearing 6205 2RS (SKF)

Abbreviations, mixed case, attributes merged into one string. Search finds one record out of three, the stock is not visible, and the item is bought again.

After cleansing

One golden record

MRO / Bearings / Rolling bearings / Ball bearings, radial

Bearing, ball, radial: 6205-2RS, 25×52×15 mm, SKF

Designation
6205-2RS
Dimensions, mm
25×52×15
Seal
both sides
Manufacturer
SKF
Golden2 duplicates linkedequivalent NSK 6205DDU

The description is built from template attributes, so identical items no longer differ in spelling.

  • Data brought to one standardBy master data templates, with software that recognises the meaningful parts of each record

  • Several catalogues centralisedWe match two or more catalogues and build one version

  • Duplicates removedMatching that accounts for synonyms, format, type and other features

  • Better processesMaster data maintenance rules that fit your organisation

  • Higher master data qualityAutomatic checks plus manual review by experts against the rules

  • Higher profitabilityAccurate stock records, unnecessary purchases blocked, unrecorded stock put to use

When you need it

When a catalogue needs cleansing

A catalogue gets cluttered gradually: everyone creates items their own way. The problems show when they start costing money or delay a project.

  • One item under different namesIt is in the warehouse, but a request buys it again.

  • Catalogue search does not workAbbreviations, mixed spelling, all characteristics in one field.

  • Moving to a new ERP or implementing MDMOld errors must not move into the new system.

  • Merging cataloguesSeveral plants or subsidiaries keep their own catalogues, and you need one.

The service is for catalogues of 20,000 items and more, most often in manufacturing, mining, oil and gas, energy and pharmaceuticals.

Stages

Main stages of master data cleansing

Four stages, each ending with a check and an agreed result. We work through the catalogue in groups of classes: the first groups are handed over while the next are still in progress.

  1. Stage 01

    Data audit and methodology

    What we do

    • Free quick assessment of your export, usually within a week
    • Profiling: errors, potential duplicates, inactive and obsolete records
    • We define the project scope and cleansing categories by class
    • We agree what to do with unidentifiable records and records to block

    What you get

    • Data quality report
    • Agreed scope of work
    • Cleansing methodology: goals, catalogue structure, rules for descriptions, duplicates and cleansing
  2. Stage 02

    Taxonomy and attribute templates

    What we do

    • We define the class of each record, usually by its noun
    • We build a hierarchical taxonomy of 2 to 6 levels
    • For each end class we set attributes based on our expertise and your data
    • We agree the templates with your experts: 2 or 3 meetings with each working group

    What you get

    • Approved taxonomy
    • Templates linked to end classes
    • Rules for short and long descriptions
  3. Stage 03

    Cleansing and enrichment

    What we do

    • We fix catalogue errors automatically
    • Software recognises the meaningful parts and splits each record into attributes
    • We add missing data from manufacturer catalogues and technical standards
    • We search for duplicates automatically by the recognised parts and, if needed, for equivalents

    What you get

    • Cleansed records by groups of classes
    • Golden record and duplicate matrix
    • List of unidentifiable records
  4. Stage 04

    Results and handover

    What we do

    • We hand over groups in batches, experts check attributes, classes and duplicates
    • We cleanse records created during the project
    • We prepare the data in your system's load template
    • We load to a test environment, then to production

    What you get

    • Consolidated table for each group
    • Load template for SAP, ERP or MDM
    • List of unnecessary purchase requests

Working together

Results agreed with your working groups

For business-critical sections, such as finished goods, the result is agreed in rounds. Synopps experts prepare a proposal, your working group adds corrections, and the data owner approves the result.

2 or 3 roundsof corrections per section

  1. 1

    We prepare the section

    We classify records and build the section taxonomy

  2. 2

    We discuss it with the working group

    We show the taxonomy and records and collect comments

  3. 3

    We approve

    The section taxonomy and records are agreed

Synopps expertsmaster data specialists for the section and a master data lead

Synopps and the working groupyour material master specialists

Data ownerone per section

Results by stage

Results of a master data cleansing project

Besides a clean catalogue, you get the rules to keep it clean. These are the key project results.

Before the start: quick assessment of your exportfree, about a week

94,908records in the export

Exact project scope

74,148to work on · 78%

20,760to archive: generic and obsolete

Of the records to work on

84%

matched to our templates

950 templates for the whole catalogue, the 100 most common cover 84%

Initial template match

11,112

potential duplicates

15% of records in work, checked in a separate stream

Savings potential

12,315

errors found

7 standard checks: mixed character sets, symbols, syntax, spelling and more

Fixed automatically

An example from a real export. Before the contract you already know how many records are in scope, how much matches a template and how many duplicates to expect.
Taxonomy and class templateStage 2

1Taxonomy

  1. Level 1MRO
  2. Level 2Bearings
  3. Level 3Rolling bearings
  4. End classBall bearings, radial

2 to 6 levels. Each end class has its own template.

2Template: attribute set

NounBearingreq.
Typeball, radialreq.
Designation6205-2RSreq.
Dimensions, mm25×52×15req.
ManufacturerSKFopt.

The noun is the defining word of a record. Together, the attributes identify the item without ambiguity.

3Description format

NounTypeDesignation,Dimensionsmm,Manufacturer

Bearing, ball, radial: 6205-2RS, 25×52×15 mm, SKF

The standard description is built from attribute values by this format, so identical items do not differ in spelling.

We agree the taxonomy and templates with your experts for each section, usually in 2 or 3 meetings with the working group.
Cleansed catalogue: before and afterStages 3 and 4

Before · 7 records

After · 4 golden records

  • brg 6205 2RS SKF
  • BEARING 6205-2RS1 25X52X15
  • Bearing 6205 2RS (SKF)

3 → 1duplicates merged

Ball bearings, radialBearing, ball, radial: 6205-2RS, 25×52×15 mm, SKF

  • bolt m12x60 galv
  • Bolt M12*60 ISO 4014 zinc

2 → 1duplicates merged

BoltsBolt, hex head: M12×60, ISO 4014, zinc plated

  • Gskt CAF 2mm 100*60

1 → 1by template

GasketsGasket, non-asbestos fibre: 100×60×2 mm

  • chk valve dn25 pn16

1 → 1by template

Check valvesValve, check: DN25, PN16

Each record gets a class and a description by template, and duplicates are merged into one golden record. You approve the result in batches by groups of classes.

The documents are shown as examples. In a project they are built from your catalogue.

Project documents

Cleansing methodology and master data maintenance rules

We agree the methodology at the start of the project, and the catalogue is cleansed by it. We write the maintenance SOP during or after cleansing so the catalogue does not get cluttered again. Both documents stay with you.

Cleansing methodology for the Materials catalogue

Document · agreed at stage 1, before cleansing

Contents

  1. Goals of record cleansing
  2. Goals of record classification
  3. Catalogue structure
  4. Rules for description templates
  5. Rules for finding and removing duplicates
  6. Rules for record cleansing

Approved by the clientp. 1

Master data maintenance SOP

Document · during or after cleansing

Section 3. Creating a new item

  1. UserMaterial request
  2. Is the item in the catalogue?Yes: issue or purchase by the golden record
  3. RequesterNew item requestby template, with class selection and duplicate check
  4. Subject matter expertNeed checkadds data
  5. Master data specialistCheck and approvalcompleteness, class, duplicates
  6. Is the data correct?No: returned for rework
  7. CatalogueRecord in the master data catalogueavailable for issue and purchase

Items are issued and purchased only against catalogue recordsp. 7

An SOP works when a tool supports it. For that we have new material requests with checks at entry.

Savings

Savings calculation and blocking unnecessary purchase requests

We match confirmed duplicates against stock and open requests and give you a list of purchases you do not need to make.

How a duplicate leads to an unnecessary purchase

Before

Needed 10 EAVisible in stock 5 EArecord 1another 5 EAunder a duplicate, not visiblePurchase +5 EA

After

Needed 10 EAIn stock 10 EAduplicates mergedPurchase 0request blocked

Real case

16%

less spent on purchasing: the items were already in the warehouse under duplicate records. Figures in millions, local currency.

  • Issued from stock142 → 228
  • Purchased553 → 467

Approach

Why software-driven cleansing works better

Synopps tools understand the structure of a record, fix errors and find duplicates even when they are worded differently. AI speeds up classification and processing, and a master data specialist checks and confirms each group.

  1. APreparation and clean-upcharacter sets, spaces, special charactersAI
  2. BSplitting into meaningful partstype, designation, dimensions, standardAI
  3. CCleansing and enrichmenttemplate attributes, manufacturer dataAI and expert
  4. DDuplicate detectionsearch, grouping, golden record choiceAI and expert
  5. EApproval and migrationbatch acceptance, load formatexpert and you

Quality criteria for accepting the result

  • CompletenessMandatory attributes filled to the standard

  • IdentifiabilityPeople and systems understand the description the same way

  • ConsistencyRecord characteristics do not conflict

  • No duplicatesDuplicates removed or linked to the golden record

Tools we work with

We cleanse data with our own Synopps tools. See what each of them does.

What we cleanse

Which master data we cleanse

The methodology is the same, but each domain has its own templates, enrichment sources and duplicate rules.

  • Materials and MRO

    Materials, spare parts, equipment. Classification, templates, enrichment from manufacturer catalogues, equivalent search.

  • Vendors and customers

    Tax and registration numbers, bank details and addresses, merging duplicate suppliers and customers.

    Vendor master data
  • Services

    Standard service names and classes for procurement, contracts and reporting.

  • Maintenance master data

    Equipment, bills of materials, spare parts linked to equipment.

    Equipment master data

Classifications and catalogues

We link records to external classifications and update references to technical standards: ISO, DIN, ASME, API.

  • UNSPSC
  • eCl@ss
  • ETIM
  • HS codes
  • National product codes
  • Manufacturer catalogues
  • Your classification

Working models

How cleansing can be organised

The choice depends on whether you have your own master data team and whether a system change is coming.

Most common

A

A turnkey project

We run all four stages and hand over the agreed catalogue in your system's load format.

Your exportSynoppsGolden

B

Your team, our methodology

We prepare the methodology, taxonomy and templates and train your specialists. Your staff cleanse the data, and we control quality.

Master data and MDM course

C

As part of an MDM implementation

We cleanse while MDM is being configured, so golden data is loaded at go-live.

Next step: MDM implementation

To keep the catalogue clean after the project, you can hand over master data maintenance to us or add checks on new items at entry.

Timeline and cost

How long cleansing takes and what it costs

A catalogue of 50,000 to 60,000 records usually takes 2 to 3 months. Timing depends on data volume and the depth of checks.

Sample plan: a catalogue of 50,000 to 60,000 records

Month 1Month 2Month 3

Free assessmentup to 1 week

Audit and methodologymethodology, scope

Classificationtaxonomy, templates

Cleansingby groups of classes

Handoverin batches, migration

What the cost depends on

We estimate the cost after the free assessment of your export, once the volume and condition of the data are clear.

  • Catalogue size and number of classes
  • Condition of the source data
  • Depth of enrichment from external sources
  • Whether equivalent search is needed
  • Load format and migration
  • How much your experts take part in approval

Migration

Loading cleansed data into SAP, ERP and MDM

We prepare the agreed data in the target system's load template with the required fields and formats. First a test load, then production.

  1. Agreed cataloguegolden records, duplicates, equivalents
  2. Load templatein your system's format
  3. Test environmentload check
  4. ProductionSAP, ERP, MDM
  • We also cleanse records created during the project, so the catalogue is complete at load time.

  • The duplicate merge matrix accounts for stock, requests and orders, so duplicates can be retired without losing history.

Experience

One of our master data cleansing projects

75,000 records of a central catalogue cleansed for an international mining company.

Client

An international mining company with subsidiaries in several countries. A central catalogue of 75,000 records, inconsistent item creation, duplicates, growing stock and excess purchasing.

What we did

  • Automated and manual data cleansing
  • Duplicate merge matrix that accounts for stock, requests and orders
  • Enrichment from manufacturer catalogues and other sources
  • 50,000items brought to the approved standard and enriched
  • 4,000duplicates. A golden record was chosen in 3 minutes instead of about a week of manual work
  • −19%catalogue size

More projects

FAQ

Master data cleansing: common questions

Did not find the answer? Send your question with a catalogue export to info@synopps.com.

What is master data cleansing?

It is the process of standardising and cleaning master data to make it consistent and reliable. Cleansing removes duplicates, unifies descriptions and attributes, improves analytics and makes procurement and inventory management more efficient.

Why does master data need cleansing?

Without clean data a business loses accurate analytics and pays for duplicate purchases and staff time. Cleansing gives one data standard and prepares the company for an MDM implementation or a move to a new ERP.

Who is the service for?

Companies with large catalogues of materials and services, from 20,000 items. Especially manufacturing, mining, oil and gas, energy and pharmaceutical companies.

How does a cleansing project run?

We collect and analyse the data, set up templates and the taxonomy, run automated cleansing and check the results, then agree and hand over the clean catalogue. The results can be loaded into SAP, ERP or other systems.

How long does a project take?

A project for 50,000 to 60,000 records usually takes 2 to 3 months. Timing depends on data volume and the depth of checks.

How do we send data for assessment?

Send a catalogue export (Excel or CSV) to info@synopps.com with a short description of the task. We will assess the complexity free of charge and propose an approach.

How is data security ensured?

On request we sign an NDA and process data only for the agreed purposes. All files are kept in an isolated environment.

Free assessment

Free assessment of your catalogue

Send a request or email an Excel or CSV export to info@synopps.com with a short description of the task. We will show how many errors and duplicates the catalogue has and propose an approach.

  1. 1
    Export

    Excel or CSV, part of the catalogue is fine

  2. 2
    Assessment within 1 week

    Volume, errors, duplicates, inactive records

  3. 3
    Proposal

    Approach, timeline and cost

0
200000
We use your details to respond to your request. See our Privacy Policy.