Accelerator · Data Normalisation Hub

UNIFY
Data Normalisation Hub

A translation and normalisation layer across BSS, OSS, CDR/xDR and mediation feeds — one subscriber ID, one code set and one format network-wide, so billing, assurance, analytics and AI all work from the same records.

See the live dashboard
6
Agents in the squad
50+
Source formats supported
4
Rule families
End-to-end
Lineage from source file to output
One subscriber, one record
Illustrative normalisation
Source records → canonical model
MEDIATION.csv · A_NUM=639171234567MSISDN +63 917 123 4567
BILLING copybook · ACCT-NO 0045521Account 45521
CRM.json · partyId P-88213Subscriber ID S-88213
Correlated into one golden subscriber record
Example values for illustration.
Chapter 4The proof Use case 4 of 6 Value-chain stageCross value chain · BSS/OSS foundation

Fix the foundation once

The pressureLegacy BSS/OSS describes the same subscriber a dozen ways — and every project re-solves the mapping.

Why it matters to an operator executiveNormalising once is what lets every later AI use case go live in weeks instead of quarters, and it de-risks BSS modernisation. It is the least glamorous and most reused investment on the roadmap.

Where it sits in the telecom value chain
  1. Network
  2. Product & pricing
  3. Sales & channels
  4. Customer care
  5. Billing, RA & fraud
  6. Wholesale & enterprise
  7. Regulatory

A foundation capability: it serves every stage, so later use cases go faster.

Business lens

From a business outcome to measured value

We start from the KPI an executive owns, not from the technology — then work back to the decisions, data and agents that move it.

Our delivery methodology
  1. 1 · Outcome & KPI One trusted record Time-to-data for new use cases · DQ pass rate · duplicate rate
  2. 2 · Value-chain domain Every stage Network, BSS/OSS, product, care, billing
  3. 3 · Decisions Which value is golden Which mapping applies; what to quarantine
  4. 4 · Data Four decades of formats Mediation and xDR, billing copybooks, CRM, OSS inventory, extracts
  5. 5 · AI & agents 6-agent squad Schema detection, fuzzy ID resolution; agents parse, translate, validate, correlate
  6. 6 · Governance & adoption Rules as config Versioned mappings approved by data owners; lineage source to output
  7. 7 · Measured value Reuse, not rework Canonical data products every accelerator builds on

How we’d deliver it

Indicative durations · sized with you in discovery
  1. 1 2–3 wks
    Discover & value case
    Main deliverable

    Source and identifier landscape; value case

  2. 2 2–3 wks
    Design
    Main deliverable

    Canonical telecom data model and rule families

  3. 3 30–45 days
    Build & integrate
    Main deliverable

    2–3 sources normalised into a golden subscriber record

  4. 4 2–4 wks
    Deploy & adopt
    Main deliverable

    First consumer — billing, RA or analytics — live

  5. 5 Ongoing
    Run & scale
    Main deliverable

    Add sources in sprints; DataOps under SLA

Same five phases on every engagement; the pilot (phase 3) runs on your data with your team. How the methodology works →

The problem

Every system describes the subscriber differently

Operators run decades of BSS and OSS side by side. The same customer, product and event arrive in different formats, codes and identifiers — and every downstream team re-solves the mapping.

Same subscriber, many IDs

MSISDN, IMSI, billing account and CRM party IDs rarely line up, so a single customer view needs custom joins in every project.

Formats from four decades

COBOL copybooks, fixed-width mediation files, CSV extracts and JSON APIs all feed billing, assurance and analytics.

Quality problems surface late

Bad codes and duplicates are found at invoice time or in revenue-assurance reports, long after they entered the data.

Our approach: normalise once, at the fabric layer, with rules and lineage you can audit — then every accelerator and data product reuses the same canonical records.
How it works

Parse, translate, validate, correlate, distribute

UNIFY runs as a governed pipeline on the Data Fabric Framework. Rules are configuration, not code, and every record keeps its lineage back to the source file.

Source feeds
Parse
Translate
Validate
Correlate
Distribute

The agent squad

Six agents do the routine normalisation work; data engineers own the rules and approve new mappings.

Format Parser Agent
Schema analyser
Detects and parses formats from legacy and modern systems, including COBOL copybooks, fixed-width mediation files and proprietary layouts.
Translation Agent
Format converter
Transforms records into the canonical model while preserving integrity and applying code-set and business rules.
Validation Agent
Quality enforcer
Applies configurable validation rules for completeness, consistency and referential integrity across all outputs.
Correlation Agent
ID resolver
Resolves subscriber, account and device identifiers across systems into one golden record.
Deduplication Agent
Record cleaner
Finds and merges duplicate records with fuzzy matching while keeping the most accurate values.
Distribution Agent
Output router
Routes normalised data to the lakehouse, billing, assurance, analytics and AI consumers.
Screens · live on demo data

Normalisation and data quality dashboard

Rule pass rates, failures by source and normalisation volumes by format — the screens a data engineering team works from.

Figures load live from the demo platform (quality rules and normalisation runs). Source names reflect the demo data set.

Overall data quality
—%
Active quality rules
—
Records checked
—
Records failed
—
Records normalised
—
Normalisation success
—%
Source formats
—
Lineage
Source → output
Failures by source system
Average pass rate by rule type
Rules by channel
Pass rate by quality rule
Normalisation volume by run
Normalised records by source format
Normalisation by type
Success rate by format
Quality rulesPass rate per rule and source
RuleTypeSourceProcessedFailedPass rate
Illustrative demo briefWritten from this page’s synthetic demo data · not client results
What the demo data shows

Format and validation rules pass at the highest rates. Correlation rules — matching the same subscriber across systems — and enrichment rules fail most often: the classic subscriber-ID problem. Legacy CSV extracts and COBOL copybooks carry the largest volumes and the most failed records.

Where we would act first
  1. Fix correlation rules across MSISDN, IMSI and billing account first.
  2. Quarantine failed records with their lineage instead of letting them flow downstream.
  3. Publish the golden subscriber record to billing and revenue assurance as the first consumers.
What a pilot would prove

Two or three sources normalised into one canonical model, with a measured rise in rule pass rates and a first consumer live.

Who uses it

Who uses UNIFY

UNIFY serves the teams who build on subscriber data and the teams who depend on it.

CIO / CTO

Technology leadership

  • Modernise BSS/OSS integration without a big-bang migration
  • Less point-to-point integration and technical debt
  • Cloud-ready, API-first data distribution

Chief Data Officer

Data governance

  • Enterprise-wide quality rules with pass-rate tracking
  • Automated lineage and impact analysis
  • A master-data foundation for subscribers and products

Enterprise architect

Architecture

  • A canonical telecom data model
  • An abstraction layer over legacy systems
  • Event-driven integration patterns

Billing & revenue assurance

Revenue teams

  • Consistent subscriber and rating data for billing
  • Fewer disputes caused by data errors
  • Audit-ready records for reconciliation
Why UNIFY

Built for telecom formats and identifiers

How a governed normalisation hub compares with the approaches operators typically use today.

CapabilityUNIFYETL toolsCustom scriptsManual process
Legacy format support 50+ formats, configurable Limited connectors Custom coding per format Manual parsing
Subscriber ID correlation Fuzzy and rule-based matching Exact match only Custom logic Manual lookup
Validation Rules plus ML anomaly checks Rule-based only Basic checks Manual review
Lineage Automatic, source to output Partial Documentation only None
Change a mapping Configuration, versioned Developer change Code release Spreadsheet update
On the Data Fabric Framework

Platform architecture

UNIFY sits in the Connect and Curate layers of the framework and publishes canonical data to every consumer. About the framework →

Telecom source systems
Mediation / CDR
Billing (BSS)
CRM
OSS & inventory
Legacy files
Ingestion
Connectors
Streams
Batch
Security
UNIFY processing
Parser
Translator
Validator
Correlator
Deduplicator
Consumers
Lakehouse
Revenue assurance
Analytics & BI
AI & agents
APIs
Value

What operators get from normalising once

Capabilities, not promises: the outcome depends on your source landscape, which we size in discovery.

One subscriber view

Every team and accelerator reads the same correlated subscriber, account and device records.

Faster new use cases

New analytics and AI work starts from canonical data instead of another round of source mapping.

Quality you can see

Rule pass rates and failures by source are measured continuously, not discovered at invoice time.

Audit-ready lineage

Each output record traces back to its source file, rule version and correlation decision.

Getting started

From pilot to production

Most UNIFY engagements start with two or three source systems and one downstream consumer, then add sources in sprints.

Step 1

Discovery

Map source systems, formats and identifier schemes; agree the canonical model and the first consumer.

Weeks 1-2
Step 2

Pilot

Connect two or three sources, configure parsing, validation and correlation rules, and publish canonical records with lineage.

30-45 days
Step 3

Scale & run

Add sources and consumers in sprints; hand over to DataOps under our managed service if you choose.

Ongoing
Chapter 4 · The proof · 4 of 6

Next: turn disputes into loyalty

Bill shock and slow dispute handling are leading churn triggers in a saturated market.

UNIFY capability tour
AI
AI Analyst

I'm the DaasLabs AI Analyst for the telecom demo platform. I can help with:

  • Revenue assurance & CDR reconciliation
  • Fraud: SIM swap, SIM box, IRSF and Wangiri
  • Churn, customer and network analytics
  • Executive briefings across the accelerators

Answers are generated from the demo data.