Email a colleague    

August 2012

Carrier Usage Audits: Why Regular Checkups Are the Key to a CSP’s Bottom-Line Health

Carrier Usage Audits: Why Regular Checkups Are the Key to a CSP’s Bottom-Line Health

Audits are not rare; they are everyday events.  When a waiter hands you the final bill at a restaurant, you scan it, check the addition, and then detect a charge for a margarita you never ordered.  The waiter then corrects the bill and you’ve just completed a rudimentary cost-assurance process complete with audit, dispute and reconciliation.

Translate this simple restaurant bill process to the one behind a full-scale carrier audit and there are a lot of similarities when you don’t count things like: a big increase in rating complexity; the addition of millions to billions of line items to check; and the need to synchronize input from multiple data sources and internal organizations.

The money at risk is the big difference, of course.  An error on a restaurant bill might cost you an extra $10.  Bad intercarrier bills could cost your company tens of millions of dollars in undetected discrepancies each year.

My mission in this column is to change some thinking around carrier audits.  Rather than a once-a-year or once-a-quarter audit, I’m going to make the case why carriers need to perform audits on a more regular basis.  Carrier invoices are such a major expense for CSPs, it’s well worth the price to conduct monthly audits to ensure the charges are accurate.

What’s more, many telecom executives are wholly unaware of the many risks of not having a solid auditing program.  So I’m going to shed some light on this subject and briefly discuss: the different types of audits; the organizations involved; the dangers of not auditing frequently; and the factors you should consider when selecting a cost-management vendor.

By the way, I will focus exclusively on usage (or transaction) audits.  Audits on the fixed/circuit facilities side are important too, but we’ll save that discussion for another time.

The Variety of Usage Audits Performed in Cost Management

Many types of audits are performed across the enterprise to ensure contract compliance.  And, based on the situation and your company’s objectives, some audits will deliver more value than others.  So here is a short list of the most common types of audits a CSP can conduct in the cost management area:

  • Contractual rates vs. actual rates
  • Switch vs. invoice volume (records and/or MOUs)
  • Switch vs.  LCR system
  • Jurisdiction validation (inter/intra state, MTA, LATA etc.)
  • Termination validation (mobile or landline)
  • Rated CDRs to invoice totals (expense, volumes, etc.)
  • Cost to revenue or margin audit

Why Most CSPs Need to Perform Monthly Usage Audits

Regular carrier audits should be an essential component of a CSP’s overall business-assurance plan.  In our discussions across the industry many CSPs perform an audit only once a year.  But our experience across many North American clients tells us that almost every CSP is better off performing usage or transaction audits once a month

There are two good reasons for auditing monthly.  First, depending on the contracts involved, you may not be able to collect anything if you wait too long to dispute.  Many contracts set limits on how far back a CSP can dispute a charge.  Typically these are set to 30, 90 or 120 days.  So, if you’re only checking every 365 days and actually find something, you’re limited on what you can collect in the dispute filing.

The second reason for performing monthly audits is to keep abreast of quickly changing third-party modifications as the following case study shows:

Case Study: Data Enrichment = $800K a Month Billing Error

For the first two months of 2011, our netCLARUS system reported very small discrepancies between the contracted and billed rates at one of our Tier I customers.  Then, in mid-March, we observed a major unexplainable spike.  Nothing had changed on the vendor side and carrier management confirmed that no new rates or new discounts were applied to the bills.

Following an enterprise-wide investigation, we found that the client’s engineering group had modified its data-enrichment process for routing purposes.  While that change was perfectly fine and necessary from a routing perspective, it caused havoc on the vendor’s billing system, i.e. that of the Inter eXchange Carrier (IXC).  This seemingly innocent enrichment change caused the nationwide IXC to mis-rate our client’s calls to the tune of $800,000 per month.

After a detailed analysis, WeDo Technologies collaborated with our client to put together a comprehensive and compelling dispute package containing the painful details.  In the end, our client recovered 99 percent of the disputed amount.  And, because the error existed within our other existing clients, we ended up issuing disputes for those clients that amounted to nearly $10 million dollars over a nine-month period.

The point of the case study is that it emphasizes the importance of constantly refreshing your audit reports so you can catch things before they get out of hand.  Fortunately, because our clients were conducting audits as part of a regular business-assurance process, they received 99 percent of what was disputed as a credit.

Confusing Internal Communication & Source Data

As we just saw, because so many internal and external organizations are involved in the carrier management process, Murphy’s Law applies: Things go wrong when you least expect them.

Unfortunately, most business units speak different languages and have different success KPIs.  The result can be miscommunication, a lack of reliable data, poor collaboration, and missed opportunities.  For example, engineering and finance both support network operations, but come at the problem from completely different perspectives and objectives.

WeDo Technologies Audit Data Sources

One of your first steps to ensuring a successful audit process is to establish a common language between the organizations. 

This is important when you consider the many data sources involved.  For instance, you should not assume that another party or organization interprets a data field of a particular data source in the same way that you do.  You might be surprised how many times folks run into errors because poor assumptions were made at the beginning.

To show you how many cooks and are stirring the kettle, at right is a quick list that matches different types of source data with the organizations.

How to Qualify an Audit Firm

Your selection of a third-party firm to conduct that audit is critical.  We’ve seen plenty of cases where a service provider hired a firm that could not produce good results because the vendor lacked the requisite experience.  Here are some key questions to ask to ensure you select the right audit partner:

  • Expertise -- How long has the audit firm been performing the specific audit being requested (as opposed to generic usage audits)?  Is the vendor conversant with all business units of the enterprise that need to be involved in the audit?  Select a vendor who can demonstrate a thorough understanding of the telco engineering, finance, and carrier management sides of the usage analysis audit you need.
  • Tools -- You should raise a red flag if the audit firm is leveraging Excel or MS Access to audit billions of transactions across complex rating algorithms.  Does the firm have the right tools in place to support your company’s volume?  Be careful about selecting a vendor that touts its “big data“ platform, but lacks the specific audit expertise in question.
  • References -- Speak to other companies that have used the audit firm.  Did they get the attention to detail they required?
  • Success Rate -- Not all audits will result in a win, but if disputes are filed, did the vendor deliver enough compelling data to win the dispute?  If so, how much did they collect and what were the time frames involved?

Revenue Share or Fixed-Price Contract

Once you select your audit vendor, the other key question you need to address is how to engage with them.

There are two basic engagement models: fixed price contract or revenue share.  Both of these models have their pros and cons.

The basic merit of a revenue share model is: If the audit firm finds something, they get a percentage of what is captured and returned.  If nothing is found, no money is exchanged.  At face value, that sounds like a prudent way to go.

But what happens if the audit firm finds $50 million and the contract is worth 20 percent of the recovered fee?  Will the CSP hand over $10 million?  It will be tough to convince your CFO or COO to pay an audit firm millions of dollars.  Will the CFO want to renegotiate because he thinks $10 million is excessive?

On the other hand, if the audit firm finds nothing, isn’t there some value in the work the audit firm performed?  We’re happy to pay a medical doctor for an exam that gives us a clean bill of health.  The audit firm found no discrepancies.  Assuming the firm did a thorough job, which should be good news to the CSP.

OK, now let’s look at the fixed price option.  The beauty of a fixed price contract is that the CSP can clearly forecast the cost of the audit.  In turn, the audit firm can use the monies to subsidize the cost of the work involved in performing the audit.

If you want the best of both worlds, why not have a fixed-price contract and offer the audit firm a small percentage upside based on savings recovered.  I think that’s a very good model because it encourages collaboration and keeps everyone focused on the real goal.  It also minimizes the need for legal wrangling around what is — and what is not — a disputable charge.

After all, the point of an audit is not just to find discrepancies.  It’s to change the business process so discrepancies don’t repeat themselves over and over again.

Usage audits will continue to be an essential piece of a carrier’s business-assurance plan, but they need to be conducted regularly and with the right auditing partner to ensure the maximum amount of invoice errors are detected, disputed and collected on.

So, happy hunting — and don’t forget to check that restaurant bill.

This article first appeared in Billing and OSS World.

Copyright 2012 Black Swan Telecom Journal

Brian Silvestri

Brian Silvestri

Brian Silvestri is Founder of SilverEcho Consuliting and provides technical and strategic business advice to companies in the telecom eco-system — including software, service and communications providers.

SilverEcho help companies map out business strategies by promoting collaboration across multiple departments with clear objectives, success metrics and timelines.

Based in Washington, DC, Brian is the former head of North American Sales for WeDo Technologies and prior to that was CEO of Connectiv Solutions, a specialist in traffic analytics and cost assurance, a firm that WeDo acquired.   Contact Brian via

Black Swan Solution Guides & Papers

cSwans of a Feather

  • TEOCO Brings Bottom Line Savings & Efficiency to Inter-Carrier Billing and Accounting with Machine Learning & Contract Scanning interview with Jacob Howell — Learn the challenges and benefits of developing of new Machine Learning and Computer Vision system for wholesale billing accounting and inter-carrier contract reading.
  • Special Report: Wholesale Systems for Advanced Services by Dan Baker — Plenty of technology and market changes are disrupting the telecom wholesale market: advanced services, new kinds of partners,,and the need to monitor relationships and services more closely than was ever required in the circuit voice world.  This article introduces a TRI special report discussing the kind of Wholesale Systems needed in this challenging marketplace.
  • Data Integrity Issues Go Global in the Telecom Wholesale Exchange interview with Vic Bozzo — Wholesale systems enable operators to expand their global reach and work efficiently with partners in an increasingly interdependent telco business.  In this article, you’ll learn about: how many subsystems work together in support of the global trading exchange, why data integrity has become critical, and how wholesale business trends are affecting wholesale systems at Tier 1 and mobile operators.
  • Carrier Usage Audits: Why Regular Checkups Are the Key to a CSP’s Bottom-Line Health by Brian Silvestri — Many telecoms are wholly unaware of the risks of not having a solid usage auditing program for interconnect bills.  Rather than a once-a-year or once-a-quarter audit, this article makes the case for regular monthly audits.  Also discussed are: the different types of audits and organizations involved; the dangers of not auditing often; and factors to consider when selecting a cost-management vendor.
  • Invoice Audit Productivity: From 19th Century Textile Mill to SaaS by Peter Yelle — When it comes to invoice reconciliation, are your processes and tools modern and efficient, or is your company stuck in a 19th century time warp?  This article show how operators can vastly reduce their manual audit steps by automating via a SaaS solution.  The  detailed case study and diagram show which tasks were automated to achieve an 80%+ productivity gain.
  • An Automated Self-Audit Approach to Telecom Cost Assurance interview with — What’s the value of an automated approach to invoice validation?  This article explains the power of the SaaS model where the vendor supplies the data-processing expertise, relieves the operator of tedious manual work and boosts auditor productivity so more money is saved.
  • Cost Assurance: Dealing with Rating Variety in Wholesale Bills by David West — Validation of intercarrier wholesale invoices seems like a fairly straight forward process.  But regulatory rules and a variety of bill rating methods have made it very complex.  This article details the challenge by walking through a wireless carrier case, then laying out the argument why operators should opt for a custom solution based on a core reporting engine.

Related Articles

  • Black Swan Guide: Araxxe’s Revenue Assurance Consulting, Testing, and High Definition Billing Analysis Service by Dan Baker — How Araxxe’s end-to-end revenue assurance complements switch-to-bill RA  through telescope RA (external and partner data) and microscope RA (high-definition analysis of complex services like bundling and digital services).
  • Subex’s IDcentral Monetizes Telco & Enterprise Data to Deliver Digital ID & Risk Metric Services for Financing, KYC & More interview with Shankar Roddam — A new digital intelligence service that monetizes the idle data of telecoms and enterprises while also earning a good return for the owner of the data.
  • Opportunities & Obstacles: Consultant Luke Taylor Muses on the State of the Telecom Risk Assurance Business interview with Luke Taylor — A rambling discussion on the state of the risk assurance business with Luke Taylor, independent consultant in telecom revenue/fraud assurance and solution requirements and marketing.
  • LATRO’s Tips for Launching a Successful Revenue & Fraud Assurance Program for Mobile Money Operations in Developing Countries interview with Don Reinhart — A company building mobile money RA/FM tools and  managed services gives a concise, but detailed tutorial on how the Mobile Money Ecosystem works.  Revenue assurance pros will get tips on  what to look for in analytics/assurance tools, controls, and professional services.
  • A WeDo Conference Talk: Consulting & Analytics: Improving your Business Today, Enhancing it Tomorrow interview with Carla Cardoso & Bernado Lucas & Thomas Steagall — Leading risk management consultants explain their mission and walk-through RA, subscription fraud, and collections cases.  They also explain how analytics and machine learning can supplement process optimization.
  • PrologMobile’s Simple and Brilliant Plan to Save US MNOs Billions a Year in Recovered Phones & Retained Customers interview with Seth Heine — An expert in the mobile phone reverse supply chain explains how MNOs — via a neutral third party information exchange — can recover their original phones on the used market and save huge sums in multi-year customer retention.
  • WeDo Explores the IoT Ecosystem in Search of Tomorrow’s Pivotal Fraud & Business Assurance Solutions interview with Carlos Marques — A veteran product manager scans the IoT terrain, discusses key fraud and assurance challenges, and explains the preparatory steps WeDo is taking to become a key player in this emerging market.
  • New Report: Telecom Fraud & Business Assurance Solutions, Services & Strategies by Dan Baker & Luke Taylor & Colin Yates — TRI publishes a new market research report, Telecom Fraud & Business Assurance Solutions, Services & Strategies.  Free executive summary available.
  • Subex Juggles a Wide Variety of Business Assurance and Big Data Analytics Use Cases interview with Rohit Maheshwari — A expert in business assurance solutions explains top use cases such as: IoT security, big data analytics/AI, network asset optimization, multi-player gaming assurance, onboarding mobile subs, and AI customer analytics.
  • MTN Agility: Mastering Exponential Technologies in Revenue/Fraud Assurance and Beyond interview with Danie Maritz & Tony Sani & Luke Taylor — An in-depth look at RAFM operations and innovation at the MTN Group.  Topics discussed include RA/fraud control challenges, strategies, and MTN’s journey to exploit exponential tech (AI, robotics, and ML) in its RAFM program and support of internal non-telco businesses.
  • From Byzantine Software Contracts to Simple & Flexible RA Managed Services interview with Philippe Orsini — Is the way B2B/enterprise software is sold and delivered today progressive — or is it Byzantine in the age of cloud?  An expert lays out the case for managed services in RA and billing verification.
  • Premiere Experts Set to Speak at Summer RAG Conference in London, July 7th and 8th by Dan Baker — The Risk and Assurance Group (RAG) has announced that its 2016 summer conference will expand into a two-day event and feature many premiere experts. 
  • WeDo Hosts Revenue Assurance & Fraud Management Conference in Washington DC by Dan Baker — Black Swan is pleased to announce what looks to be a first class revenue assurance and fraud management conference being put on by WeDo Technologies, on October 1st and 2nd in beautiful Washington DC.
  • Test Call Generators: An Essential Test & Debugging Tool in Mobile Billing Assurance interview with Steffen Öftring — An “active” test call generator (TCG) can see problems that a “passive” revenue assurance system is blind to.  Here’s a discussion on the test call RA  process, over-the-air calls versus core call injection, and test call networks in global roaming RA.
  • The Revenue Assurance Game: How the Rules Change in the Era of IoT & Mobile Broadband interview with Rene Felber & Gadi Solotorevsky — Revenue assurance is perhaps the hardest of telecom functions to define because the term is used in so many different senses.  This discussion on the evolving role of revenue assurance was catalyzed by a survey of experts in the profession.
  • Day in the Life of a Revenue Assurance Analyst interview with Michael Lazarou — Revenue assurance is much more than a software category.  It’s individual analysts struggling to help their larger organizations get a handle on system errors and coordination problems.  In this interview, an analyst reveals the many challenges of getting the revenue assurance job done at a small GSM operator in Europe.
  • Revenue Assurance: History and New Beginnings in RA Maturity interview with Daniela Giacomantonio & Gadi Solotorevsky — The Roman Forum was the center of commercial life in ancient Rome.  Now, two millennia later, the Forum lives on in the exchange of ideas across countless professions and  media.  In this interview, two Revenue Assurance experts discuss both the new RA Maturity initiative of the TM Forum and the value of telco/solution vendor collaboration.
  • Migrating systems or launching LTE next year?  Don‘t forget transformation assurance & optimisation by Efrat Nissimov — System transformations and network migrations are major  revenue impacting events and they should raise a big red flag.  Why?  Because data integrity issues are bound to crop up as CSPs move vital data from a legacy system to something new.  It’s time for transformation assurance.
  • How can Cable/DSL Internet Providers Meet the Usage-Based Billing Mandate? interview with Ryan Guthrie — The popularity of YouTube, Netflix, and Hulu other video outlets has turned the tables on service profitability for cable/DSL service providers.  Many are moving to usage-based billing, but that largely unprepared for the revenue assurance aspects of this move.  This interview explains the technical challenge and points to solutions in billing, speed caps, and traffic revenue monitoring.
  • CABS Revenue Assurance: How Rural LECs can Recover $284 Million in Revenue Shortfalls interview with Kelly Cannon & Darrell Merschak — Independent rural LECs in the U.S. still rely on the AMA/EMI billing formats for CABS billing, even as that format has proven to be highly inaccurate as a source of inter-carrier records.  This interview includes an analysis and discussion of revenue recovery techniques ILECs can use by leveraging SS7 probes.  Also discussed are billing strategies, traffic dumping threats, and the possible fallout from the FCC’s bill-and-keep mandate.
  • Make Business Assurance Progress Every Day: How to Set Goals, Automate, and Energize Your Team interview with Kathleen Romano — Business assurance (BA) skills have wide applicability outside the revenue assurance and fraud mangement domains.  In this article, a telecom executive explains how she’s applying her BA skills in the Payments area.  In addition to discussing the key operational challenges in Payments, the interview also provides keen insights on setting goals in business assurance, leading a team, and making critical decisions.
  • LTE Rollout: Make it a Smashing Success with Risk Assessment, Controls, and Marketing Offer Analytics by Gadi Solotorevsky — LTE brings splendid new capabilities to mobile users.  But like 2G and 3G deployments before, operators can only make money if they successfuly plan, coordinate, deploy fast, and pay attention to pricing plans and the customer experience.  This article lays out a 3-phase tactical guide on  how revenue analytics professionals can add value in LTE service risk assessment, controls, and marketing offer analytics.
  • RA Prevention: How to Manage Revenue Risks and Communicate RA’s Value to Senior Execs by Shaul Moav — The era of revenue assurance prevention and risk assessment is here.  Several of the mature operators of the world have developed their own methodologies and tools.  Using firefighting and fire prevention as a metaphor, the article details a new commercial software approach explaining the goals, method of risk evaluation, and senior executive dashboards developed for the process.
  • Precision Clockworks: How Revenue Assurance Synchronizes with the Business at Swisscom interview with Marco Pollinger — An expert revenue assurance department is one whose work dovetails well with the lines of businesses it supports.  In this interview you’ll learn how Swisscom manages its revenue assurance function for maximum effect.  The article discusses: the operator’s innovative RA organization, the screening and RA approval of new services, its pre-production bill audits, and its coordination with corporate risk management.
  • Versatile, Portable & Corrections-Savvy: Quest for the Swiss Army Knife of Revenue Assurance Software by Mark Yelland — Revenue assurance maturity models are not cast in stone.  Since  best practices will change over time, it’s healthy to explore moving maturity models forward.  For example, great gains have been made in leakage detection, but RA corrections has been harder to master.  The author dreams about seven functions that should ideally come together in a single all-purpose revenue assurance software tool.
  • Bringing Strategic Planning & Value Engineering to Revenue Assurance interview with Maged Fawzy — Engineering and architectural techniques have a role in revenue assurance.  This interview with a top Egyptian RA consultant explains how continuous risk assessment and long range — yet flexible — RA planning can sharpen a carrier’s RA program and lead to better use of revenue assurance software and integration services.
  • Forensic Fossils: Is Your Revenue Assurance Shop Fit for Display at a Natural History Museum? interview with Jim Marsh — Without the continuous guiding light of seasoned revenue assurance leaders, even the best teams of RA professionals, technology, and business processes can fossilize and lose their vitality.
  • Revenue Assurance: The Magical Market Cap Multiplier by Van Howard & Curtis Mills — Many operators today consider revenue assurance yesterday’s opportunity.  But this article shows why significant revenue and cost leakage can still go undetected, even in companies with dedicated RA departments.  Also discussed are the benefits of a broader or more “forensic” approach to revenue assurance, an approach that boosts the bottom line regardless of the automated tools already in place.
  • From Risk to Robust: Turning the Big Picture Into a Real Agenda for Change in Telecoms by Eric Priezkalns — Inspired by a Financial Times article written by Nassim Taleb, author of “The Black Swan”, here is an insightful and entertaining primer on telecom risk management.  The article takes ten risk management lessons from Taleb and applies them specifically to the communications industry.  You’ll learn about the value of small scale trials, organization accountability, cures for a blame culture, incentives that work, the power of simplicity, and more.
  • Synthesizing the Telecom Business Assurance Practice With the Analytics World by Dan Baker — Business assurance is a wrapper term that allows you to draw a circle around various telecom assurance, control, and optimization activities.  This article maps business assurance as a subset of telecom analytics, constrasting it with marketing analytics while a diagram shows where biz assurance fits in the larger B/OSS world.
  • CABS Revenue Assurance Disputes: May the Carrier With the Best Data Win by Cheryl Smith Rardin & David West — Revenue assurance innovation is far easier when partners cooperate to make it happen.  This articles shows how a U.S. operator, software vendor, and consultant teamed to develop a breakthrough in Carrier Access Billing (CABS) assurance.  Learn about: the dispute resolution data gap that needed to be filled, the partnering strategy, the implementation challenges, and payback results.
  • Revenue Assurance vs.  Business Assurance: Who’s the Rightful King of Controls Software? interview with Sergio Luis Silvestre — Business controls software, originally developed for RA, is finding application in other areas of the business such as internal audit, collections, security and risk management.  This article argues that “business assurance” is the best term to describe this broader set of  controls software that can find a home in numerous departments or functions of a CSP’s business.
  • PwC on the Business of Revenue Assurance Consulting & Mentoring interview with Tim Banks & Dan Stevens — Revenue assurance consulting firms offer a broad range of services to clients these days.  The article explains the practice of mentoring RA mangers and providing a CFO with visibility on the status of an operator’s business controls.  Perspective is also offered on the value of RA software and the opportunity to broaden the RA practice scope.
  • Robots for Hire: Verifying Accuracy In the Age of Complex Mobile Billing/Charging interview with Xavier Lesage — As real-time charging and complex lifestyle calling plans gain credence across the globe in wireless, billing quality issues will rise in importance.  This article discusses a unique managed services approach to invoice testing and roaming fraud protection that checks results against advertised or published source data for the utmost accuracy.
  • Ericsson: Revenue Assurance Consulting With an NGN Flavor interview with Thomas Steagall — Helping operators detect billing and provisioning problem is merely table stakes in the RA services business these days.  The article discuss why operators need to ramp up their RA function with service experience and group-wide financial health monitoring.  Advise is also offered on: key RA maturity questions, risk-and-reward contracts, and how to extract greater value from software investments.
  • Do-It-Yourself RA for Small Operators and MVNOs interview with Mark Yelland — Budget-minded small operators and MVNOs are no longer hamstrung in RA capability anymore.  This article offers high-leverage strategies for operators who cannot afford expensive RA software tools.  With  data access, brains, and a DIY philosophy, any small operator can map a  path to greater RA savings, maturity, and program growth.
  • Revenue Assurance Maturity: Report From the Arena interview with Eric Nelson — Revenue assurance maturity can‘t be easily computed.  How do you  compare the KPIs of Comcast billing with that of mobile money RA in Western Africa?  Even still, this article offers some universal RA wisdom from a straight-shooting veteran of carriers large and small.  Topics discussed include: dashboard or process, COTS vs. inhouse solutions, and tips on gaining internal support for the RA practice.