Email a colleague    

August 2011

Analytics Guru: Are Telecoms Ready for the Biz Intelligence Explosion?

Analytics Guru: Are Telecoms Ready for the Biz Intelligence Explosion?

Making sweeping generalizations on B/OSS software is a risky business, but I’d like to divide the history of B/OSS software into three decades:

Decade          Software Category in Greatest Demand

1984 to 1993 — Billing Software for Large Incumbents — Custom

1994 to 2003 — Billing/OSS Software — Commercial Off-The-Shelf (COTS)

2004 to Now —  Analytics & Assurance Software — COTS

In the first decade, after the AT&T divestiture, the IXCs and Baby Bells thirsted for custom billing software that was built for them by integrators like Andersen Consulting, American Management Systems and Bellcore.  During the second decade, true off-the-shelf software emerged from firms like Amdocs, CBIS, Kenan, Kingston, Clarity, Micromuse, Siebel Systems, and MetaSolv.

But by 2004, the B/OSS market had matured.  While startup operators certainly needed new billing and operations software, most of the hotly contested turf battles were decided, and the B/OSS market shifted into maintenance/upgrade mode.

We’re now in the decade of analytics, typified by software used to analyze, audit, and assure operations in greater detail.  Service assurance is certainly one big category of software that employs analytics.  Another is customer behavior and marketing analytics, the cousin of CRM.  Still another is the business, fraud, and revenue assurance sector.  Even billing and charging software, these days, includes a heavy analytics component to drive marketing and promotional offers.

So if we’re in an analytics era, it might be a good idea to figure out where this big analytics category may be headed.

To gain that perspective, I spoke to analytics expert John Myers, founding principal and senior strategist for Blue Buffalo Group, a Colorado telecom-focused business intelligence (BI) consultancy.  Many will remember that Myers was associated for five years with Subex, where he consulted with their Americas Sales/Pre-Sales organization.

Dan Baker: For starters, John, what exactly does an analytics consultant do?  And what type of beast is a Blue Buffalo?

John Myers: Sure, Dan.  There are several hardware and software companies who want to apply their hardware and tools in the telecommunications space.  But they have relatively little knowledge on telecom industry requirements.  That is the sort of knowledge I consult with them about.  And as you can imagine, with cloud computing and mobile broadband in high gear, there’s great interest out there.

As for a, or rather THE, Blue Buffalo Group: It’s a name I developed based on the Native North American mythology of the buffalo being the communicator of knowledge and wisdom.  It also doesn’t hurt that Blue Buffalo incorporates my undergraduate (University of Michigan) and graduate studies (University of Colorado) in the name of my business.

John, what’s the best definition of business intelligence?

Well, I think lots of people make the mistake of equating business intelligence with dashboards and/or reports.  These are really two different things.

It is about taking data from your environment, giving it a context, coming back with knowledge associated with that particular context, then actually taking action on that knowledge.

For example, let’s say we have achieved the ultimate in Smart Grid deployment and every single device in my home is connected to the Internet.  OK now, if today is the hottest day in August and my dashboard shows that a brownout is imminent because everyone is running their air conditioners full blast, what do I do next?  Well, maybe I tell all the refrigerators in the city to reduce their cooling temperature by three degrees or turn off the lights in every room in the city not currently occupied with people.

Business intelligence really is taking action on the knowledge, or rules, like the Smart Grid example.  What distinguishes true business intelligence from a dashboard is that the dashboard only “presents“ information or data.

Now to link the “concept“ of business intelligence to telecommunications, look at revenue assurance.  A lot of times you cannot automate a corrective Revenue Assurance or Service Assurance action because of certain operational or regulatory restrictions.  For instance, if an invoice has been issued to a customer, to make a change on the bill you generally need to get the permission of the customer.  This is a result of “cramming,” “slamming,“ etc.  However, before a customer’s invoice is issued and within certain operational constraints, you can use business-intelligence analytics to automate Revenue Assurance or Fraud Management discrepancies to reduce internal costs and improve customer satisfaction.

While we in the telecom industry certainly have made a lot of progress in terms of business analytics relating to Revenue Assurance and Fraud Management systems in the past few years, we still have a long ways to go in terms of adding true business intelligence analytics to those practices.

As the telecom industry has evolved, the number of events that need to be tracked in analytics applications like Revenue Assurance, Fraud Management, and Service Assurance are growing big time.

Yes, that is correct! From the proliferation of GPS-enabled smart phones and IPTV implementations, the telecom industry is at the forefront of the “big-data“ wave.

And it is not only the amount of events that has increased, but the complexity.  It used to be fairly easy to identify an event on a telecom network in a single CDR.  Then when we had long voice calls and we learned how to stitch those long-call duration activities and links together and recognize them as one big event.

Now imagine rather than a long-duration call with a couple of segments, you envision IPTV video content.  We are not talking in single digits or tens of events to stitch together, but rather millions of IP protocol events that make up a single customer-facing event like a mobile TV sporting event or an over-the-top (OTT) IPTV movie presentation.

Incidentally, I have heard that between the hours of 6 p.m. and 12 midnight, 24 percent of all North American traffic that goes across broadband networks is coming from Netflix — not Netflix-like activities, but Netflix itself.

Is Deep Packet Inspection a worthwhile strategy for collecting these events?

With DPI, it really depends on how much data you want to store.  Now in a large data-management environment that can handle “big-data“ requirements, you can track as much data as you want.  But are you really going to make use of that data because it can be expensive to store DPI data?

As long as an operator is charging only a monthly recurring fee for bandwidth, the business case for that doesn’t make sense.  However, as soon as a mobile carrier moves into tiered, mobile data pricing models, that’s a different story and thus a different business case.  If someone runs Netflix through a wirelessly connected tablet or smartphone (as opposed to streaming across Wi-Fi), the wireless carrier is going to love that because sooner or later the user is going to exceed his or her mobile broadband data cap and thus produce greater revenues for the telecom carrier.

It sounds like you will still run up against a storage issue, even if you are a big carrier.

Yes “big-data“ collection and analysis is, pardon the pun, a huge problem.

However, think about the progression we’ve seen over the past two decades.  Voice CDRs were relatively easy to track and store.  Then when SMS came on board, you went from say 20 CDRs per user, per day, to 100 mixed xDRs per day.  Now as you add mobile data to the mix, you’re talking about another 10-100x increase, in terms of the number of events that are going through the device.  A smartphone, by its very nature, is on all the time.  And depending on a carrier’s business model, you need to analyze a majority of that subscriber’s activity from a Revenue Assurance, Fraud Management and Customer Billing perspective.

What’s the answer to “big-data“ analytics issues, John?

I think the answer comes from a couple of directions.  First, we can learn a lot from our past experiences as we moved from landline to mobile, then mobile to SMS, and so forth.  If we bring some of that learning forward, we’ll be better prepared for the huge event record volumes that are here now, and will only continue to grow with, mobile broadband.

Secondly, database technologies have matured greatly in the past few years.  We are now at the point where it is not just possible but feasible from a business-case perspective to store all this data and provide access to it from an analytical platform(s) around a carrier.  Many data-management organizations made possible the kind of scalable analytical data sources that will allow you to do Fraud Management and Revenue Assurance, though it may not be good for traditional operational database management applications like Customer Billing or Customer Relationship Management (CRM).

In no particular order, here are some of the players in this “big-data“ space:

  • AsterData, now part of Teradata — itself one of the leaders in “big-data“
  • Dataupia
  • Greenplum, part of EMC
  • Netezza, part of IBM
  • ParAccel
  • Vertica, part of HP

As you can see from that list, many of the large hardware companies have recently been acquiring players in this high-end, “big-data“ analytics space.

Most, if not all, of these players are leveraging MPP or Massively Parallel Processing or Hadoop architectures to achieve this success.  MPP technology has been around for a relatively long time and Hadoop is one of the new line of technologies spawned by internet groups like Google, etc.

As these new databases come into play, does that mean the RA/fraud software vendors of the world need to re-architect their systems?

It really depends on how robust the underlying data architectures are in those Revenue Assurance, Fraud Management and Service Assurance platforms.  Theoretically, an application that utilizes a standard OLTP database, like Oracle or IBM, can use an MPP data management platform that mimics a standard OLTP structure.

Some “big-data“ solutions emulate a standard OLTP component so that they look and act like an OLTP database.  It really depends on how much encapsulation there is between the “big-data” platform and the Revenue Assurance, Fraud Management/Service Assurance application itself.  They will determine how much re-architecting you have to do.

This article first appeared in Billing and OSS World.

Copyright 2011 Black Swan Telecom Journal

 

About the Expert

John Meyers

John Meyers

John Myers is the founding principal and senior analyst/strategist for the Blue Buffalo Group in Lafayette, Colorado.  He is also responsible for the telecommunications channel of the B-eye-Network where he comments on all aspects of the telecom industry including video content distribution.

Related Stories

  • Telecom CVM: From Scattered Campaigns to Unified & Consistent Communication with Customers interview with Cretièn Brandsma — Despite the many failures Customer Value Management has faced in telecom, CVM’s future is very hopeful.  A carrier expert explains why telecoms have faltered, how customer experience programs can be revitalized, and where telecoms should invest in better tactics and technology.
  • The Key to Driving 4G Profit: Sell Value, Not Bandwidth by Miri Duenias — Are you struggling to earn a profit on your 4G investments?  Many operators are failing today on the marketing side.  But aligning 4G products with a customer’s personal preferences and desires provides the necessary sizzle to boost sales and earn a handsome ROI.
  • Batting for More Churn Reduction and Revenue Assurance Home Runs interview with Peter Mueller — What’s it like to transform an IT shop to big data and cloud?  In this interview, the CTO of a boutique revenue assurance explains how his firm made the leap.  He shows how project-oriented programs and working with carrier customers to explore RA and churn reduction “hunches” is where much of the action is.
  • Sharing Intelligence, Services, and Infrastructure across the Telecom Galaxy interview with Gary Zimmerman — The telecom industry is an industry of sharing.  In fact, the rise of mobile broadband is driving a greater reliance on real-time intelligence, services trading, and infrastructure exchange.  In this article, a leading info exchange provider explains the value of its services portfolio and points to other interoperability and sharing ideas under development.
  • Data Monetization: Why Selling Intelligence is a Hot New Revenue Stream for Mobile Carriers interview with Joe Levy — Data monetization is a revenue dream come true for mobile carriers: a highly profitable sideshow where the carrier analyzes and sells data it already collects for other purposes.  In this article you’ll learn how operators monetize their data through use cases in corporate advertising and media branding.
  • Back Office Streamlining to Enterprise Support: The Many Flavors of Wireline Analytics interview with Tom Nolting — Mobile analytics gets plenty of press coverage, but analytics is just as crucial for wireline operators.  In this article, a billing VP at a leading wireline operator discusses several diverse uses of analytics in billing, enterprise sales/retention, and network partner margin assurance.
  • Analytics Guru: Are Telecoms Ready for the Biz Intelligence Explosion? interview with John Meyers — Business intelligence is evolving from the creation of dashboards and reports to taking action based on a deep knowledge of the environmental context.  The article explores the implications of “big data” in terms of IPTV, storage requirements, hardware, event collection, and deep packet inspection.
  • Making the Strategic Leap From Billing to Merchandising interview with Humera Malik — Today billing/charging technology has progressed to the point where the usage intelligence, the charges, the user behaviors, and the analytics can all come together in near real-time.  This article discusses the organizational and marketing strategies that enable a operator to create a true “merchandising” system that can revolutionize a CSP’s business. 

Related Articles

  • Telecom CVM: From Scattered Campaigns to Unified & Consistent Communication with Customers interview with Cretièn Brandsma — Despite the many failures Customer Value Management has faced in telecom, CVM’s future is very hopeful.  A carrier expert explains why telecoms have faltered, how customer experience programs can be revitalized, and where telecoms should invest in better tactics and technology.
  • The Key to Driving 4G Profit: Sell Value, Not Bandwidth by Miri Duenias — Are you struggling to earn a profit on your 4G investments?  Many operators are failing today on the marketing side.  But aligning 4G products with a customer’s personal preferences and desires provides the necessary sizzle to boost sales and earn a handsome ROI.
  • Will Real-Time Decisioning Save Big Data Analytics from Overblown Hype? interview with Tom Erskine — Telecom analytics is more than just collecting and analyzing data.  It’s also about taking action — correct action — often in real-time and across a complex provisioning environment.  In this interview you’ll hear how next best actions are creating value in retention and upselling through a more flexible, business-process driven approach.
  • A Big Data Starter Kit in the Cloud: How Smaller Operators Can Get Rolling with Advanced Analytics interview with Ryan Guthrie — Medium to small operators know “big data” is out there alright, but technical staffing and cost issues have held them back from implementing it.  This interview discusses the advantages of moving advanced analytics to the cloud where operators can get up and running faster and at lower cost.
  • The Customer Engagement Era: How Personalization & Backend Integration Leads to a Richer Mobile Biz interview with Rita Tochner — How does a mobile operator move its subscribers to higher levels of spending and profit?  Fierce competition, social media scrutiny, and the high cost of new networks all conspire against these goals.  In this interview, however, you’ll learn how engaging better with customers, getting more personal, and being more sensitive to their individual needs is the path forward.
  • Telecoms Failing Badly in CAPEX: The Desperate Need for Asset Management & Financial Visibility interview with Ashwin Chalapathy — A 2012 PwC report put the telecom industry on the operating table, opened the patient up, and discovered a malignant cancer: poor network CAPEX management, a problem that puts telecoms in grave financial risk.  In this interview, a supplier of network analytics solutions provides greater detail on the problem and lays out its prescription for deeper asset management, capacity planning and data integrity checks.
  • Batting for More Churn Reduction and Revenue Assurance Home Runs interview with Peter Mueller — What’s it like to transform an IT shop to big data and cloud?  In this interview, the CTO of a boutique revenue assurance explains how his firm made the leap.  He shows how project-oriented programs and working with carrier customers to explore RA and churn reduction “hunches” is where much of the action is.
  • History Repeats: The Big Data Revolution in Telecom Service Assurance interview with Olav Tjelflaat — The lessons of telecom software history teach that new networks and unforeseen industry developments have an uncanny knack for disrupting business plans.  A service assurance incumbent reveals its strategy for becoming a leader in the emerging network analytics and assurance market.
  • From Alarms to Analytics: The Paradigm Shift in Service Assurance interview with Kelvin Hall — In a telecom world with millions of smart devices, the service assurance solutions of yesteryear are not getting the job done.  So alarm-heavy assurance is now shifting to big data solutions that deliver visual, multi-layered, and fine-grained views of network issues.  A data architect who works at large carriers provides an inside view of the key service provider problems driving this analytics shift.
  • The Shrink-Wrapped Search Engine: Why It’s Becoming a Vital Tool in Telecom Analytics interview with Tapan Bhatt — Google invented low cost, big data computing with its distributed search engine that lives in mammoth data centers populated with thousands of commodity CPUs and disks.  Now search engine technology is available as “shrink wrapped” enterprise software.  This article explains how this new technology is solving telecom analytics problems large and small.
  • Sharing Intelligence, Services, and Infrastructure across the Telecom Galaxy interview with Gary Zimmerman — The telecom industry is an industry of sharing.  In fact, the rise of mobile broadband is driving a greater reliance on real-time intelligence, services trading, and infrastructure exchange.  In this article, a leading info exchange provider explains the value of its services portfolio and points to other interoperability and sharing ideas under development.
  • Data Monetization: Why Selling Intelligence is a Hot New Revenue Stream for Mobile Carriers interview with Joe Levy — Data monetization is a revenue dream come true for mobile carriers: a highly profitable sideshow where the carrier analyzes and sells data it already collects for other purposes.  In this article you’ll learn how operators monetize their data through use cases in corporate advertising and media branding.
  • Harvesting Big Data Riches in Retailer Partnering, Actionable CEM & Network Optimization interview with Oded Ringer — In the analytics market there’s plenty of room for small solution firms to add value through a turnkey service or cloud/licensed solution.  But what about large services firms: where do they play?  In this article you’ll learn how a global services giant leverages data of different types to help telcos: monetize retail partnerships, optimize networks, and make CEM actionable.
  • Raising a Telco’s Value in the Digital Ecosystem: One Use Case at a Time interview with Jonathon Gordon — The speed of telecom innovation is forcing software vendors to radically adapt and transform their business models.  This article shows how a deep packet inspection company has  expanded into revenue generation, particularly  for mobile operators.  It offers a broad palette of value-adding use cases from video caching and parental controls to application-charging and DDoS security protection.
  • Radio Access Network Data: Why It’s Become An Immensely Useful Analytics Source interview with Neil Coleman — It’s hard to overstate the importance of Radio Access Network (RAN) analytics to a mobile operator’s business these days.  This article explains why the RAN data, which lives in the air interface between the base station and the handset --  can be used for a business benefit in network optimization and customer experience.
  • Back Office Streamlining to Enterprise Support: The Many Flavors of Wireline Analytics interview with Tom Nolting — Mobile analytics gets plenty of press coverage, but analytics is just as crucial for wireline operators.  In this article, a billing VP at a leading wireline operator discusses several diverse uses of analytics in billing, enterprise sales/retention, and network partner margin assurance.
  • Analytics Biology: The Power of Evolving to New Data Sources and Intelligence Gathering Methods interview with Paul Morrissey — Data warehouses create great value, yet it’s now time to let loose non-traditional big data platforms that create value in countless pockets of operational efficiency that have yet to be fully explored.  This article explains why telecoms must expand their analytics horizons and bring on all sorts of new data sources and novel intelligence gathering techniques.
  • B/OSS Mathematics: The Quest to Analyze Business Problems & Drive Operating Decisions interview with Matti Aksela — Analytics is the glory of mathematics brought to practical use.  And in telecom, analytics has merely stratched the surface of its full potential.  In this article, you’ll learn how machine learning is being combined with the power of CDR number crunching to optimize mobile top-ups, control churn — and in the future, help telecoms make critical network and operating decisions.
  • Leveraging the RA/FM Platform to Deliver Business Insights to Finance & Marketing by Amit Daniel — Carrier professionals using RA and fraud management tools are getting requests from internal customers who want the role of RA/FM platforms expanded to deliver up-to-date analytics data for finance and marketing purposes.  This article advocates a cross-product layer to serve such broader use cases.  The effect would be to transform the existing RA/FM platform into a combined business protection and business growth analytics engine.
  • A Mobile Marketer Service: Bridging Personalization & B/OSS Flowthrough interview with Efrat Nakibly — Marketing analytics is a prescriptive program for driving  actions such as sending a timely promotion to a mobile subscriber.  But completeness demands that you also be able to provision that treatment, qualify the promotion, and keep billing fully in the loop.  This article shows how a managed services program can deliver such an end-to-end process and manage customer life cycles on a one-to-one basis.
  • Science of Analytics: Bringing Prepaid Top Ups & Revenue Maximization under the Microscope interview with Derek Edwards — Prepaid subscribers are the customers that carriers know the least about.  The operator is not interacting with prepaid customers on a monthly basis.  You’re not sending a bill, nor do you have detailed profiles on these customers, especially in the developing world where customers are buying SIMs at a grocery store.  This interview explains how contextual marketing meets the unique analytics challenge of prepaid customers.
  • Connecting B/OSS Silos and Linking Revenue Analytics with the Customer Experience by Anssi Tauriainen — Customer experience analytics is a complex task that flexes B/OSS data to link the customer’s network experience and actions to improve it and drive greater revenue.  In this article, you’ll gain an understanding of how anayltics data needs to be managed across various customer life cycle stages and why it’s tailored for six specific user groups at the operator.
  • Profitable 3G: China’s Mobile Operators Monetize Networks with Retailers & Partners interview with Kevin Xu — Mobile operators are at the center of explosive growth in wireless services.  But to exploit this opportunity requires IT ingenuity and a broader view on how the mobile user can be served.  In this article you’ll learn the innovative techniques Chinese operators use to monetize 3G networks via analytics and partnerships with retailers, social networks, and advertisers.
  • Customer Analytics: Making the Strategic Leap From Hindsight to Foresight interview with Frank Bernhard — Are your company’s analytics programs scattered?  Is there a strategy in place for customer analytics?  This interview with a leading telecom analytics consultant explains why strategy and planning around the analytics function is crucial to getting your money’s worth.  Topics discussed include: hindsight vs. foresight; an advanced analytics program; and the interface sophistication required to support high end vs. low end analytics users.
  • Meeting the OTT Video Challenge: Real-Time, Fine-Grain Bandwidth Monitoring for Cable Operators interview with Mark Trudeau — Cable operators in North America are being overwhelmed by the surge in video and audio traffic.  In this article you’ll learn how Multi Service Operators (MSOs) are now monitoring their traffic to make critical decisions to protect QoS service and monetize bandwidth.  Also featured is expert perspective on trends in: network policy; bandwidth caps; and  customer care issues.
  • Analytics Meditations: The Power of Low-Cost Hardware and the Social Network Within interview with Ken King — Analytics didn‘t arrive yesterday.  Data warehousing and BI have been in the telecom vocabulary for twenty-five or more years.  In this interview, you’ll gain a perspective on why “big data” changes the game and why social network (or social circles) analysis promises the next level of insights.  Other interesting topics include: segmenting the analytics market, engaging with carrier clients, and upgrading from older- to newer-style methodologies.
  • LTE Analytics:  Learning New Rules in Real-Time Network Intelligence, Roaming and Customer Assurance interview with Martin Guilfoyle — LTE is telecom’s latest technology darling, and this article goes beyond the network jargon, to explain the momentous changes LTE brings.  The interview delves into the marriage of IMS, high QoS service delivery via IPX, real-time intelligence and roaming services, plus the new customer assurance hooks that LTE enables.
  • Shared Data Plans: The Challenge of Managing a Family of Pricing, Revenue Assurance, Fraud, and Network Policy Issues by Amit Daniel — Verizon Wireless‘ recent announcement of its move to shared data plans for families shook the mobile industry.  In this column, cVidya’s Amit Daniel shines a spotlight on the knowhow and analytics tools that operators now deperately need to offer the right  shared data price plans, ensure bandwidth throttling is handled correctly, and address new fraud concerns.
  • Analytics Guru: Are Telecoms Ready for the Biz Intelligence Explosion? interview with John Meyers — Business intelligence is evolving from the creation of dashboards and reports to taking action based on a deep knowledge of the environmental context.  The article explores the implications of “big data” in terms of IPTV, storage requirements, hardware, event collection, and deep packet inspection.
  • Social Networking for Telecoms: How To Enlist Friends and Family as Mobile Marketers interview with Simon Rees — Social Network Analysis (SNA) is about exploiting data on “friends and family” connections to combat churn and win new CSP business.  The article explores how an analysis of the ebb and flow of CDRs, phone calls, and messages, can identify key influencers and drive powerful marketing campaigns.
  • Making the Strategic Leap From Billing to Merchandising interview with Humera Malik — Today billing/charging technology has progressed to the point where the usage intelligence, the charges, the user behaviors, and the analytics can all come together in near real-time.  This article discusses the organizational and marketing strategies that enable a operator to create a true “merchandising” system that can revolutionize a CSP’s business.