Email a colleague    

March 2013

Meeting the OTT Video Challenge: Real-Time, Fine-Grain Bandwidth Monitoring for Cable Operators

Meeting the OTT Video Challenge: Real-Time, Fine-Grain Bandwidth Monitoring for Cable Operators

I wonder how many tons of black ink (and electronic ink) have been spilled writing about how Over-the-Top (OTT) players are killing the mobile business.

Well, if you think mobile operators have got it bad, then consider the plight of the cable operators who are being overwhelmed by the surge in video and audio traffic.

A recent “Global Internet Phenomena” report by DPI vendor Sandvine says that during peak time, 65 percent of all fixed-line data traffic in North America is delivered as audio- or video-streaming services.  And one particular OTT, movie-streamer Netflix, accounts for a little over half of that traffic.  All told, average monthly data usage in North America across wired connections has more than doubled from 23GB in 2011 to 51GB in 2012.

Peak Period Traffic Composition via Mobile Access
in North America

2012 Sandvine Report on Traffic Composition

And it’s not just entertainment: a few weeks ago I repaired my refrigerator watching a step-by-step video from a company who sells appliance parts.  The popularity of OTT applications like that is what’s caught the cable industry by surprise.

But help is here from a new and innovative provider, OpenVault, who monitors high-speed internet traffic from the cloud and makes it easy for Multi Service Operators (MSOs) to make critical decisions to protect quality of service and monetize their available bandwidth.  Mark Trudeau, the company’s CEO, who gives some great perspective on this issue and other key trends in the cable industry, joins us now.

Dan Baker: Mark, what’s your own perspective on the challenges cable operators face?  What does your data tell you?

Mark Trudeau: I think you framed the key issues, Dan.  One thing our data confirms is that the usage spike is happening across the board.  It’s not just the top 1% of users who are using more bandwidth — it’s everybody.

Another key trend we are seeing is a big growth in the number of devices per household.  Households now have multiple iPads, an Xbox, or maybe internet-enabled TVs connected.  All of those new devices are contributing to the spike in bandwidth consumption.

Put succinctly, the cable operators are no longer seeing their revenues directly aligned with their expenditures because of the proliferation of connected devices as well as OTT services.

It is not so much the device types we explore as it is the cumulative effect of the increasing number of devices and increasing number of bytes consumed/generated per device.

As it turns out, unknowingly, MSOs boxed themselves into a corner with these all-you-can-eat rate plans in the race to acquire HSD subscribers.  Due to the unforeseen growth in data consumption you’re starting to see more usage-based billing offerings out there and enforcement of the Terms of Service that accompany them.  In other words, they are going the way of wireless providers — charging the subscriber a fee whenever they go above an allowance or modifying their bandwidth when they reach their limits.

Okay, interesting.  My fast-internet provider is a rural operator called Blue Ridge Cable, and I don‘t believe they offer that quite yet.

Sure, the smaller rural operators generally follow what big guys like Comcast and Cox roll out, so it is only a matter of time for you to personally experience it.  Many of the big MSOs have announced usage-based billing packages, so we are starting to see the smaller operators catching the same train.

Please tell us how your solution works.

Well, our solution collects IPDR transported data generated by DOCSIS-compliant high-speed networks.  That data is pushed to us every 15 minutes allowing us to see at a DOCSIS device level, the amount of upstream and downstream data consumption.  We then enrich that data with other network traffic information and subscribed service contract parameters to tie actual network usage with financial responsibility.  We track that throughout the course of a billing cycle and will know when a subscriber reaches their limit and then our solution will handle that situation based on what the operator wants to do at that point.

Some operators will throttle subscriber bandwidth speeds down to hopefully prevent them from using too much.  Other operators will charge the customer once the subscriber goes over their limit.  So there are various options depending on what the operators want to do from a business perspective, any of which our platform already supports.

Was it a struggle to get the MSOs to agree to do this over the cloud?

No.  We haven‘t really had that problem.  Certainly the larger operators like to host the data themselves and we’re flexible to accommodate that.  But most of the small operators are willing to do this because number one, they don’t have space in their own data centers a lot of times, and frankly many of them love the flexibility of a software as a service model.  So, it doesn‘t require any upfront licensing fee or anything like that, so they pay per subscriber per month.  The SaaS approach really lowers the cost to get into this kind of technology.

I should also add that one of things that has made them more comfortable with SaaS is that we are not collecting personally identifiable information — or anything that could put them at risk in anyway.  In fact, we have many security measures in place to protect them.

What are the peak hours in the U.S. market for the spike in high-speed internet usage?

Actually anywhere from 7 to 10 p.m. is the timeframe when the networks are at peak loads.  And we’ve seen that remarkably consistent across operators.

Now a lot of operators look at the total year-over-year growth of usage consumption on their network, but that misses the point.  They should really be looking at what’s going on during peak hours — how fast the peak usage is growing and which subscribers specifically are contributing to that growth.

That’s the real indicator of when and where they need to increase capacity.  And analytics is key to measuring that.  If I based my capacity plans on experiencing 40% year-over-year growth and the peak time period grew 60%, then I’ve vastly underestimated my capacity needs.

You can imagine what a challenge these dynamics are putting on MSOs.

You’re losing customers who are subscribing to premium services on one side of your business, who are, unfortunately for you, fulfilling their entertainment requirements by driving more data traffic on your HSD network, so you’ve got to figure out a way to grow new revenue streams.

Most of these operators have been experiencing flat revenues on the internet side of the business because their rate plans have been a consistent monthly recurring charge with no other incremental fees; meanwhile their costs to provide this service have been going up.  That is not sustainable and has got to change.

This business of real-time traffic analytics — where’s it likely to go from here?  Can you expand your offering and provide other services to your base?

Well, this highly granular monitoring of bandwidth is still very new for the operators, though they certainly know how to monitor network bandwidth at a high level.

So as our kind of solution becomes more mainstream, the operators are going to need to introduce new revenue generating products or usage-based billing types of things.  Now the only way to offer the right product to the right customer is if you really understand the usage behavior on your network at a granular level.

So we are excited that numerous operators are starting to take advantage of the more granular usage intelligence we are providing.  They will need to create new revenue-generating products — or, for operators who have congestion problems, they will use our data to manage bandwidth during peak time so that can provide a higher service quality to more subscribers during those hours.

For now, I think cable operators have all come to the conclusion that even if they haven‘t announced usage caps quite yet, they eventually will.  And once they make decisions about what they are going to do, that’s when the market will open up to provide real-time rating and bandwidth management solutions.

So policy management has some potential to grow in the future.

There are many different aspects of policy, but as a general answer, “yes”.  For instance, a very important capability is notifying subscribers when they reach certain thresholds of usage, via email for instance.  Now that could lead to the operator doing various policy enforcement activities in the network such as limiting the ability to use too much of the network.

But before we get to that stage, there are other key things that need to be done.

For instance, educating the subscriber on what a gigabyte is and how many they routinely use.  To accomplish that, we put up a subscriber usage meter for our operator customers.  The subscriber can look at month-to-date usage and then some history of usage over the previous two or three months.  Most operators go to that level; some provide daily information.  We aggregate the every-15-minutes data we receive to the hourly level.

Going one step further, when a consumer calls to complain about being charged extra for high usage, there’s a challenge around justifying your bill.  So we provide a portal for the customer care agent that shows the high speed internet usage for a particular subscriber during the previous month.

So if Grandma calls up to complain about a high usage charge on her internet bill, the customer care reps can point to a particular weekend, and suggest that maybe that’s when grandkids were visiting and using a Xbox or something.  So providing more granular information like this allows customer care to better respond.

What’s your feeling about these shared billing data plans such as Verizon Wireless has introduced?  Can you foresee that type of model working in cable someday?

You are comparing personal devices with premise devices.  I do think shared plans make sense for the personalized wireless world.  In the cable market, remember we are talking about a fixed DOCSIS network, and by default the family shares the pipe that comes into the house.  Even still, we do see the concept of accounts with multiple cable modems on them, each subscribed to their own package and it is not a large step to combine the data for those multiple modems to support a shared data concept.

Still, more and more technologies are becoming available that will allow you to control bandwidth at the device level.  So down the road we may see scenarios where an individual household and account holder has a lot of control over which devices are allocated bandwidth.

What are the challenges the cable operators face as they move to more granular tracking and caps on usage?

Well, one really important challenge is accuracy and reliability.  As soon as you  start billing for usage, you’re going to be challenged in terms of the accuracy of your usage levels that you are reporting on and billing on.  So, that becomes a really critical piece of any solution that an operator puts in place because the last thing you need is bad press and a bunch of consumers complaining that they are being over-billed.

Since we view this accuracy issue as critical we had an audit done of our system by NetForecast, an independent auditor, the most well-known and respected auditor that’s out there.  They confirmed the accuracy of our data collection and reporting in a report that’s available for anyone to see.  We view this as a big differentiator versus other vendors and home-grown solutions.

So when we talk to potential customers, we kind of wave the accuracy flag and point out that if you plan to deploy usage limits and usage based billing, make sure to consider the accuracy factor because there’s a significant customer satisfaction, potential brand damage and revenue risk around that.

Copyright 2013 Black Swan Telecom Journal

Mark Trudeau

Mark Trudeau

Mark Trudeau brings two decades of senior communications software domain and investment expertise.  He has founded and led numerous technology companies through major growth and success for his customers and investors.  With strong partnering skills and concern for customers, Mark leads operational and strategic decision-making at OpenVault.   Contact Mark via

Black Swan Solution Guides & Papers

cSwans of a Feather

  • A Big Data Starter Kit in the Cloud: How Smaller Operators Can Get Rolling with Advanced Analytics interview with Ryan Guthrie — Medium to small operators know “big data” is out there alright, but technical staffing and cost issues have held them back from implementing it.  This interview discusses the advantages of moving advanced analytics to the cloud where operators can get up and running faster and at lower cost.
  • Telecoms Failing Badly in CAPEX: The Desperate Need for Asset Management & Financial Visibility interview with Ashwin Chalapathy — A 2012 PwC report put the telecom industry on the operating table, opened the patient up, and discovered a malignant cancer: poor network CAPEX management, a problem that puts telecoms in grave financial risk.  In this interview, a supplier of network analytics solutions provides greater detail on the problem and lays out its prescription for deeper asset management, capacity planning and data integrity checks.
  • History Repeats: The Big Data Revolution in Telecom Service Assurance interview with Olav Tjelflaat — The lessons of telecom software history teach that new networks and unforeseen industry developments have an uncanny knack for disrupting business plans.  A service assurance incumbent reveals its strategy for becoming a leader in the emerging network analytics and assurance market.
  • From Alarms to Analytics: The Paradigm Shift in Service Assurance interview with Kelvin Hall — In a telecom world with millions of smart devices, the service assurance solutions of yesteryear are not getting the job done.  So alarm-heavy assurance is now shifting to big data solutions that deliver visual, multi-layered, and fine-grained views of network issues.  A data architect who works at large carriers provides an inside view of the key service provider problems driving this analytics shift.
  • The Shrink-Wrapped Search Engine: Why It’s Becoming a Vital Tool in Telecom Analytics interview with Tapan Bhatt — Google invented low cost, big data computing with its distributed search engine that lives in mammoth data centers populated with thousands of commodity CPUs and disks.  Now search engine technology is available as “shrink wrapped” enterprise software.  This article explains how this new technology is solving telecom analytics problems large and small.
  • Harvesting Big Data Riches in Retailer Partnering, Actionable CEM & Network Optimization interview with Oded Ringer — In the analytics market there’s plenty of room for small solution firms to add value through a turnkey service or cloud/licensed solution.  But what about large services firms: where do they play?  In this article you’ll learn how a global services giant leverages data of different types to help telcos: monetize retail partnerships, optimize networks, and make CEM actionable.
  • Raising a Telco’s Value in the Digital Ecosystem: One Use Case at a Time interview with Jonathon Gordon — The speed of telecom innovation is forcing software vendors to radically adapt and transform their business models.  This article shows how a deep packet inspection company has  expanded into revenue generation, particularly  for mobile operators.  It offers a broad palette of value-adding use cases from video caching and parental controls to application-charging and DDoS security protection.
  • Radio Access Network Data: Why It’s Become An Immensely Useful Analytics Source interview with Neil Coleman — It’s hard to overstate the importance of Radio Access Network (RAN) analytics to a mobile operator’s business these days.  This article explains why the RAN data, which lives in the air interface between the base station and the handset --  can be used for a business benefit in network optimization and customer experience.
  • Analytics Biology: The Power of Evolving to New Data Sources and Intelligence Gathering Methods interview with Paul Morrissey — Data warehouses create great value, yet it’s now time to let loose non-traditional big data platforms that create value in countless pockets of operational efficiency that have yet to be fully explored.  This article explains why telecoms must expand their analytics horizons and bring on all sorts of new data sources and novel intelligence gathering techniques.
  • Connecting B/OSS Silos and Linking Revenue Analytics with the Customer Experience by Anssi Tauriainen — Customer experience analytics is a complex task that flexes B/OSS data to link the customer’s network experience and actions to improve it and drive greater revenue.  In this article, you’ll gain an understanding of how anayltics data needs to be managed across various customer life cycle stages and why it’s tailored for six specific user groups at the operator.
  • Meeting the OTT Video Challenge: Real-Time, Fine-Grain Bandwidth Monitoring for Cable Operators interview with Mark Trudeau — Cable operators in North America are being overwhelmed by the surge in video and audio traffic.  In this article you’ll learn how Multi Service Operators (MSOs) are now monitoring their traffic to make critical decisions to protect QoS service and monetize bandwidth.  Also featured is expert perspective on trends in: network policy; bandwidth caps; and  customer care issues.
  • LTE Analytics:  Learning New Rules in Real-Time Network Intelligence, Roaming and Customer Assurance interview with Martin Guilfoyle — LTE is telecom’s latest technology darling, and this article goes beyond the network jargon, to explain the momentous changes LTE brings.  The interview delves into the marriage of IMS, high QoS service delivery via IPX, real-time intelligence and roaming services, plus the new customer assurance hooks that LTE enables.

Related Articles