Email a colleague    

March 2013

Analytics Meditations: The Power of Low-Cost Hardware & the Social Network Within

Analytics Meditations: The Power of Commodity Hardware & the Social Network Within

In case you haven‘t noticed, a bunch of software startups have exploded onto the telecom analytics scene in recent years.  So the question is: will this business continue to grow or will it fizzle as soon as IBM stops its “big data” and “smarter planet” ad campaign?

My sense is that the rise of telecom analytics is very real.  In fact, the availability of low cost computing power has opened the flood gate to dozens of analytic apps that deliver real value for telcos.  Analytics gurus talk about three V’s that drive analytics opportunities: the Velocity of the business, the Volume of data you have to analyze, and the Variety of data.  Well, telecom has all those qualities in abundance.

And by virtue of its thirty years of experience in the market, you can bet that SAS Institute will continue to be a big beneficiary of this trend.

SAS Institute should be no stranger to those following high tech.  The North Carolina-based private company with a global reach is today’s largest player in telecom analytics with communications industry revenue accounting for 7% of its $2,275 million total (2011).

Rated by Fortune magazine as one of most employee-friendly companies in the U.S., the company is a solid business too: despite the recession, SAS grew its revenue a healthy 11% from 2010 to 2011.  Steady at the helm, SAS has stayed the analytics course and grown the business organically while its competitors spent billions in acquisitions to get into the same race.

Another thing I like: SAS reaches out to editors and potential customers in a down-to-earth way.  Check out their Customer Success webpage with its hundreds of cases studies-a full 29 of which are cases in the comms industry.  Each case is professionally written with a mind to educate the reader with food for intelligent thought.

So we’re pleased to welcome long term industry colleague Ken King, Director of Telecommunications at SAS, who gives us a valuable historical and future-looking perspective on telecom analytics.

Dan Baker: Ken, looking back to the day when SAS was one of the very few companies you could classify as a true “analytics firm”, I’m wondering how the arrival of “big data” or low cost computing power has changed the way analytics is done.

Ken King: Dan, I think the big difference is around how fast you can do the analysis.  When you can enable these things to run in memory, your models can be updated in minutes instead of hours.  So instead of updating those models quarterly, you can update them perhaps daily or even multiple times a day.

As we look at the models we’ve built in the past, they run reasonably well, but they required a filtering process that causes you to move a lot of data in and out.  For example, in the past we would filter and analyze the top 1% of something because that’s all the customer could afford to process.  Today we can avoid much of that intermediate processing and put everything in memory and process it very fast.

That means we are increasingly looking at all the data rather than a sample.  So that gives you a big lift because looking at all of the data is better than the sample.  But if there’s no or relatively little extra cost to look at all the data versus just a sampling, then using all the data is better because you can look at all the outliers.

So what’s new at SAS Institute in telecom?  What part of the market are you seeing some potential growth in?

Over two dozen of our telecom customers are using the product of ours we call Customer Link Analytics.  What this does is reveal which customers have the largest social circles.  It recognizes those people who are better connected and are more influential -- or if not influential, then certainly people provide an early indicator of trends.

Traditionally the techniques for reducing churn have been based on algorithms that only looked at that customer’s individual records: it didn‘t look at the social network that a customer was involved in.  Customer Link Analytics adds an entirely new dimension to the tools used by marketers for retention and launching new products and services.

Doing this analysis for millions of customers is enormously compute-intensive, so not many companies could afford that capability up to now.  I mean, imagine a big spreadsheet where you had every phone number on one side and every phone number again on the other axis — and as start connecting one phone number to all the others, it plots out as a huge, sparsely populated matrix.  Later this year we will release a version that is enabled for in-memory analytics.  So the processing time will drop from many hours to just a few minutes.

I believe this technique is called “social networking” and it is totally different, of course, from the social network we talk about in the context of Facebook or Twitter.

That’s right, and it does cause confusion, though I’m not sure exactly what we can do to eliminate that confusion.

Actually, social network analysis goes back a long way in telecom.  For instance, least cost routing was done using this technique and the idea there was to see how many calls were passing through a particular intermediate node in the network.  And in this way you could figure out where spending your next dollar in network would do the most good.

So those were all sort of ways of social networking and then all of a sudden Facebook and LinkedIn came along and they sort of hijacked the terminology.  What’s different about the social network analysis I’m talking about it’s done using your own call detail records: it’s data that only you have access to and it is a 100% objective data.  Everything that you are looking at has something to do with your customer using your products.  There certainly is an analytic opportunity to look at comments posted on Twitter and Facebook, but that’s the exact opposite.  With Facebook comments, the data that is not just available to you; it’s available to anybody.  And that data is also very subjective for the user and you have to filter out the 99% of information that has absolutely nothing to do with your products and services.

Can you give a quick example how you would utilize Customer Link Analytics?

Sure, Dan.  Let’s say we’ve launched a new Android or iPhone app and we want to observe how quickly it propagates through the network.  Well, we start seeing that app being used by the influential users and pretty soon the next group of people downloading the app are closely connected with them.  That’s a very good indication that the app is successful and will probably do well, so based on that info, maybe we should do some marketing campaigns to promote the app.

By the same token, if you notice that your app isn‘t propagating, well, that’s a signal that the app is not very good because the key influencers are not telling their friends about it.

Ken, as an analyst, I’m always trying to sort out the markets I study.  So what about analytics?  How do you carve out the pie?  Do you internally track a “customer churn prevention” segment vs. a network optimization one?

Churn is a different animal I think.  I mean, almost everything an operator does is in some way related to reducing churn.  Churn management is much more than creating a model that says who is likely to churn.  The important part is going back and addressing the factors that are causing the churn.  And this opinion is reflected in our own surveys when we ask customers why they bought our software.  So while churn management is certainly a permanent issue, its causes are many.

As we see the telecom analytics market, there are three major segments: customer intelligence, information management, and network analytics.  These are the top sectors, but then there’s what we call service optimization which includes a bunch of different things such as risk management, which includes revenue assurance, fraud, and margin assurance.

Another area is “analytics model management”.  A company may have thousands of different analytical models put together, so how do I manage those?  And each is in a different maturity phase across its lifecycle.  Some models are in test mode.  Others are in production.  Still others need to be sent out to pasture because they are no longer useful.

So model management entails monitoring the effectiveness of models.  When someone comes along and says, “I’ve got a great idea for a model”, well, you can look back and see: have we done anything like that before; do we actually already have it; and what results came out of that model?  In short, as soon as you begin collecting a large number of analytical models, it’s easy to get mixed up unless you’ve got a good process for managing it.

Coming into the analytics business in the very early years, you’ve prospered without tying yourself to any particular hardware religion.

Yes, we have always been very much hardware and database independent.  And that kind of brings you back to the thing that has made SAS so successful — the ability to get data from anywhere.  Talk to some of the people who have been here a long time and they will say: “We have never seen a data source we couldn‘t access.” So, you are right, we are independent.

And the way the market is evolving, you’ve got big providers like Oracle and IBM who are betting they can be a one-stop shop — buy hardware and the software from the same vendor.  SAP is another company doing lots of acquisitions and acquiring that entire end-to-end thing, but our strategy at SAS is to stick with what we do well, which is the analytics — and supporting all the platforms that we believe are important.

How does SAS typically engage with telecom industry clients?  Are you going in and doing some upfront consulting and leaving some analytics software behind?

We have many, many different models of business that we do, but perhaps our most common scenario is to engage with a customer about its hot-button issues and how we could help them solve those issues.

Obviously over the last couple of years, the big trend in wireless has been the movement away from feature phones that make calls and send text — and towards the smartphone.  So the rise of the smartphone means that a lot of analytic models need to be recalibrated because people are now using apps, they are a lot more data dependent and so forth.

So, we come in and try to understand: what are the factors that are changing those models?  We often start off by doing a proof of concept, showing how it would work and then integrating it into existing systems.  So, the customer is then licensed to use the software for that particular process.

The customer gets an end-to-end analytical application that provides them answers to a business problem and there are different models of how we do this.  In most cases the client then takes over and their people run and maintain that system.

Often the customer has its own experts who‘ve been SAS users for a long time and they know exactly what they need to do and just use a software license to do it.  Other times they need various amounts of assistance from us.

In some cases , we’re like the home improvement store where somebody shows up at the cash registrar with a bunch of boards, saws, nails and hammers and they walk off and go build something.  We often have no idea what they have built until they come back and might say, “Hey, I have built this neat thing and I would like to do a presentation about it at the SAS Global Forum.”

So when those models happen and a customer shares something he’s done, we and our customers learn from that.  But sometimes they come in and say, “Gee, I want to build a dog house but I don‘t really know how to get started”, and so we work with them to build a complete business solution.

The majority of our revenue comes from the follow-on software license.  To keep that revenue stream flowing we have to continue delivering value to our customers.  So we need to understand their business challenges and work with them on solutions.

Copyright 2013 Black Swan Telecom Journal

 

About the Expert

Ken King

Ken King

Ken King is Director of, Telco & Media Convergence at SAS.  He is an expert on the use of advanced analytics to solve complex communications industry business problems.  He consults with SAS clients and industry thought leaders on topics such as churn management, social network analysis, product bundling, offer optimization, forecasting, and operational improvements.  SAS solutions are deployed by over 200 telecoms around the world.   Contact Ken via

Related Stories

  • Will Real-Time Decisioning Save Big Data Analytics from Overblown Hype? interview with Tom Erskine — Telecom analytics is more than just collecting and analyzing data.  It’s also about taking action — correct action — often in real-time and across a complex provisioning environment.  In this interview you’ll hear how next best actions are creating value in retention and upselling through a more flexible, business-process driven approach.
  • The Customer Engagement Era: How Personalization & Backend Integration Leads to a Richer Mobile Biz interview with Rita Tochner — How does a mobile operator move its subscribers to higher levels of spending and profit?  Fierce competition, social media scrutiny, and the high cost of new networks all conspire against these goals.  In this interview, however, you’ll learn how engaging better with customers, getting more personal, and being more sensitive to their individual needs is the path forward.
  • B/OSS Mathematics: The Quest to Analyze Business Problems & Drive Operating Decisions interview with Matti Aksela — Analytics is the glory of mathematics brought to practical use.  And in telecom, analytics has merely stratched the surface of its full potential.  In this article, you’ll learn how machine learning is being combined with the power of CDR number crunching to optimize mobile top-ups, control churn — and in the future, help telecoms make critical network and operating decisions.
  • A Mobile Marketer Service: Bridging Personalization & B/OSS Flowthrough interview with Efrat Nakibly — Marketing analytics is a prescriptive program for driving  actions such as sending a timely promotion to a mobile subscriber.  But completeness demands that you also be able to provision that treatment, qualify the promotion, and keep billing fully in the loop.  This article shows how a managed services program can deliver such an end-to-end process and manage customer life cycles on a one-to-one basis.
  • Science of Analytics: Bringing Prepaid Top Ups & Revenue Maximization under the Microscope interview with Derek Edwards — Prepaid subscribers are the customers that carriers know the least about.  The operator is not interacting with prepaid customers on a monthly basis.  You’re not sending a bill, nor do you have detailed profiles on these customers, especially in the developing world where customers are buying SIMs at a grocery store.  This interview explains how contextual marketing meets the unique analytics challenge of prepaid customers.
  • Profitable 3G: China’s Mobile Operators Monetize Networks with Retailers & Partners interview with Kevin Xu — Mobile operators are at the center of explosive growth in wireless services.  But to exploit this opportunity requires IT ingenuity and a broader view on how the mobile user can be served.  In this article you’ll learn the innovative techniques Chinese operators use to monetize 3G networks via analytics and partnerships with retailers, social networks, and advertisers.
  • Customer Analytics: Making the Strategic Leap From Hindsight to Foresight interview with Frank Bernhard — Are your company’s analytics programs scattered?  Is there a strategy in place for customer analytics?  This interview with a leading telecom analytics consultant explains why strategy and planning around the analytics function is crucial to getting your money’s worth.  Topics discussed include: hindsight vs. foresight; an advanced analytics program; and the interface sophistication required to support high end vs. low end analytics users.
  • Analytics Meditations: The Power of Low-Cost Hardware and the Social Network Within interview with Ken King — Analytics didn‘t arrive yesterday.  Data warehousing and BI have been in the telecom vocabulary for twenty-five or more years.  In this interview, you’ll gain a perspective on why “big data” changes the game and why social network (or social circles) analysis promises the next level of insights.  Other interesting topics include: segmenting the analytics market, engaging with carrier clients, and upgrading from older- to newer-style methodologies.
  • Shared Data Plans: The Challenge of Managing a Family of Pricing, Revenue Assurance, Fraud, and Network Policy Issues by Amit Daniel — Verizon Wireless‘ recent announcement of its move to shared data plans for families shook the mobile industry.  In this column, cVidya’s Amit Daniel shines a spotlight on the knowhow and analytics tools that operators now deperately need to offer the right  shared data price plans, ensure bandwidth throttling is handled correctly, and address new fraud concerns.
  • Social Networking for Telecoms: How To Enlist Friends and Family as Mobile Marketers interview with Simon Rees — Social Network Analysis (SNA) is about exploiting data on “friends and family” connections to combat churn and win new CSP business.  The article explores how an analysis of the ebb and flow of CDRs, phone calls, and messages, can identify key influencers and drive powerful marketing campaigns.

Related Articles

  • Will Real-Time Decisioning Save Big Data Analytics from Overblown Hype? interview with Tom Erskine — Telecom analytics is more than just collecting and analyzing data.  It’s also about taking action — correct action — often in real-time and across a complex provisioning environment.  In this interview you’ll hear how next best actions are creating value in retention and upselling through a more flexible, business-process driven approach.
  • A Big Data Starter Kit in the Cloud: How Smaller Operators Can Get Rolling with Advanced Analytics interview with Ryan Guthrie — Medium to small operators know “big data” is out there alright, but technical staffing and cost issues have held them back from implementing it.  This interview discusses the advantages of moving advanced analytics to the cloud where operators can get up and running faster and at lower cost.
  • The Customer Engagement Era: How Personalization & Backend Integration Leads to a Richer Mobile Biz interview with Rita Tochner — How does a mobile operator move its subscribers to higher levels of spending and profit?  Fierce competition, social media scrutiny, and the high cost of new networks all conspire against these goals.  In this interview, however, you’ll learn how engaging better with customers, getting more personal, and being more sensitive to their individual needs is the path forward.
  • Telecoms Failing Badly in CAPEX: The Desperate Need for Asset Management & Financial Visibility interview with Ashwin Chalapathy — A 2012 PwC report put the telecom industry on the operating table, opened the patient up, and discovered a malignant cancer: poor network CAPEX management, a problem that puts telecoms in grave financial risk.  In this interview, a supplier of network analytics solutions provides greater detail on the problem and lays out its prescription for deeper asset management, capacity planning and data integrity checks.
  • Batting for More Churn Reduction and Revenue Assurance Home Runs interview with Peter Mueller — What’s it like to transform an IT shop to big data and cloud?  In this interview, the CTO of a boutique revenue assurance explains how his firm made the leap.  He shows how project-oriented programs and working with carrier customers to explore RA and churn reduction “hunches” is where much of the action is.
  • History Repeats: The Big Data Revolution in Telecom Service Assurance interview with Olav Tjelflaat — The lessons of telecom software history teach that new networks and unforeseen industry developments have an uncanny knack for disrupting business plans.  A service assurance incumbent reveals its strategy for becoming a leader in the emerging network analytics and assurance market.
  • From Alarms to Analytics: The Paradigm Shift in Service Assurance interview with Kelvin Hall — In a telecom world with millions of smart devices, the service assurance solutions of yesteryear are not getting the job done.  So alarm-heavy assurance is now shifting to big data solutions that deliver visual, multi-layered, and fine-grained views of network issues.  A data architect who works at large carriers provides an inside view of the key service provider problems driving this analytics shift.
  • The Shrink-Wrapped Search Engine: Why It’s Becoming a Vital Tool in Telecom Analytics interview with Tapan Bhatt — Google invented low cost, big data computing with its distributed search engine that lives in mammoth data centers populated with thousands of commodity CPUs and disks.  Now search engine technology is available as “shrink wrapped” enterprise software.  This article explains how this new technology is solving telecom analytics problems large and small.
  • Sharing Intelligence, Services, and Infrastructure across the Telecom Galaxy interview with Gary Zimmerman — The telecom industry is an industry of sharing.  In fact, the rise of mobile broadband is driving a greater reliance on real-time intelligence, services trading, and infrastructure exchange.  In this article, a leading info exchange provider explains the value of its services portfolio and points to other interoperability and sharing ideas under development.
  • Data Monetization: Why Selling Intelligence is a Hot New Revenue Stream for Mobile Carriers interview with Joe Levy — Data monetization is a revenue dream come true for mobile carriers: a highly profitable sideshow where the carrier analyzes and sells data it already collects for other purposes.  In this article you’ll learn how operators monetize their data through use cases in corporate advertising and media branding.
  • Harvesting Big Data Riches in Retailer Partnering, Actionable CEM & Network Optimization interview with Oded Ringer — In the analytics market there’s plenty of room for small solution firms to add value through a turnkey service or cloud/licensed solution.  But what about large services firms: where do they play?  In this article you’ll learn how a global services giant leverages data of different types to help telcos: monetize retail partnerships, optimize networks, and make CEM actionable.
  • Raising a Telco’s Value in the Digital Ecosystem: One Use Case at a Time interview with Jonathon Gordon — The speed of telecom innovation is forcing software vendors to radically adapt and transform their business models.  This article shows how a deep packet inspection company has  expanded into revenue generation, particularly  for mobile operators.  It offers a broad palette of value-adding use cases from video caching and parental controls to application-charging and DDoS security protection.
  • Radio Access Network Data: Why It’s Become An Immensely Useful Analytics Source interview with Neil Coleman — It’s hard to overstate the importance of Radio Access Network (RAN) analytics to a mobile operator’s business these days.  This article explains why the RAN data, which lives in the air interface between the base station and the handset --  can be used for a business benefit in network optimization and customer experience.
  • Back Office Streamlining to Enterprise Support: The Many Flavors of Wireline Analytics interview with Tom Nolting — Mobile analytics gets plenty of press coverage, but analytics is just as crucial for wireline operators.  In this article, a billing VP at a leading wireline operator discusses several diverse uses of analytics in billing, enterprise sales/retention, and network partner margin assurance.
  • Analytics Biology: The Power of Evolving to New Data Sources and Intelligence Gathering Methods interview with Paul Morrissey — Data warehouses create great value, yet it’s now time to let loose non-traditional big data platforms that create value in countless pockets of operational efficiency that have yet to be fully explored.  This article explains why telecoms must expand their analytics horizons and bring on all sorts of new data sources and novel intelligence gathering techniques.
  • B/OSS Mathematics: The Quest to Analyze Business Problems & Drive Operating Decisions interview with Matti Aksela — Analytics is the glory of mathematics brought to practical use.  And in telecom, analytics has merely stratched the surface of its full potential.  In this article, you’ll learn how machine learning is being combined with the power of CDR number crunching to optimize mobile top-ups, control churn — and in the future, help telecoms make critical network and operating decisions.
  • Leveraging the RA/FM Platform to Deliver Business Insights to Finance & Marketing by Amit Daniel — Carrier professionals using RA and fraud management tools are getting requests from internal customers who want the role of RA/FM platforms expanded to deliver up-to-date analytics data for finance and marketing purposes.  This article advocates a cross-product layer to serve such broader use cases.  The effect would be to transform the existing RA/FM platform into a combined business protection and business growth analytics engine.
  • A Mobile Marketer Service: Bridging Personalization & B/OSS Flowthrough interview with Efrat Nakibly — Marketing analytics is a prescriptive program for driving  actions such as sending a timely promotion to a mobile subscriber.  But completeness demands that you also be able to provision that treatment, qualify the promotion, and keep billing fully in the loop.  This article shows how a managed services program can deliver such an end-to-end process and manage customer life cycles on a one-to-one basis.
  • Science of Analytics: Bringing Prepaid Top Ups & Revenue Maximization under the Microscope interview with Derek Edwards — Prepaid subscribers are the customers that carriers know the least about.  The operator is not interacting with prepaid customers on a monthly basis.  You’re not sending a bill, nor do you have detailed profiles on these customers, especially in the developing world where customers are buying SIMs at a grocery store.  This interview explains how contextual marketing meets the unique analytics challenge of prepaid customers.
  • Connecting B/OSS Silos and Linking Revenue Analytics with the Customer Experience by Anssi Tauriainen — Customer experience analytics is a complex task that flexes B/OSS data to link the customer’s network experience and actions to improve it and drive greater revenue.  In this article, you’ll gain an understanding of how anayltics data needs to be managed across various customer life cycle stages and why it’s tailored for six specific user groups at the operator.
  • Profitable 3G: China’s Mobile Operators Monetize Networks with Retailers & Partners interview with Kevin Xu — Mobile operators are at the center of explosive growth in wireless services.  But to exploit this opportunity requires IT ingenuity and a broader view on how the mobile user can be served.  In this article you’ll learn the innovative techniques Chinese operators use to monetize 3G networks via analytics and partnerships with retailers, social networks, and advertisers.
  • Customer Analytics: Making the Strategic Leap From Hindsight to Foresight interview with Frank Bernhard — Are your company’s analytics programs scattered?  Is there a strategy in place for customer analytics?  This interview with a leading telecom analytics consultant explains why strategy and planning around the analytics function is crucial to getting your money’s worth.  Topics discussed include: hindsight vs. foresight; an advanced analytics program; and the interface sophistication required to support high end vs. low end analytics users.
  • Meeting the OTT Video Challenge: Real-Time, Fine-Grain Bandwidth Monitoring for Cable Operators interview with Mark Trudeau — Cable operators in North America are being overwhelmed by the surge in video and audio traffic.  In this article you’ll learn how Multi Service Operators (MSOs) are now monitoring their traffic to make critical decisions to protect QoS service and monetize bandwidth.  Also featured is expert perspective on trends in: network policy; bandwidth caps; and  customer care issues.
  • Analytics Meditations: The Power of Low-Cost Hardware and the Social Network Within interview with Ken King — Analytics didn‘t arrive yesterday.  Data warehousing and BI have been in the telecom vocabulary for twenty-five or more years.  In this interview, you’ll gain a perspective on why “big data” changes the game and why social network (or social circles) analysis promises the next level of insights.  Other interesting topics include: segmenting the analytics market, engaging with carrier clients, and upgrading from older- to newer-style methodologies.
  • LTE Analytics:  Learning New Rules in Real-Time Network Intelligence, Roaming and Customer Assurance interview with Martin Guilfoyle — LTE is telecom’s latest technology darling, and this article goes beyond the network jargon, to explain the momentous changes LTE brings.  The interview delves into the marriage of IMS, high QoS service delivery via IPX, real-time intelligence and roaming services, plus the new customer assurance hooks that LTE enables.
  • Shared Data Plans: The Challenge of Managing a Family of Pricing, Revenue Assurance, Fraud, and Network Policy Issues by Amit Daniel — Verizon Wireless‘ recent announcement of its move to shared data plans for families shook the mobile industry.  In this column, cVidya’s Amit Daniel shines a spotlight on the knowhow and analytics tools that operators now deperately need to offer the right  shared data price plans, ensure bandwidth throttling is handled correctly, and address new fraud concerns.
  • Analytics Guru: Are Telecoms Ready for the Biz Intelligence Explosion? interview with John Meyers — Business intelligence is evolving from the creation of dashboards and reports to taking action based on a deep knowledge of the environmental context.  The article explores the implications of “big data” in terms of IPTV, storage requirements, hardware, event collection, and deep packet inspection.
  • Social Networking for Telecoms: How To Enlist Friends and Family as Mobile Marketers interview with Simon Rees — Social Network Analysis (SNA) is about exploiting data on “friends and family” connections to combat churn and win new CSP business.  The article explores how an analysis of the ebb and flow of CDRs, phone calls, and messages, can identify key influencers and drive powerful marketing campaigns.
  • Making the Strategic Leap From Billing to Merchandising interview with Humera Malik — Today billing/charging technology has progressed to the point where the usage intelligence, the charges, the user behaviors, and the analytics can all come together in near real-time.  This article discusses the organizational and marketing strategies that enable a operator to create a true “merchandising” system that can revolutionize a CSP’s business.