Email a colleague    

September 2014

Paradigm Shift in OSS Software: Network Topology Views via Enterprise-Search

Paradigm Shift in OSS Software: Network Topology Views via Enterprise-Search

“Throw a stone into the stream, and the circles that propagate themselves are a beautiful example of all influence.  Likewise, man is placed in the center of beings and a ray of relation passes from every other being to him.”   — Ralph Waldo Emerson, Nature 1836


Enterprise-search is the most frugal of big data’s creatures: it lives off the land and doesn‘t need to be fed.

It acquires its data from any number of sources: machine logs, tables, emails, twitter feeds, Excel, call center conversations — you name it.  It even bypasses APIs and the data trolls who force you to pay a king’s ransom to cross their bridges.

Search also discovers the relations in data without the heavy lifting and expense of architecting data schemas or constantly modifying the business logic inside the labyrinth of enterprise data gardens.

Linked-In is a perfect example of search’s power.  With a market cap of $28 billion, Linked-In makes its money by searching and analyzing the ever-changing relations (or links) between people and the subject matter that unites them.

And yet, as successful as enterprise-search has become on the web, its influence has not yet rippled into the IT main stream.  It’s still considered “experimental” technology: good for report generating and ad hoc analytics, but not for serious operational applications.

So this is precisely why Ontology’s recent announcement of the first successful “shrink-wrapped” enterprise-search OSS application for a Tier 1 operator is so significant.  It’s a clear sign that enterprise-search is now on the maturity fast track — and it can be at the core of genuine software, not just consulting services.

Here to discuss his company’s breakthrough and delve into a discussion on network inventory and the future of enterprise-search and topology visualization is Benedict Enweani, Ontology’s CEO.

Dan Baker: Benedict, first of all, congratulations.  The delivery of a large-scale enterprise-search application is exciting news for all of us big data enthusiasts.  Please tell us about it.

Benedict Enweani: Thanks, Dan.  About a year ago, we deployed the solution to a big Middle Eastern operator who has about 40 million subs.  We were initially hired to come in and create reports for them.  And they saw how we could generate across multi-technology and multi-vendor vendor views — see a full topology from the antenna and RAN all the way back through the various layers of microwave, backhaul, Ethernet and T1/E1 connections riding under that.

So they came back to us and said: “Why should we pay you all this money to get just reports from you.  Can‘t we just pay you to provide an operational system we can use for network operations and troubleshooting?”

Needless to say we were thrilled to get that offer.  So that was the impetus to package up our search technology and sell it as a solution.  In turn, it’s generating interest from other telecoms and managed service providers.

What did the operator consider most valuable in the solution?

In a word, the ability to see “multi-dimensional topologies”: multi-vendor, multi-technology, and multi-layer.  And when you get that view, it becomes much easier to do network change management, trouble shooting, and service impact analysis.

This Middle Eastern operator has 8,000 different configurations it needed to bring in.  And they didn‘t want to go into five different systems to find their answers.  So we delivered a tool intelligent enough to spot the context talked about in different configuration sources and build a structure that explains them and fits them in a data model.

Another value we brought in was an ability to resolve tough data integrity problems that require comparing multiple sources.

In the past we would simply extract our data into reports and special interfaces, but we realized that everyone has a need to visualize network topology so that’s what are our primary output is today.  And while topology sounds like a very network specific concern, it’s actually a data integration problem.  The information you need to understand a topology you can‘t actually discover using SNMP, in fact, getting an understanding of only a single system is not enough.  You need to know how things cross many different systems.  You need to study how everything interacts with everything else.

So the data sources we pulled in were many, for instance: GE Small World, Siebel CRM, Twitter feeds, Mobile network, Cisco configurations of fixed network, and addressable parts of the network from IBM.  Search semantically recognizes nodes, switches, cards, interfaces, and connections, and in this case across 10 different network domains.

In the topology you see a link between the radio antenna and base station controller.  You notice the base station serves six different cells, and there’s a microwave backhaul for the first couple of miles and that terminates on an optical network and runs into the BSC.  So all that detail is there.  And if you want to drill down and see how a particular switch is set up and what cards are in the chassis, you can do that.

Now a program like this is usually a candidate for a network inventory solution.  But that’s a very difficult road to take.  I have personally been involved in several network inventory projects, and often the network inventory system never gets fully functional.  What we accomplished for the Middle East operator took us 6 months.  But if it was a network inventory project, it would have taken three years.

So we figure, our technology is lower cost and a better choice than a network inventory solution in many cases.

“Better than network inventory” is a bold statement, Benedict, and it goes against the conventional wisdom of the past 15 years which says that network inventory is the Holy Grail of what you need to do in OSS.

Yes, I realize it’s a bold statement, so let me step back and explain my view of the OSS world -- its evolution and issues from an inventory point of view.

The first wave of inventory solutions was born in the TDM world where you simply documented facilities.  Then as IP emerged and greatly complicated things, folks like Cramer Systems and Granite came along with the idea that network inventory should be elevated to a kind of golden database and business process engine for provisioning the network.

However, history has shown there are big problems in keeping network inventory up to date.  And the complexity of accounting for many different types of services and equipment requires you to constantly create new SQL logic.  Then there’s the huge cost of manually or semi-automatically importing the data into inventory.  We’ve seen cases where it took 8 years to actually stand an inventory system up.  Plus, once you’re there, you need to ensure the inventory system is the exclusive way you the provision, else you can quickly lose the bubble.

I figure the third inventory wave was Intelliden’s idea of reconciling against the actual network itself instead of trying to meticulously replicate it in an off-line database.  Intelliden’s concept was an important breakthrough except that you could only see active elements in the network: it gave you no visibility over all the passive elements out there.  Plus there are issues keeping up with the changes to all the vendors‘ network equipment.

Network Data Alignment

So how does Ontology improve on the network inventory state-of-the-art?

Well we begin by recognizing that while getting detailed network views is key, going the extra step of automating provisioning may not be worth the effort, especially in large networks.

I worked for a company called Orchestream in the 90s and we built the IP network activation software. [Orchestream was bought by MetaSolv, then later acquired by Oracle.]

Now the task we set out for ourselves at Orchestream was a tough one because we needed to tightly integrate with all the NMSs and EMSs.  We found this effort can succeed in constrained domains, for instance a network with only Cisco and Juniper network gear.  But if you strayed off and bought something from another provider, then the cost of integrating to that equipment was just huge.

So this is why Ontology limits itself to getting the network view for service assurance and network planning, but we stop short of provisioning or writing anything to the network.  In fact, our Middle Eastern operator was very satisfied that we went halfway.  They use our solution for service assurance and generating the topological views, then make manual or semi-automated changes on their own using various NMSs and EMSs.

One of the biggest drawbacks of inventory solutions is that every time you run into a new source of data or change the infrastructure, you need to insert new logic in the inventory software’s model which is an expensive and error-prone task.

But with enterprise-search, if you add a new data source, you essentially create a new class and tell the system how objects of that class link to other things.  The search routine then automatically discovers and maps those objects into the topology.

For instance, to add a new type of antenna into your network you simply define how that antenna interacts with, say, your microwave links.  Then the next topology search would discover all those antenna nodes in your system.  Network nodes are constantly announcing how they relate to things they connect with.  For instance, there may be IP addresses in the antenna’s configuration, or maybe time slots associated with a SONET network within that equipment, so the system deduces that there’s a connection to an optical network.

Each data source updates on its own clock.  Faults are coming in all the time.  Network discovery engines are usually programmed to discover the network 1 to 4 times a day.  CRMs can update each transaction, however that normally creates a heavy load, so operators tend to batch that up once an hour.  Physical inventory updates don‘t usually happen faster than once a week.  And Twitter tweats are loading constantly.  Then using a technique we call “finger-printing” we detect abnormal behavior so if we normally receive an update from a source every hour, and we haven’t seen one in the last 3 hours, that raises an alert.

In what network areas you are applying your enterprise search technology to?

Actually there are four or five very specific areas that customers find most useful for this technology.  Let me walk you through them:

  • Change management -- You are going to make some network changes and you need to pick the most opportune time to make the change and know how the change will impact your SLAs with customers.  And will changes that others are making at the same time possibly create a catastrophe?
  • Network troubleshooting — If fifty 3G cells go down at one time, you ask yourself: what’s common for those 50 cells?  And the system comes back and tells you they all use the same transmission node.  So such root cause analysis can be done across a multi-layer system view.  Theoretically you can do this in an inventory system, but in the seven years that my partner Leo and I have been working on this project, we have actually never seen an inventory system that spans more than 2 technologies.
  • Service Impact Analysis — If a key DWM switch goes down, which antennas are affected?  Which service centers are affected?  And which of the actual enterprise customers are affected?
  • Enterprise Customer Topology — This is a very interesting one and a very large operator in the UK needed this capability.  Take a financial firm like Llyod’s Bank.  They have thousands of network delivery points and it’s very useful to search the carrier’s infrastructure and pull together a topology showing where service is running poorly and where there are issues.  For each enterprise client, we ended up saving the carrier many days of work trying to pull this same information from multiple sources.

So these four use cases are where the lion’s share of our ROI comes from.  So you are saving people time digging up vital information or decreasing their SLA violations.  Or you are decreasing the minutes of downtime, or maybe increasing service resilience.

And the beauty here is that an operator can achieve all these things without the expense of building out a new inventory system.

Benedict, thanks for this highly interesting briefing.  Good luck as you roll this solution out — and please keep us informed of your progress.

Copyright 2014 Black Swan Telecom Journal

 

About the Expert

Benedict Enweani

Benedict Enweani

As CEO and co-founder of Ontology Systems, Benedict aims to make his company the leading innovator of semantic solutions in the data center and networking marketplace.  Before founding Ontology in 2005, Benedict was CTO at Corvil Networks and CTO at Orchestream (now Oracle).   Contact Benedict via

Related Stories

  • Delivering Service Assurance Excellence at a Reduced Operating Cost interview with Gregg Hara — The great diversity and complexity of today’s networks make service assurance a big challenge.  But advances in off-the-shelf software now permit the configuring and visualizing of services across multiple technologies on a modest operating budget.
  • Paradigm Shift in OSS Software: Network Topology Views via Enterprise-Search interview with Benedict Enweani — Enterprise-search is a wildly successful technology on the web, yet its influence has not yet rippled to the IT main stream.  But now a large Middle Eastern operator has deployed a major service assurance application using enterprise-search.  The interview discusses this multi-dimensional topology solution and compares it to traditional network inventory.
  • The Multi-Vendor MPLS: Enabling Tier 2 and 3 Telecoms to Offer World-Class Networks to SMBs interview with Prabhu Ramachandran — MPLS is a networking technology that has caught fire in the last decade.  Yet the complexity of MPLS has relegated to being mostly a large carrier solution.  Now a developer of a multi-vendor MPLS solutions explains why the next wave of MPLS adoption will come from tier 2/3 carriers supporting SMB customers.
  • Big Data: Is it Ready for Prime Time in Customer Experience Management? interview with Thomas Sutter — Customer experience management is one of the most challenging of OSS domains and some suppliers are touting “big data” solutions as the silver bullet for CEM upgrades and consolidation.  This interview challenges the readiness of big data soluions to tackle OSS issues and deliver the cost savings.  The article also provides advice on managing technology risks, software vendor partnering, and the strategies of different OSS suppliers.
  • Calculated Risk: The Race to Deliver the Next Generation of LTE Service Management interview with Edoardo Rizzi — LTE and the emerging heterogeneous networks are likely to shake up the service management and customer experience management worlds.  Learn about the many new network management challenges LTE presents, and how a small OSS software firm aims to beat the big established players to market with a bold new technology and strategy.
  • Mobile Broadband: The Customer Service Assurance Challenge interview with Michele Campriani — iPhone and Android traffic is surging but operators struggle with network congestion and dropping ARPUs.  The answer?  Direct  resources and service quality measures to ensure VIPs are indeed getting the quality they expect.  Using real-life examples that cut to the chase of technical complexities, this article explains the chief causes of service quality degradation and describes efficient ways to deal with the problem.

Related Articles

  • Pure Play NFV: Lessons Learned from Masergy’s Virtual Deployment for a Global Enterprise interview with Prayson Pate — NFV is just getting off the ground, but one cloud provider to enterprises making a stir in virtual technology waters is Masergy.  Here are lessons learned from Masergy’s recent global deployment using a NFV pure play software approach.
  • The Digital Enabler: A Charging, Self-Care & Marketing Platform at the Core of the Mobile Business interview with Jennifer Kyriakakis — The digital enabler is a central platform that ties together charging, self-care, and marketing.  The article explains why leading operators consider digital enablers pivotal to their digital strategies.
  • Delivering Service Assurance Excellence at a Reduced Operating Cost interview with Gregg Hara — The great diversity and complexity of today’s networks make service assurance a big challenge.  But advances in off-the-shelf software now permit the configuring and visualizing of services across multiple technologies on a modest operating budget.
  • Are Cloud-Based Call Centers the Next Hot Product for the SMB Market? interview with Doron Dovrat — Quality customer service can improve a company’s corporate identity and drive business growth.  But many SMBs are priced out of acquiring modern call center technology.  This article explains the benefits of affordable and flexible cloud-based call centers.
  • Flexing the OSS & Network to Support the Digital Ecosystem interview with Ken Dilbeck — The need for telecoms to support a broader digital ecosystem requires an enormous change to OSS infrastructures and the way networks are being managed.  This interview sheds light on these challenges.
  • Crossing the Rubicon: Is it Time for Tier Ones to Move to a Real-Time Analytics BSS? interview with Andy Tiller — Will tier one operators continue to maintain their quilt works of legacy and adjunct platforms — or will they radically transform their BSS architecture into a new  system designed to address the new telecom era?  An advocate for radical transformation discusses: real-time analytics, billing for enterprises, partnering mashups, and on-going transformation work at Telenor.
  • Paradigm Shift in OSS Software: Network Topology Views via Enterprise-Search interview with Benedict Enweani — Enterprise-search is a wildly successful technology on the web, yet its influence has not yet rippled to the IT main stream.  But now a large Middle Eastern operator has deployed a major service assurance application using enterprise-search.  The interview discusses this multi-dimensional topology solution and compares it to traditional network inventory.
  • The Multi-Vendor MPLS: Enabling Tier 2 and 3 Telecoms to Offer World-Class Networks to SMBs interview with Prabhu Ramachandran — MPLS is a networking technology that has caught fire in the last decade.  Yet the complexity of MPLS has relegated to being mostly a large carrier solution.  Now a developer of a multi-vendor MPLS solutions explains why the next wave of MPLS adoption will come from tier 2/3 carriers supporting SMB customers.
  • Enabling Telecoms & Utilities to Adapt to the Winds of Business Change interview with Kirill Rechter — Billing is in the midst of momentous change.  Its value is no longer just around delivering multi-play services or sophisticated rating.  In this article you’ll learn how a billing/CRM supplier has adapted to the times by offering deeper value around the larger business issues of its telecom and utility clients.
  • Driving Customer Care Results & Cost Savings from Big Data Facts interview with Brian Jurutka — Mobile broadband and today’s dizzying array of app and network technology present a big challenge to customer care.  In fact, care agents have a hard time staying one step ahead of customers who call to report problems.  But network analytics comes to the rescue with advanced mobile handset troubleshooting and an ability to put greater intelligence at the fingertips of highly trained reps.
  • Hadoop and M2M Meet Device and Network Management Systems interview with Eric Wegner — Telecom big-data in networks is more than customer experience managment: it’s also about M2M plus network and element management systems.  This interview discusses the explosion in machine-to-machine devices, the virtues and drawbacks of Hadoop, and the network impact of shrink-wrapped search.
  • The Data Center & Cloud Infrastructure Boom: Is Your Sales/Engineering Team Equipped to Win? by Dan Baker — The build-out of enterprise clouds and data centers is a golden opportunity for systems integrators, carriers, and cloud providers.  But the firms who win this business will have sales and engineering teams who can drive an effective and streamlined requirements-to-design-to-order process.  This white paper points to a solution — a collaborative solution designs system — and explains 8 key capabilities of an ideal platform.
  • Big Data: Is it Ready for Prime Time in Customer Experience Management? interview with Thomas Sutter — Customer experience management is one of the most challenging of OSS domains and some suppliers are touting “big data” solutions as the silver bullet for CEM upgrades and consolidation.  This interview challenges the readiness of big data soluions to tackle OSS issues and deliver the cost savings.  The article also provides advice on managing technology risks, software vendor partnering, and the strategies of different OSS suppliers.
  • Calculated Risk: The Race to Deliver the Next Generation of LTE Service Management interview with Edoardo Rizzi — LTE and the emerging heterogeneous networks are likely to shake up the service management and customer experience management worlds.  Learn about the many new network management challenges LTE presents, and how a small OSS software firm aims to beat the big established players to market with a bold new technology and strategy.
  • Decom Dilemma: Why Tearing Down Networks is Often Harder than Deploying Them interview with Dan Hays — For every new 4G LTE and IP-based infrastructure deployed, there typically a legacy network that’s been rendered obsolete and needs to be decommissioned.  This article takes you through the many complexities of network decom, such as facilities planning, site lease terminations, green-safe equipment disposal, and tax relief programs.
  • Migration Success or Migraine Headache: Why Upfront Planning is Key to Network Decom interview with Ron Angner — Shutting down old networks and migrating customers to new ones is among the most challenging activities a network operators does today.  This article provides advice on the many network issues surrounding migration and decommissioning.  Topics discussed include inventory reconciliation, LEC/CLEC coordination, and protection of customers in the midst of projects that require great program management skills.
  • Navigating the Telecom Solutions Wilderness: Advice from Some Veteran Mountaineers interview with Al Brisard — Telecom solutions vendors struggle mightily to position their solutions and figure out what to offer next in a market where there’s considerable product and service crossover.  In this article, a veteran order management specialist firm lays out its strategy for mixing deep-bench functional expertise with process consulting, analytics, and custom API development.
  • Will Telecoms Sink Under the Weight of their Bloated and Out-of-Control Product Stacks? interview with Simon Muderack — Telecoms pay daily for their lack of product integration as they constantly reinvent product wheels, lose customer intelligence, and waste time/money.  This article makes the case of an enterprise product catalog.  Drawing on central catalog cases at a few Tier 1 operators, the article explains the benefits: reducing billing and provisioning costs, promoting product reuse, and smoothing operations.
  • Virtual Operator Life: Enabling Multi-Level Resellers Through an Active Product Catalog interview with Rob Hill — The value of product distribution via virtual operators is immense.  They enable a carrier to sell to markets it cannot profitably serve directly.  Yet the need for greater reseller flexibility in the bundling and pricing of increasingly complex IP and cloud services is now a major channel barrier.  This article explains what’s behind an innovative product catalog solution that doubles as a service creation environment for resellers in multiple tiers.
  • Telecom Blocking & Tackling: Executing the Fundamentals of the Order-to-Bill Process interview with Ron Angner — Just as football teams need to be good at the basics of blocking and tackling, telecoms need to excel at their own fundamental skillset: the order-to-cash process.  In this article, a leading consulting firm explains its methodology for taking operators on the path towards order-to-cash excellence.  Issues discussed include: provisioning intervals; standardization and simplicity; the transition from legacy to improved process; and the major role that industry metrics play.
  • Wireline Act IV, Scene II: Packaging Network & SaaS Services Together to Serve SMBs interview with John Frame — As revenue from telephony services has steadily declined, fixed network operators have scrambled to support VoIP, enhanced IP services, and now cloud applications.  This shift has also brought challenges to the provisioning software vendors who support the operators.  In this interview, a leading supplier explains how it’s transforming from plain ol‘ OSS software provider to packager of on-net and SaaS solutions from an array of third party cloud providers.
  • Telecom Merger Juggling Act: How to Convert the Back Office and Keep Customers and Investors Happy at the Same Time interview with Alan Burgess & Curtis Mills — Billing and OSS conversions as the result of a merger are a risky activity as evidenced by famous cases at Fairpoint and Hawaiian Telcom.  This article offers advice on how to head off problems by monitoring key operations checkpoints, asking the right questions, and leading with a proven conversion methodology.
  • Is Order Management a Provisioning System or Your Best Salesperson? by John Konczal — Order management as a differentiator is a very new concept to many CSP people, but it’s become a very real sales booster in many industries.  Using electronics retailer BestBuy as an example, the article points to several innovations that can — and are — being applied by CSPs today.  The article concludes with 8 key questions an operator should ask to measure advanced order management progress.
  • NEC Takes the Telecom Cloud from PowerPoint to Live Customers interview with Shinya Kukita — In the cloud computing world, it’s a long road from technology success to telecom busness opportunity.  But this story about how NEC and Telefonica are partnering to offer cloud services to small and medium enterprises shows the experience of early cloud adoption.  Issues discussed in the article include: customer types, cloud application varieties, geographic region acceptance, and selling challenges.
  • Billing As Enabler for the Next Killer Business Model interview with Scott Swartz — Facebook, cloud services, and Google Ads are examples of innovative business models that demand unique or non-standard billing techniques.  The article shows how flexible, change-on-the-fly, and metadata-driven billing architectures are enabling CSPs to offer truly ground breaking services.
  • Real-Time Provisioning of SIM Cards: A Boon to GSM Operators interview with Simo Isomaki — Software-controlled SIM card configuration is revolutionizing the activation of GSM phones.  The article explains how dynamic SIM management decouples the selection of numbers/services and delivers new opportunities to market during the customer acquisition and intial provisoining phase.
  • A Cynic Converted: IN/Prepaid Platforms Are Now Pretty Cool interview with Grant Lenahan — Service delivery platforms born in the IN era are often painted as inflexible and expensive to maintain.  Learn how modern SDPs with protocol mediation, high availability, and flexible Service Creation Environments are delivering value for operators such as Brazil’s Oi.
  • Achieving Revenue Maximization in the Telecom Contact Center interview with Robert Lamb — Optimizing the contact center offers one of the greatest returns on investment for a CSP.  The director of AT&T’s contact center services business explains how telecoms can strike an “artful balance” between contact center investment and cost savings.  The discussion draws from AT&T’s consulting with world class customers like Ford, Dell, Discover Financial, DISH Network, and General Motors.
  • Mobile Broadband: The Customer Service Assurance Challenge interview with Michele Campriani — iPhone and Android traffic is surging but operators struggle with network congestion and dropping ARPUs.  The answer?  Direct  resources and service quality measures to ensure VIPs are indeed getting the quality they expect.  Using real-life examples that cut to the chase of technical complexities, this article explains the chief causes of service quality degradation and describes efficient ways to deal with the problem.
  • Telco-in-a-Box: Are Telecoms Back in the B/OSS Business? interview with Jim Dunlap — Most telecoms have long since folded their merchant B/OSS software/services businesses.  But now Cycle30, a subsidiary of Alaskan operator GCI, is offering a order-to-cash managed service for other operators and utilities.  The article discusses the company’s unique business model and contrasts it with billing service bureau and licensed software approaches.
  • Bricks, Mortar & Well-Trained Reps Make a Comeback in Customer Management interview with Scott Kohlman — Greater industry competition, service complexity, and employee turnover have raised the bar in the customer support.  Indeed, complex services are putting an emphasis on quality care interactions in the store, on the web, and through the call center.  In this article you’ll learn about innovations in CRM, multi-tabbed agent portals,  call center agent training, customer treatment philosophies, and the impact of  self-service.
  • 21st Century Order Management: The Cross-Channel Sales Conversation by John Konczal — Selling a mobile service is generally not a one-and-done transaction.  It often involves several interactions — across the web, call center, store, and even kiosks.  This article explains the power of a “cross-channel hub” which sits above all sales channels, interacts with them all, and allows a CSP to keep the sales conversation moving forward seamlessly.
  • Building a B/OSS Business Through Common Sense Customer Service by David West — Delivering customer service excellence doesn‘t require mastering some secret technique.  The premise of this article is that plain dealing with customers and employees is all that’s needed for a winning formula.  The argument is spelling out in a simple 4 step methodology along with some practical examples.