keynote cambron
TRANSCRIPT
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property.
Designing Global Networks
Keith Cambron President & CEO, AT&T Labs
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property.
Networks – before 1990 - Shaped by the PSTN providers & standards - Largely voice, ISDN introduced in mid 1980s.
- One converged network for voice and data - Predictable port growth, about 3% per year - Predictable traffic patterns
- 3 ccs residence or 8% line occupancy in the busy hour
- 5 ccs business or 14% line occupancy in the busy hour
2
How have networks changed, and how do we design and operate them?
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property. 3
Networks – before 1990 ...
- Hierarchical networks - Static routing set by PSTN engineers - Clear division, networks & terminals
- Backbone traffic throttled by access - All traffic is unicast - All sessions used 64 kbps bandwidth
- Common channel signaling - Sessions are blocked, not queued - Blocking occurs at origination
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property. 4
Networks – after 2010
- Mesh - network of networks - Dynamic routing set by the network
- Mobility and IP are the centerpieces
- Blurred boundary, apps & net - No explicit congestion control
- Traffic is unicast & multicast - Session bandwidth is unspecified
- Services fail at the weakest point
- No end to end service management - Lack of global standards for services
Backbone ConsumersContent
Peers
Wireless
EnterpriseRegionalAccess
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property. 5
Foundational Changes in Networks
Then –
Converged networks optimized capital deployment. Networks were predictable and centrally managed. The network and the service were one. Devices and applications followed the network.
Now –
Devices and applications lead the networks. Traffic demand and modalities shift in dramatic fashion. There is no clear owner of service management. Global mobility and video drive investment.
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property.
• IP in over 200 countries • Over 4,000 nodes
• 1,000,000+ ports
• Over 900,000 fiber miles
• 38 Internet data centers • 168,000 routers
• Over 135,000 WiFi Hotspots
• Ethernet at 1,500 access points
Simplified map: not all nodes/links/routes shown * Enough data to transmit the digitized contents of the Library of Congress more than 400 times every day ** MPLS technology enables high-quality delivery to multiple services over a single IP Network Infrastructure
The AT&T network carries more than 21 Petabytes* of data traffic on average business day
Existing Fiber Routes New Undersea Fiber
New to AT&T Global Network New Core Routers
Existing IP/MPLS Hubs
Today’s Network Global Reach and Consistency
Page 6 © 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property.
Sydney-Hawaii
TPE
AAG
• 60,000 cell sites in US • 93M wireless subscribers
• 19,000 text msgs/second
• 7.5B records/day
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property.
• Trends That Matter • Technologies That Matter • The Technology Pipeline
• The Operational Model
7
Designing & Operating Today’s Networks How do we begin?
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property. 8
Trends That Matter Device Adoption
Computer Industry Almanac
PC Adoption
Mobile Phone Adoption
WikiInvest.com
Device adoption is going to mobile in US, and growing at 15 - 30% CAGR globally.
Device bandwidth consumption is growing at ~ 40% CAGR for smart devices.
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property. 9
Trends That Matter Internet Video
Un-cached Unicast
2000
4000
6000
8000
10000
12000
20 40 60 80 100 120 140 160 180 200 Number of Subscribers to a Live Event in 1000s
BW
x M
iles
March Madness
2008
Oprah Book Club 2008
Well-Cached Unicast
Multi-cast
2009
Inauguration
Video accounts for 40% of backbone traffic, and is growing at 75% CAGR
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property.
• iPad, iTablets – dramatic increases in screens • Multi-tasking – Pandora • Mobile LANs – tethering and vans
• Invisible Computing – 4G pallets & collars • Venues – replays and captures at the stadium • IPV6 – interworking and routing tables
10
Trends That Matter Cutting the cord
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property.
• MPLS/IP Core – foundational • Access Technologies – opening the gates • Optical Technologies – trenching & Moore’s Law
• Information Sciences – processing, data mining • IP & Media Evolution – IPv6, HTML5
11
Technologies that Matter
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property.
• Applications – daily change, dramatic shifts in months with long periods of stability
• Devices – 2x in 2 years, Moore’s Law • MPLS/IP Core – 4x improvement every 6 years • Wireline Access – 10x every 10 years
• Mobility Access – 4x every 4 years
Access technologies have long deployment cycles and are capital intensive. You’d better be right.
12
Velocity of Transformation The rate and periodicity of change
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property. 13
The Technology Pipeline
Demand – application & device driven Capacity –
technology & capital driven
Research Develop Deploy Operate
time
Keeping Pace With Demand
Volume
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property. 14
The Technology Pipeline Components and Chips to Systems
Research
Transmission Systems Eng
IC Design Systems Eng
IC Supplier AT&T Labs
Network Characteristics & Models, Use Cases & Models
Transmission Engineering Element Systems Engineering
Systems Supplier
Network Element Design
Network Element Certification
Systems Integration
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property. 15
The Technology Pipeline Systems to Networks and Services
Network Engineer
IT Engineer
Info Tech AT&T Labs Marketing & Sales
Service Definition Services Design & Integration
Systems Integration
Network Topology, Flows and Policies
Network Design & Engineering Operations & Systems Design
Operations
Operations & Performance Engr
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property. 16
Network Technology Introduction Research and Engineering Teams
Core Research
Development
Incubation & Ops
Systems Engineers
Test Engineers
Network Engineers
Σ (1 + x) n
for( int i = 0; i < x; i++ ) { Node n = new Node(i);
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property.
The Operational Model
17
Customer Care NOC
Network Management
Reporting Visualization Analysis Planning
Data Collection
NOC Service Management
Field Operations
Networks Topology Performance Events Customer
Data
Engineering
Design Audits Fault Engineering Fraud
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property.
The Operational Model AT&T Labs Mobility Network Design Regime
InstallationGuides / MOPs
Testing /Certification
Element/EMS MIBInventory
Data CollectorDesign & Impl.
Engr & FaultAnalysis Platforms
Work GroupReports, Portals & Views
Element & EMSRequirements
Configuration /Gold Standards
Engr & Ops Rules /Guidelines
Element Engr. &Ops Review
Element DrivenDesign Work
Network DrivenDesign Work
Service DrivenDesign Work
Availability &Failover Analysis
A – Z NetworkAnalysis &Design
Control PlaneDesign
QoS & PolicyDesign
Traffic DemandModels
Network Optimization& Design
End to End ServiceRequirements
Service/NetworkDesign & Budgets
Customer Churn Analysis
Service Trendingand Impacts
DeviceAnalysis
Chronic TroubleAnalysis
ConfigurationAudits & Tools
Tier 4Support
PSL
Operations DrivenDesign Work
MD&E (McElroy)Responsibility
Page 18
AT&T Proprietary (Restricted)
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property.
Site 2
MPLS Transport
OSPF selected path using network topology
Network & Application Aware – Load Balancing
Edge Routers
Backbone Switch
IRSCP/RR servers
Content Servers
Altered policy injected into IRSCP/RR servers
Site 1
Topology independent preferred path based on latency or other factors
Applying Research – Dynamic Control Intelligent Routing Service Control Point (IRSCP)
19
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property.
Applying Research Traffic Analysis System
TAS was delivered within 45 days; from technology into a documented system operating in a production environment
Technology components quickly assembled, hardened and delivered to customers
Analytics
Algorithms
Production Processes: • Testing • Release Mgmt • Operations • Tier 3 Application Support • ETE Security • Audits/Controls
U S E R S U P P O R T
Documentation/Training
Production Environment Stable/scalable code
Daytona
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property.
Applying Research Traffic Analysis System
21
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property.
Page 22
Loss of many links out of
Japan
Snapshot from March 15th 2011
Applying Research Ptolemy
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property.
Page 23
Loss of many links out of
Japan. What’s left?
Applying Research Ptolemy
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property.
Ptolemy is built on top of a wide range of research innovations: • Darkstar/Data: Massive repository of network data, normalized for easy correlation
• OSPFMON: Monitoring link status
• NETDB: Topology views, capacities
• Graphivz: Logical topology views
• …
Ptolemy design detected issues in other systems e.g., • Missing alarms
• Majority performance alarms erroneously turned off for 6 months – Ops flying blind!
• System bugs (e.g., NetDB capacities)…
Page 24
Applying Research Ptolemy
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property.
• 400 platforms – ADSL modem to CRS-1 • > 10,000 services – POTS to AVPN, Cloud • > 1,000 active projects
• > 100 software projects • Staffing – Talent, breadth, depth • Supplier engagement – Quality, R&D
25
Our Biggest Challenge Excellence at Scale