Cisco Confidential 4 the largest portion of the traffic will rule the design the largest portion of the traffic must be as close to fiber as possible, eliminate overlay the largest po
Trang 2© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 2
Trang 3© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 3
IP Traffic will increase 4x from 2009 to 2014
Central & Eastern Europe will be 2.3EB/month (3.6%
of the global 64EB/month)
Source: Cisco Visual Networking Index—Forecast, 2009–2014 [Cisco VNE]
IP Traffic
Internet Traffic
Business IP traffic will increase 2.6x (21% CAGR), only video will grow 10x
Trang 4© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 4
the largest portion of the traffic will rule the design
the largest portion of the traffic must be as close to fiber as
possible, eliminate overlay
the largest portion of the traffic must pass the lowest possible
number of nodes
the number of changes in the network must be minimal when
adding more capacity; use statistical multiplex - small traffic follows big traffic
Watch TCO, Price/Performance ratio, Watt/Gigabit ratio,
investment protection (h/w upgradeability, s/w roadmaps)
How to move bits cheaper
reduce OPEX, CAPEX, and keep reasonable quality?
Trang 5© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 5
Trang 6© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 6
Not multiple single-service networks Key enablers are Virtualization, QoS and Security.
Moving bits cheaper 100GE evolution, Price/Gigabit and Watt/Gigabit reduction.
Statistical Multiplex (IP/MPLS, MPLS-TP) and Division Multiplex (DWDM, OTN).
Trang 7Cisco Confidential 7
© 2010 Cisco and/or its affiliates All rights reserved
Designing End to End IP/MPLS
Static Transport Layer
Protection is in the IP domain
• Hierarchical Design with optical router bypass
• Still simple upgrades
• Cheaper bandwidth
• Quality is kept
Flat Design (full mesh between IP routers) Fewer nodes, Much more Links
Complex upgrades, complex QoS
Dynamic Transport Layer (G.MPLS, VCAT/ODU-FLEX) Protection in the Optical domain
Trang 8© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 8
Metro Aggregation
Core
BNG (Edge)
Internet Gateways
The Quality of IP NGN Design
• Hierarchy (P is connected to PE)
• One network, one IGP (not multiple)
• QoS and Security everywhere
• Scalability – where will 40/100GE start?
The Quality of IP NGN Design
• Hierarchy (P is connected to PE)
• One network, one IGP (not multiple)
• QoS and Security everywhere
• Scalability – where will 40/100GE start?
SSN – Single Service Node (eg BRAS, IGW) MSN – Multiservice Node (eg P router)
•SSN-MSN link = ok
safe operation
•MSN-MSN link = think twice!
such link needs proper QoS and capacity mgt
•SSN-SSN link = stop!
don’t break the hierarchy, don’t create another net
Trang 10© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 10
100GE
IEEE 802.3ba ratified
CRS-3 today, in 2011/12 also ASR9K & Nexus7K
OTN (Optical Transport Network)
OTN Framing
implemented today for Ethernet interfaces – ITU-T G.709
CRS, ASR9000, 7600, CPT, ONS (ODU2e, ODU3, future ODU4)
OTN Aggregation
implemented today for 10GE ODU3 (future Any-Rate, ODU4, MPLS-TP)
ONS15454 Muxponder
OTN Switching
geographically very large countries, or very dense 10G E-Line networks (G.MPLS)
developed for next generation portfolio
Trang 11© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 11
• All lambdas upgraded to 100Gbps
• Sub-100G services provided by OTN OEO
Advantages All lambdas on a fibre are 100G
Disadvantages 100TXP investment upfront Need an additional OTN OEO All 10G TXPs are obsolete
10G and 100G DWDM
Coexistence
10G and 100G lambdas co-exist on same fibre
Packet uses 100G, everything else 10G
Advantages Only high demand clients upgraded to 100G
Protects existing 10G DWDM investment
Lowest cost per bit (100G TXPs>10 x10G TXPs)
Disadvantages Need a guard band between 10G and 100G
OTN Multiplexing
Trang 12© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 12
No No No
Trang 13© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 13
Wholesale and retail Ethernet services :
E-Line, E-Tree and E-LAN
~90% of Ethernet market place <1GE in 2013
What is the most efficient way to support these
Ethernet Services? OTN circuits or Packets?
Source Infonetics 2009 and Cisco VNI
domain for OTN domain for MPLS
Circuit
Packet
Trang 14© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential
Routers
Trang 15© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 15
• Silicon has fundamentally followed Moore’s law
• Optics is fundamentally an analog problem
Routers: 23% Cumulative Average $/Gbps Drop per year / fewer ASICs
Optics: $/G stays flat (best case) or increases from one technology to the next
Cisco Core Router Example
10G/40G/100G Networking Ports Biannual Worldwide and Regional Market Size and Forecasts
May 2010
NEW
Trang 16© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 16
RSP, Route/Switch Processor (instead of RP and FC)
Ethernet-oriented Linecard (non-modular, less memory)
4x 10G NPU (instead of 1x 40G NPU)
one full-duplex NPU shared for rx and tx (instead of 2 dedicated NPU’s)
2x 40G fabric interface (instead of 1x 80G fabric interface)
8/16 queues per port (instead of thousands)
lower-scale NPU (no need for thousands of interfaces)
licenses for features that not everybody uses (IPoDWDM, SyncE, VPN, )
Trang 17© 2010 Cisco Systems, Inc All rights reserved.
Cisco CRS
very modular router anatomy
buff.
IOS Q
buff.
IOS Q
141G rx 225G tx
Trang 18© 2010 Cisco Systems, Inc All rights reserved.
- shared for RX & TX processing
- more independent NPU’s per card
Trident NPU
- 15 Gbps, 14 Mpps (2x)
- shared for RX & TX processing
- more independent NPU’s per card
NP NP
buff.
buff.
Transport LC – 16x TGE OS
NP NP
buff.
buff.
IOS
NP NP
buff.
buff.
NP NP
buff.
buff.
NP NP NP NP
• CPU + Switch Fabric
• active/active SF
RSP (Route/Switch Processor)
• CPU + Switch Fabric
• active/active SF
Trang 19© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 19
Edge-facing Card Core-facing Card Over-subscribed Card
CRS-1 EMSE MSC40 $50K FP40 + 4xTGE $19K FP40 + 8xTGE $16K
-CRS-3 EMSE MSC140 $29K FP140 + 14xTGE $18K FP140 + 20xTGE $15K
ASR9000 A9K-8T-B $16K A9K-8T-L $9.25K A9K-8T/4-L $5.75K
Watt per TGE (max.)
Trang 20© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential
IPoDWDM
Trang 21© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 21
Invest in High Capacity SDH/SONET/OTN
10 transponders needed
4-14 Short Reach optics
Every Lambda OEO
Addt’l transponder & SR for each λ
Expensive switch w/active electronics
OTN OEO SDH/SONET Solution
Short Reach Optics I/F
Cross Connect (XC)
IPoDWDM Solution
ROADMs
Tunable DWDM I/F Router
Eliminate Unnecessary OEO XC & Transponders
Trang 22Cisco Confidential 22
© 2010 Cisco and/or its affiliates All rights reserved
Core Router
Electrical XC
Metro Network
Electrical switching – OEO conversions
Metro
Network
Manual patching of
10G connections
Trang 23Photonic switching –
no OEO conversions
ROADM
Core Router
Common Network Management and Control
Mesh
ROADM
Trang 24© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 24
• Integration of core routers with optical transport platform
2 layer in one reduced OPEX
Eliminates need O-E-O modules (transponders) in transport platform
Integration at control plane level (pre-FEC FRR) to improve network resiliency
• Increased rack space and power efficiency
• Possible integration with 3rd party transport equipment
modulations for high speed channels
ODB, DPSK+ for 40 Gbps
CP-DQPSK planned for 100 Gbps
• Available for CRS, ASR 9000, 7600, and 12000
Trang 25© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 25
Before
Router Transponder ROADM
Transponder Integrated into Router Transponder Integrated into Router
Trang 26© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 26
Ensure you are user of user group in proper task group
Configure DWDM controller using CLI:
Trang 27© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 27
ITU-T G.709 Performance Monitoring
Line Card State
LOS = 0 LOF = 0 LOM = 0
BDI = 0 IAE = 0 BIP = 0
pre-FEC BER = 9.53E-8 Q = 5.26 Q Margin = 5.49
Remote FEC Mode: Unknown
FECMISMATCH = 0
Trang 28© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 28
Optical Alarms Trace & Performance Monitoring
On-Board TDC included
on 2 nd Generation
show controllers dwdm 0/15/0/0 (cont)
Port dwdm0/15/0/0
Detected Alarms: None
Asserted Alarms: None
Alarm Reporting Enabled for: LOS LOF LOM IAE OTU-BDI OTU-TIM OTU_SF_BER OTU_SD_BER
ODU-AIS ODU-BDI OCI LCK PTIM ODU-TIM FECMISMATCH
BER Thresholds: OTU-SF = 10e-3 OTU-SD = 10e-6
OTU TTI Sent String ASCII: Tx TTI Not Configured
OTU TTI Received String ASCII: Rx TTI Not Recieved
OTU TTI Expected String ASCII: Exp TTI Not Configured
ODU TTI Sent String ASCII: Tx TTI Not Configured
ODU TTI Received String ASCII: Rx TTI Not Recieved
ODU TTI Expected String ASCII: Exp TTI Not Configured
Trang 29© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 29
Performance Monitoring Over Time
Current Interval
Past Intervals
show controllers dwdm 0/15/0/0 pm history fec
Port dwdm0/15/0/0
g709 FEC in the current interval [ 1:30:00 - 01:31:21 Mon Jun 28 2010]
EC-BITS : 238922 Threshold : 0 TCA(enable) : NO
UC-WORDS : 0 Threshold : 0 TCA(enable) : NO
g709 FEC in interval 1 [ 1:15:00 - 1:30:00 Mon Jun 28 2010]
Trang 30© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 30
APS channel is used for alarm signaling
Trang 31© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential
Proactive Protection
Trang 33© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 33
RP/0/0/CPU0:router(config)# controller dwdm 0/0/0/0
proactive
log signal /disk0:/logfile1 /* start logging to the file
proactive trigger threshold 5 3 /* BER = 5E-3, window=30ms
proactive trigger window 100 /* changed to 100ms
proactive revert threshold 4 3
commit
RP/0/0/CPU0:router# sh controller dwdm 0/0/0/0 proactive
Proactive protection status: ON/OFF
Proactive protection state: Normal - interface is active
Inputs affecting proactive protection state:
Transport Admin State : IS/OOS/OOS-MT
Trigger Threshold: 3e-4
Revert Threshold: 5e-5
Trigger Integration Window: 100ms
Revert Integration Window: 2000ms
Received APS: 0x00 (No Request)
Transmitted APS request: 0x0A (Signal Degrade)
Trang 34© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 34
1 A-Z Provisioning sets congruent threshold for pre-FEC BER
2 Whenever a degrade is detected, i.e the BER pre-FEC
threshold is crossed at REGEN, REGEN propagates a Degrade indication forward and backward
3 FRR detects the degrade indication and switch
Regen
Threshold crossed at a regen, causing a signal towards upstream and downstream routers
Activates L3 switching
signal
signal
Router-B
Trang 35© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 35
– FRR decides protection path ahead of a failure
– Can be wrong w/o SRLG data
What appears diverse in L2/L3 may not be diverse in L1
– Manual SRLG entry is error prone and not up to date
– SRLGs can be mined from the Optical layer and fed to IP layer
Trang 36in Info Model
Comm Inside the
NE (IPC)
Alarm
EMS
DWDM Router Interfaces
TL-1/CORBA/XML
Config
DWDM Main Controller w/ Info Model Database
Virtual Transponder Representation in Info Model
LMP
IPoDWDM: Can Be Managed w/out Significant Changes
Trang 37© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 37
Trang 38© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 38
CESNET 40G IPoDWDM Testing 2009
G.652
Balanced G.655
Trang 39© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 39
Requirements:
„Big box” – multichassis OC-768
QoS Multicast IPv6
nx10GigE, not same as 40G
Trang 40© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 40
Trang 41© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential
40GE and 100GE
Trang 42© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 42
Standard Update
Trang 43© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 43
High Speed Ethernet Standard Interfaces
Trang 44© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 44
High Speed Ethernet – Not To Exceed Pricing Estimated Not to Exceed List Prices (Industry-wide)
Trang 45Cisco Confidential 45
© 2010 Cisco and/or its affiliates All rights reserved
Historical Adoption of High Speed Ethernet
Trang 4670 pins
4x3.125G
E-interface:
70 pins 4x3.125G
30 pins 1x10G
20 pins 1x10G
E-interface:
148 pins 4x10G (XLAUI) 10x10G (CAUI)
38 pins 4x10G
High-Speed Transceivers Form Factors
Trang 47© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 47
High-Speed Ethernet Transceiver Landscape
Applications:
Single Mode Fiber 10-40+Km
Multimode Parallel Fiber
Trang 48© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 48
CFP features a new concept known as the riding
heat sink, in which the heat sink is attached to
rails on the host card and “rides” on top of the
CFP, which is flat topped
High-Speed Ethernet Transceiver Landscape
CXP was created to satisfy the high-density requirements of the data center, targeting parallel interconnections for 12x QDR InfiniBand (120 Gbps),
100 GbE, and proprietary links between systems collocated in the same facility The InfiniBand Trade Association is currently standardizing the CXP.
100GbE CFP requires
“Riding HeatSink” SMF optimized 100GbE CXP MMF/Twinax optimized
Trang 49© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 49
1x 100GBE
Line-rate performance (100Gbps)
CFP optics (LR4)
FP-140 – Core & Peering @ 140 Gbps
8 queues per port, ACL, Netflow
MSC-140 – High-speed edge @ 140Gbps
HQoS, 64,000 queues, 12,000 interfaces
Interface Module
Forwarding Processor
Trang 50© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 50
CRS 400G per slot
ASR9000 80G per slot
ASR9000 200G per slot
100GE 100GE OTU4
40GE OTU3e 10GE OTU2e
10GE
OTU2e
STM-256 OTU3
10GE
STM-256
100GE/40GE OTU
7600 ES+
40G per slot
Trang 51© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 51
80Gbps/60Mpps, CFP transceivers 16x 10GE version also available
240Gbps/120Mpps, QSFP transceivers (focused on DC distances)
200Gbps/120Mpps, CFP transceivers (focused on wide-area distances)
Target FCS CY11
Data Center
Trang 52© 2010 Cisco and/or its affiliates All rights reserved Cisco Confidential 52
• Increase distances utilizing Cisco Advanced FEC
• Advanced signal processing to address:
CD Compensation PMD Mitigation Single Channel Non-linear impairment mitigation
• To be implemented on both router interfaces and transport NEs
4 x 50G ADC
Signal Processing
PIN PIN PIN PIN
In-phase Quadrature