Tài liệu Cisco IT@Work Data Center Infrastructure doc

Cisco IT@Work, Internet Business Solutions and Results Presentation_ID © 2005 Cisco Systems, Inc.. Cisco IT Total Cost Avoidance of $225M* Storage Pooling and Compute Standardization

Cisco IT@Work, Internet Business

Solutions and Results

Presentation_ID © 2005 Cisco Systems, Inc All rights reserved.

“Network infrastructure is directly tied to the ability to gain competitive advantage in the

marketplace, today and in the future.”

There's no higher-profile embodiment of Cisco's architecture-to-business-solutions message than

Cisco itself The company is a rabid consumer and

integrator of its own wireless, IP telephony,

switching, routing, and security dog food

Network Computing: Cisco:

On Its Feet and On the Prowl

Session Number

Presentation_ID © 2005 Cisco Systems, Inc All rights reserved

Using Advanced Technology to

Enhance Business

ly

VIRTUAL CAMPUS

How Big is Cisco?

Technology and People

Cisco Runs Its Business

The Cisco Network Infrastructure

Versatility Functionality

)

| |

Í i 1}

-

Ease of Operation

Performance Cost of Ownership Security Sr ee

Shifting the Viewpoint

¢ Access worid as OUr | In the office

" Security kK campus On the road

Cisco IT Total Cost Avoidance of $225M*

Storage Pooling and Compute Standardization

Federated Infrastructure Model; “Logical” Cisco

Disparate Islands for Each ee Business Functions Application/Business Function

“Source: James Cooke, Internet Business Solutions Group, Cisco Systems

Consolidated Data Center Infrastructure

¢ Tiered levels of service

¢ Laid foundation for future service oriented Futu re EV architecture model

© 2004 Cisco Systems, Inc All rights reserved 11

How Thought Leaders Are Capturing Value

Coordinate Investments

a) _ 2 ”

a ae => ¿ Business Internet Business

Processes Applications

Net Impact:

Kệ ‹ Over Peers Using

Measurement and Metrics Just Applications

Cisco Internet Business Solutions

FY”04 Results: $2.2 Billion

Cisco Internet Business Solutions Results

Cisco’s Data Center Best Practice

Session Number Presentation_ID © 2005 Cisco Systems, Inc All rights reserved

Information Technology (IT)

Develops, maintains and supports telecommunications, networks,

business applications, Internet and Intranet applications, desktops, servers and infrastructure

Supports all business unit and group functions within Cisco

Supports portions of external groups such as Cisco Partners,

select vendors and customers

DCIT interfaces between IT and Facilities (WPR) for Data Center

maintenance and construction

Cisco’s Data Centers

¢ World-class facilities that safeguard

Cisco’s intellectual property

¢ 46 Data Centers and Server Rooms

¢ 125,000+ sq ft /11,600+ sq m

¢ 11 countries, 10 time zones

¢ Production Data Centers (PDCs) house business-critical systems

¢ Development Data Centers (DDCs) house engineering development

Data Center Features

Restricted physical access

Data Center Management

1996-1997

¢ PDCs and DDCs supported by separate teams

¢ No formal support of non-San Jose DCs

¢ New DCs designed by outside vendor

1998-2001

¢ DCIT responsible for DDC design and management worldwide

¢ Standardization introduced into DDCs

¢ PDCs still managed by a separate group

2002-2003

¢ DCIT designs, supports and manages all DCs

¢ DCIT members in CA, MA, NC and TX

- “One Data Center” model created

Old Cabling Design

Direct-connect cabling

All network devices in

DDC Cabling Design

¢ Network substation at

¢ Structured cabling to all

server cabinet locations

¢ Risk of downtime reduced

¢ Shorter cable runs save $$

Session Number

Presentation_ID © 2005 Cisco Systems, Inc All rights reserved

Data Center Design Elements

¢ Standardized components

¢ Pre-wired power and data

¢ Color-coded infrastructure

¢ Common supplies and signage

¢ Consistent look and feel

¢ Segmented and scalable

¢ Simplified equipment moves

¢ Scalable for upgrades

¢ Less $$ than one-off installations

Simplifies maintenance

Data Center Design

Infrastructure is tiered by type of Data Center

Production Data Center

Monitored by Operations

Command Center

Monitored by Operations Command Center

Monitored by Operations Command Center

Raised floor environment Raised floor environment Overhead infrastructure

UPS backup [N+1] UPS backup [N] UPS backup [N]

Generator backup [N+1] Generator backup [N]

24/7 Cooling via house air or

HVAC units outside room [N]

(4) Circuits per cabinet location,

fed by 2 PDUs

(4) Circuits per cabinet location,

fed by 2 PDUs (2) Circuits per cabinet location,

fed by 1 PDU

Session Number

Presentation_ID © 2005 Cisco Systems, Inc All rights reserved

Online Tools — Building Automation System

1 Chiller Plant

2 Standby Electrical

3 HVAC Floor Plan

1 in Unit Detail

Online Tools — DCIT Web Site

The toting mottos eet ferntetre yee eth (000) xgec đe ¬svdrre*f, knec«se t4 v5 sseey

mm &Äew |@) tp (6e ero cóc cơn/Vng/ CD Đi g2arte 2] bè inte”

Sand ards of Oper stews

Xi tán: lý se wher œ a Date Canter, at «fy

Welcome to the ones 960029402 (ý mformaten stot 1 Data Centers the

wpeciahzed ererarnerts that house fe ' company) mỤ i production end Ge eee - = I8 *j

servers eam thal sepporte them Thee ete contarre a wealth

> oo — fern te oe

eet 23992 Ont woe Som OB AT

bom der “yh Daseperts 10 server itl atlation pc Óeee4 ty rermnele mand

ÃôỒ PA Cutten ater `

The Cate Comers wee ae tạ (144 ph 14 #Í 4/0191 : 'eg/ed WW

Management precens - #9 3(9 (#12(6fy 6@©4906đ lý túth (hé O0 0X | ( Greece's Oats Conners & Serve: Recess erter and the Date Center intrestructus Tear

has reve theo ALD) Dete Coters and Dera 5 *.0292990019094 mews hee 127000 06 6 (11 15D ged Thene d9 tớ se nss4 se (11 trdepercderd power ant dala connecteddy are preweted ty eerver Cabrel wees os eon canes Eras send cach & Goce mas 6 Solty tule

Gelibuted threegton the Data Comtore Thue provides reduedenty, of

twa como ovo On TY N orm box (0 [ser bere 1 1

tê 0781/1207 00) cao ) ED [Ha (AONE)

00 Dphes Date Cortere ated Servet Rocene are eeppoted and in ears Sater Nee 3s i1t Seg 0) = Acueries Cổ + Date C s94£' lha4092c%gs Team, s44 “v66 ae located 0ì C đọ (eo Aaa uceag: Exes =P Reuse) Cites Gao 12

Mossarteeetts, Neth Cawine wd Terat Mite tmiis EES eee ie ee LT Sate 5G

2) Sar Quay UP? Recess am = Seed

; a Đáp %›é¿o ĐDAGONGE ÊmawetCC<| !!taerilte “tt Pun) 2062)” Weennins | @bamtrekcoe | BS =1 net | = hee KT _—— cheree LOCC T) Blents 2m: ¿a4 ý

Temperature Sensor Network

Data Center Temperature Challenges

¢ Proliferation of high-density servers

¢ HVAC sensors at the unit, not where servers live

¢ Sensors within servers are limited

° Sensors installed atop cabinets

Connected to pre-existing console network All sensors are polled in an hourly sweep

Results sent via e-mail

First sensor online in 2000

261 now In network

© 2005 Cisco Systems, Inc All rights reserved.

Build Room

¢ Build room provides an area for equipment vendors to rack,

stack, configure, and burn in new systems before they go into

production and try new equipment and configurations

¢ Cabling and network architecture in the Build room is

designed to flexibly support quick equipment changes

¢ Network cabinet in every half row of each of four rows makes

connecting and reconnecting new equipment and moving equipment much easier by not having to pull new cable the length of the room

© 2005 Cisco Systems, Inc All rights reserved.

Data Center — Vendor Access

¢ Equipment within the data center is largely supported directly

by vendors under contract with Cisco IT

¢ Vendors perform upgrades, changes, and troubleshooting

and repair if a problem arises with equipment

¢ Modems

Many of the storage frames have modem boxes to allow vendors

to remotely monitor their equipment

If a device experiences a problem, it automatically calls the vendor

Vendor can then dial in through the same modem and diagnose the problem

Analog modems will soon be replaced by a VPN solution over the Cisco® IP network and the Internet

© 2005 Cisco Systems, Inc All rights reserved

Data Center Storage

Now, hundreds of hosts are connected to a group of storage frames through a Storage Area Network (SAN), creating a large, efficient pool of shared storage supported by Cisco® MDS 9509 multilayer director switches

San Jose building 12 data center also provides tape storage for

vital records, however, backup storage for San Jose is in the RTP

data center, which acts as a hot standby site

© 2005 Cisco Systems, Inc All rights reserved.

Data Center Servers

¢ Servers

San Jose building 12 data center houses many servers in distributed environments that can be stacked and pooled together

Most run Linux and Windows OSs

Some are large, supporting multiple e-commerce

applications Others are smaller and highly specialized, such as the five Cisco® CallManagers, taking up

a quarter rack, that replaced a PBX in each of the 51 San Jose campus buildings

Data Center — Fire Suppression

- Fire Suppression nots eRe ego

activated in stages within the San Jose building 12 data BR RET eae a

center PHA s reek aoe cop eke oy

Smoke detection by one of many sensors mounted in the Smoke Sensor ceiling throughout the data center sets off an alarm,

which dispatches Cisco® security

Smoke detection by two sensors begins a 30-second countdown FM200 will discharge throughout data center unless a technician in the area presses one of the

designated panels on the wall to suspend the countdown

ÁN &

M "2 ° ˆ + A 4 = ae

Data Center — Earthquake Protection

¢ Earthquake Protection

Seismic isolation platforms in the main San Jose production data center allow equipment to survive an 8.3 earthquake with little or no damage

Platforms contain two parabolic plates with a large ball bearing in between

them

Hosts or frames are fastened to the upper seismic plate with nylon straps, which allows the upper portion of the >

platform to remain relatively stationary | while the lower portion and ground

move side to side in an earthquake

Data Center — Temperature Sensing

¢ Temperature Sensing System

Concerned with temperature at the frame or host, Cisco® placed temperature sensors in many of the racks and frames, distributed in a grid-like pattern

Sensors connect to an IP-based console

network for remote monitoring

Alarm is sent to OCC if temperature at any

sensor exceeds threshold

Sensors have eliminated two or three

temperature-related system problems a year Temperature

Cisco® IT Operations Data Center

¢ The Cisco® IT Operations Data Center on the San Jose,

California campus is one of five Cisco production data centers

worldwide

Supports Cisco’s intranet systems, enterprise resource planning (ERP) systems such as financials, data storage, IP telephony infrastructure, and a multitude of other employee-facing

applications and databases Houses the Operations Command Center (OCC), which monitors

business-critical resources within Cisco data centers worldwide

Occupies 14,269 square feet and consists of four areas:

Cisco OCC

¢ Facilitates problem resolution for significant failures that could

affect business continuity

¢ Tracks and responds to high-priority issues regarding priority-

1 (P1) and priority-2 (P2) systems located in the five production and 41 engineering data centers worldwide

¢ Monitors about 8000 P1 and P2 hosts, including switches,

routers, and servers across all operating systems and

architectures, in addition to 374 P1 applications and 500 P2 applications

¢ San Jose OCC staff monitors network 6 a.m to 6 p.m Pacific

Time

¢ Similar command center within Divyasree data center building

in Bangalore, India, monitors network 6 p.m to 6 a.m Pacific Time

© 2005 Cisco Systems, Inc All rights reserved.

OCC Responsibilities

¢ San Jose building 12 OCC staff provide communication,

coordination, and documentation during incidents involving a

P1 or P2 host or application

¢ Communication — Letting the right business or support

groups know about the existence of a down or degraded resource

¢ Coordination — Getting all duty support responders required

to identify and resolve a problem to talk together to keep the resolution process active

¢ Documentation — Capturing every detail of the incident, from

a short-term fix to a full recovery, in real time

© 2005 Cisco Systems, Inc All rights reserved.

OCC Monitoring

¢ OCC uses the Enterprise Management

(EMAN) monitoring tool to perform Scoot =

alerting, change managementtracking, and “= ˆ — = : availability measurements =—ˆ

° Sends out series of two “pings” every 15

seconds to 10,000+ resources it monitors

24 hours a day

¢ If a resource fails to respond to one of

these, EMAN reports a degraded service

condition

¢ If the resource fails to respond to these

pings four times consecutively, EMAN reports zero percent availability—the

resource is down

¢ Failures associated with P1 and P2

resources are displayed in red on monitors within OCC

Other OCC Responsibilities

¢ EMAN supports change management, which is

tightly integrated with the EMAN alerting process and availability monitoring

¢ OCC monitors all approved change requests within

their window of implementation—approximately 80 each day

¢ OCC team also involved with month-end and

quarter-end data processing, a large set of batch

jobs run to close the monthly financial cycle