Oracle Sun Datacenter InfiniBand Switch 648 Manuale utente
Sun Datacenter InfiniBand
Switch 648
Installation Guide
Part No. 820-7738-12
May 2010, Revision A
Copyright © 2009, 2010 Oracle and/or its affiliates. All rights reserved.
This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by
intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate,
broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means. Reverse engineering,
disassembly, or decompilation of this software, unless required by law for interoperability, is prohibited.
The information contained herein is subject to change without notice and is not warranted to be error-free. If you find any errors, please report them to us
in writing.
If this is software or related software documentation that is delivered to the U.S. Government or anyone licensing it on behalf of the U.S. Government, the
following notice is applicable:
U.S. GOVERNMENT RIGHTS Programs, software, databases, and related documentation and technical data delivered to U.S. Government customers are
"commercial computer software" or "commercial technical data" pursuant to the applicable Federal Acquisition Regulation and agency-specific
supplemental regulations. As such, the use, duplication, disclosure, modification, and adaptation shall be subject to the restrictions and license terms set
forth in the applicable Government contract, and, to the extent applicable by the terms of the Government contract, the additional rights set forth in FAR
52.227-19, Commercial Computer Software License (December 2007). Oracle America, Inc., 500 Oracle Parkway, Redwood City, CA 94065.
This software or hardware is developed for general use in a variety of information management applications. It is not developed or intended for use in any
inherently dangerous applications, including applications which may create a risk of personal injury. If you use this software or hardware in dangerous
applications, then you shall be responsible to take all appropriate fail-safe, backup, redundancy, and other measures to ensure its safe use. Oracle
Corporation and its affiliates disclaim any liability for any damages caused by use of this software or hardware in dangerous applications.
Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners.
AMD, Opteron, the AMD logo, and the AMD Opteron logo are trademarks or registered trademarks of Advanced Micro Devices. Intel and Intel Xeon are
trademarks or registered trademarks of Intel Corporation. All SPARC trademarks are used under license and are trademarks or registered trademarks of
SPARC International, Inc. UNIX is a registered trademark licensed through X/Open Company, Ltd.
This software or hardware and documentation may provide access to or information on content, products, and services from third parties. Oracle
Corporation and its affiliates are not responsible for and expressly disclaim all warranties of any kind with respect to third-party content, products, and
services. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party
content, products, or services.
Copyright © 2009, 2010, Oracle et/ou ses affiliés. Tous droits réservés.
Ce logiciel et la documentation qui l’accompagne sont protégés par les lois sur la propriété intellectuelle. Ils sont concédés sous licence et soumis à des
restrictions d’utilisation et de divulgation. Sauf disposition de votre contrat de licence ou de la loi, vous ne pouvez pas copier, reproduire, traduire,
diffuser, modifier, breveter, transmettre, distribuer, exposer, exécuter, publier ou afficher le logiciel, même partiellement, sous quelque forme et par
quelque procédé que ce soit. Par ailleurs, il est interdit de procéder à toute ingénierie inverse du logiciel, de le désassembler ou de le décompiler, excepté à
des fins d’interopérabilité avec des logiciels tiers ou tel que prescrit par la loi.
Les informations fournies dans ce document sont susceptibles de modification sans préavis. Par ailleurs, Oracle Corporation ne garantit pas qu’elles
soient exemptes d’erreurs et vous invite, le cas échéant, à lui en faire part par écrit.
Si ce logiciel, ou la documentation qui l’accompagne, est concédé sous licence au Gouvernement des Etats-Unis, ou à toute entité qui délivre la licencede
ce logiciel ou l’utilise pour le compte du Gouvernement des Etats-Unis, la notice suivante s’applique :
U.S. GOVERNMENT RIGHTS. Programs, software, databases, and related documentation and technical data delivered to U.S. Government customers
are "commercial computer software" or "commercial technical data" pursuant to the applicable Federal Acquisition Regulation and agency-specific
supplemental regulations. As such, the use, duplication, disclosure, modification, and adaptation shall be subject to the restrictions and license terms set
forth in the applicable Government contract, and, to the extent applicable by the terms of the Government contract, the additional rights set forth in FAR
52.227-19, Commercial Computer Software License (December 2007). Oracle America, Inc., 500 Oracle Parkway, Redwood City, CA 94065.
Ce logiciel ou matériel a été développé pour un usage général dans le cadre d’applications de gestion des informations. Ce logiciel ou matériel n’est pas
conçu ni n’est destiné à être utilisé dans des applications à risque, notamment dans des applications pouvant causer des dommages corporels. Si vous
utilisez ce logiciel ou matériel dans le cadre d’applications dangereuses, il est de votre responsabilité de prendre toutes les mesures de secours, de
sauvegarde, de redondance et autres mesures nécessaires à son utilisation dans des conditions optimales de sécurité. Oracle Corporation et ses affiliés
déclinent toute responsabilité quant aux dommages causés par l’utilisation de ce logiciel ou matériel pour ce type d’applications.
Oracle et Java sont des marques déposées d’Oracle Corporation et/ou de ses affiliés.Tout autre nom mentionné peut correspondre à des marques
appartenant à d’autres propriétaires qu’Oracle.
AMD, Opteron, le logo AMD et le logo AMD Opteron sont des marques ou des marques déposées d’Advanced Micro Devices. Intel et Intel Xeon sont des
marques ou des marques déposées d’Intel Corporation. Toutes les marques SPARC sont utilisées sous licence et sont des marques ou des marques
déposées de SPARC International, Inc. UNIX est une marque déposée concédée sous licence par X/Open Company, Ltd.
Ce logiciel ou matériel et la documentation qui l’accompagne peuvent fournir des informations ou des liens donnant accès à des contenus, des produits et
des services émanant de tiers. Oracle Corporation et ses affiliés déclinent toute responsabilité ou garantie expresse quant aux contenus, produits ou
services émanant de tiers. En aucun cas, Oracle Corporation et ses affiliés ne sauraient être tenus pour responsables des pertes subies, des coûts
occasionnés ou des dommages causés par l’accès à des contenus, produits ou services tiers, ou à leur utilisation.
iii
Contents
Using This Documentation ix
Preparing the Site 1
Understanding Switch Specifications 1
Physical Specifications 2
Environmental Requirements 3
Acoustic Noise Emissions 3
Electrical Specifications 3
Network Management Connector and Pins 4
Serial Management Connector and Pins 5
CXP Connector and Pins 5
Routing Service Cables 7
Power Cord Requirements 8
Management Cable Requirements 9
Understanding InfiniBand Cabling 9
InfiniBand Cable Cautions 10
InfiniBand Cable Guidelines 11
InfiniBand Cable Types 12
InfiniBand Cable Path Lengths 12
InfiniBand Cable Bundling 13
Floor and Underfloor Delivery of InfiniBand Cables 14
Overhead Delivery of InfiniBand Cables 14
iv Sun Datacenter InfiniBand Switch 648 Installation Guide • May 2010
Installing the Switch 15
Understanding the Installation 15
Supported Configurations 16
Fabric Card Distribution 17
Fabric Card Handling Guidelines 17
Line Card Distribution 17
Line Card Handling Guidelines 18
Fabric Card and Line Card Fillers 18
Installation Preparation 19
Suggested Tools for Installation 19
Antistatic Precautions for Installation 20
Installation Responsibilities 20
Installation Sequence 20
Installing the InfiniBand Software Stack 23
▼Install the HPC Software Suite 23
Unpacking the Chassis 25
▼Remove the Shipping Carton Contents 25
▼Unsecure the Chassis From the Pallet 28
Preparing the Chassis 29
▼Install the Rail Assemblies in the Rack 29
▼Install the Cable Trees 32
▼Install the Cable Curves 38
▼Install the Chassis in the Rack 39
Inspecting the Components 45
Inspecting the Midplane for Installation 45
▼Identify the Midplane Fabric Card Connectors 46
▼Inspect the Pins on the Rear Side of the Midplane 47
▼Identify the Midplane Line Card Connectors 48
Contents v
▼Inspect the Pins on the Front Side of the Midplane 50
Inspecting the Fabric Cards for Installation 51
▼Identify the Fabric Cards for Installation 52
▼Inspect the Fabric Card Chassis for Installation 53
▼Inspect the Fabric Card Retainer Bolts for Installation 53
▼Inspect the Fans for Installation 54
▼Inspect the Fabric Card XBOW Connectors for Installation 54
Inspecting the Line Cards for Installation 55
▼Identify the Line Cards for Installation 56
▼Inspect the Line Card Chassis for Installation 58
▼Inspect the Line Card Retainer Bolts for Installation 58
▼Inspect the Line Card XBOW Connectors for Installation 59
▼Inspect the Line Card CXP Connectors for Installation 60
Inspecting the InfiniBand Cables for Installation 61
▼Identify the InfiniBand Cable for Installation 61
▼Inspect the InfiniBand Cable Hardware for Installation 62
▼Inspect the InfiniBand Cable Connectors for Installation 63
Installing the Components 63
▼Install the Midplane Stiffener 64
▼Install the Fabric Cards or Fabric Card Fillers 67
▼Remove the Midplane Stiffener 70
▼Install the Line Cards or Line Card Fillers 72
Powering On the CMCs 75
▼Attach the Management Cables 76
▼Attach the Power Cords 78
▼Check the Power Supply Status LEDs 80
▼Check the CMC Status LEDs 80
Accessing the CMC 81
vi Sun Datacenter InfiniBand Switch 648 Installation Guide • May 2010
▼Access the CMC From the Serial Management Port 82
▼Set the Initial UBoot Parameters 83
▼Access the CMC From the Network Management Port 84
▼Verify the CMC Status 86
▼Identify the CMC Addresses 87
▼Display the CMC FRU ID Information 88
▼Verify the Power Supply Status 89
▼Identify the Power Supply Addresses 90
▼Display the Power Supply FRU ID Information 91
Powering On the Fabric Cards 92
▼Enable the Fabric Cards for Installation 93
▼Create the guid.txt File for Installation 93
▼Power On the Fabric Cards for Installation 96
▼Check the Fabric Card Status LEDs 96
▼Verify the Fabric Card Status 97
▼Identify the Fabric Card Addresses 99
▼Display the Fabric Card FRU ID Information 100
Powering On the Line Cards 101
▼Enable the Line Cards for Installation 102
▼Power On the Line Cards for Installation 103
▼Check the Line Card Status LEDs 103
▼Verify the Line Card Status 104
▼Identify the Line Card Addresses 106
▼Display the Line Card FRU ID Information 107
Connecting InfiniBand Cables 108
▼Attach Cables to the CXP Connectors 109
▼Check the CXP Connector Status LEDs 115
▼Check Link Status 116
viii Sun Datacenter InfiniBand Switch 648 Installation Guide • May 2010
ix
Using This Documentation
This installation guide provides detailed procedures that describe the preparation
and installation of the Sun Datacenter InfiniBand Switch 648 from Oracle®. This
document is written for technicians, system administrators, authorized service
providers, and users who have advanced experience installing computing hardware.
■“Related Documentation” on page ix
■“Documentation, Support, and Training” on page x
■“Documentation Feedback” on page x
Related Documentation
The documents listed as online are available at:
(http://docs.sun.com/app/docs/prod/ib.switch.648)
Application Title Part Number Format Location
Getting started Sun Datacenter InfiniBand Switch 648 Getting Started
Guide
820-7745 Printed
PDF
Shipping
kit
Online
Last-minute
information
Sun Datacenter InfiniBand Switch 648 Product Notes 820-7743 PDF Online
Preparation and
installation
Sun Datacenter InfiniBand Switch 648 Installation
Guide
820-7738 PDF
HTML
Online
Administration Sun Datacenter InfiniBand Switch 648 Administration
Guide
820-7739 PDF
HTML
Online
Service Sun Datacenter InfiniBand Switch 648 Service Manual 820-7740 PDF
HTML
Online
xSun Datacenter InfiniBand Switch 648 Installation Guide • May 2010
Documentation, Support, and Training
These web sites provide additional resources:
■Documentation (http://docs.sun.com)
■Support (http://www.sun.com/support)
■Training (http://www.sun.com/training)
Documentation Feedback
Submit comments about this document by clicking the Feedback[+] link at
(http://docs.sun.com). Include the title and part number of your document
with your feedback:
Sun Datacenter InfiniBand Switch 648 Installation Guide, part number 820-7738-12.
Command
reference
Sun Datacenter InfiniBand Switch 648 Command
Reference
820-7741 PDF
HTML
Online
Compliance Sun Datacenter InfiniBand Switch 648 Safety and
Compliance Guide
820-7744 PDF Online
ILOM information Oracle Integrated Lights Out Manager (ILOM) 3.0
Supplement for the Sun Datacenter InfiniBand Switch
648
821-0896 PDF
HTML
Online
Application Title Part Number Format Location
Altri manuali per Sun Datacenter InfiniBand Switch 648
1
Indice
Altri manuali Oracle Interruttore
Oracle
Oracle ES1-24 Manuale di servizio
Oracle
Oracle InfiniBand Switch IS2-46 Manuale utente
Oracle
Oracle InfiniBand Switch IS2-46 Manuale utente
Oracle
Oracle Sun Network QDR InfiniBand Gateway Switch Manuale utente
Oracle
Oracle Fabric Interconnect F2-12 Manuale utente
Oracle
Oracle Sun Datacenter InfiniBand Switch 648 Manuale utente
