Mellanox Technologies MHEH28-XSC Manuale utente

Mellanox Technologies

ConnectX®IB Dual Port InfiniBand Adapter

Card User’s Manual

P/N: MHEH28-XSC, MHEH28-XTC, MHGH28-XSC, MHGH28-XTC,

MHGH29-XSC, MHGH29-XTC, MHJH29-XSC, MHJH29-XTC

Rev 1.2

Rev 1.2 Mellanox Technologies

Mellanox Technologies, InfiniHost®, and ConnectX®are registered trademarks for Mellanox Technologies, Inc.

All other marks and names mentioned herein may be trademarks of their respective companies.

ConnectX IB Dual Port InfiniBand ®

Document Number: 2802

Mellanox Technologies, Inc.

2900 Stender Way

Santa Clara, CA 95054

U.S.A.

www.mellanox.com

Tel: (408) 970-3400

Fax: (408) 970-3403

Mellanox Technologies Ltd.

PO Box 586 Hermon Building

Yokneam 20692

Israel

Tel: +972-4-909-7200

Fax: +972-4-959-3245

ConnectX IB Dual Port InfiniBand Adapter Cards With PCI Express x8 User’s Manual 3

Rev 1.2

Mellanox Technologies

Table of Contents

Table of Contents 3

List of Tables 4

List of Figures 5

Revision History 6

About this Manual 7

Chapter 1 Overview 8

1.1 Adapter Cards 8

1.2 Mellanox Part Numbering Legend 9

1.3 Finding the GUID and Serial Number on the Adapter Cards 10

Chapter 2 HCACard Installation 11

2.1 Hardware and Software Requirements 11

2.2 Installation Instructions 11

Chapter 3 DriverSoftwareand Firmware 13

3.1 Driver Software 13

3.2 Updating HCA Card Firmware 13

3.3 Single HCA Card Firmware Update 13

3.4 HCA Card Firmware Update as Part of a Cluster Firmware Update 13

Chapter 4 AdapterCardInterfaces 14

4.1 I/O Interfaces 14

4.2 I2C Compatible Interface 15

4.3 Power 15

4.4 Memory 16

4.5 VPDs 16

AppendixA Specifications 26

A.1 Board Mechanical Drawing and Dimensions 26

A.2 EMC Certification Statements 27

A.3 MHEH28-XSC and MHEH28-XTC Specifications 29

A.4 MHGH28-XSC and MHGH28-XTC Specifications 29

A.5 MHGH29-XSC and MHGH29-XTC Specifications 30

A.6 MHJH29-XSC and MHJH29-XTC Specifications 32

AppendixB Interface Connectors Pinout 33

B.1 I2C-Compatible Connector Pinout 33

B.2 InfiniBand Connector Pinout 33

B.3 PCI Express x8 Connector Pinout 34

AppendixC Replacing a Tall Bracket With a Short Bracket on HCA Cards 35

C.1 Removing Tall Bracket 35

C.2 Placing a Kapton® Polyimide Label 37

C.3 Assembling Short Bracket 38

AppendixD Avertissements de sécurité d’installation 41

Rev 1.2 Mellanox Technologies

List of Tables

Table 1: Revision History Table 6

Table 2: Documents List 7

Table 3: HCA Cards 8

Table 4: Mellanox HCA Cards Part Numbering Key 9

Table 5: Hardware and Software Requirements 11

Table 6: LEDs 15

Table 7: Jumper Configuration 16

Table 8: VPD Layout for MHEH28-XSC 17

Table 9: VPD Layout for MHEH28-XTC 18

Table 10: VPD Layout for MHGH28-XSC 19

Table 11: VPD Layout for MHGH28-XTC 20

Table 12: VPD Layout for MHGH29-XSC 21

Table 13: VPD Layout for MHGH29-XTC 22

Table 14: VPD Layout for MHJH29-XSC 23

Table 15: VPD Layout for MHJH29-XTC 24

Table 16: HCA Cards Certification Status 27

Table 17: Specifications for MHEH28-XSC/-XTC 29

Table 18: Specifications for MHGH28-XSC/-XTC 29

Table 19: Specifications for MHGH29-XSC/-XTC 30

Table 20: Specifications for MHJH29-XSC/-XTC 32

Table 21: I2C-compatible Connector Pinout 33

Table 22: Connector Pin Name and Number to Signal Name Correspondence 34

ConnectX IB Dual Port InfiniBand Adapter Cards With PCI Express x8 User’s Manual 5

Rev 1.2

Mellanox Technologies

List of Figures

Figure 1: HCA Card 8

Figure 2: Port Numbering 14

Figure 3: Physical and Logical Link Indications 15

Figure 4: I2C Connector 15

Figure 5: Flash Jumper 16

Figure 6: Schematic of the ConnectX IB HCA Card with CX4 Connectors 26

Figure 7: I2C-Compatible Connector Plug and Pinout 33

Figure 8: InfiniBand CX4 Connector Pinout 33

Figure 9: Tall Bracket of a Dual IB Port HCA Card 35

Figure 10: Connector Retention Clip 35

Figure 11: Extracting Connector Clip 36

Figure 12: Bracket Screws 36

Figure 13: Rotate the Bracket to Detach it From the Card 37

Figure 14: Hold Kapton Label With Pincers 37

Figure 15: Place Label on Print Side With Label’s and Card’s Holes Aligned 38

Figure 16: Ensure That Label is Well-attached 38

Figure 17: Place Short Bracket onto Card 39

Figure 18: Attach Bracket onto Card using Screws 39

Figure 19: Sliding Connector Clip Evenly 40

Figure 20: Assembled Short Bracket 40

Figure 21: Print Side View After Short Bracket Assembly With Kapton Label 40

Rev 1.2 Mellanox Technologies

Revision History

This document was printed on August 6, 2008 10:52 am.

Table 1 - Revision History Table

Date Rev Comments/Changes

August 2008 1.2 Removed watermark

May 2008 0.31 Added CTUVUS and CB report status to Cert Table in Appendix A.

April 2008 0.30 Preliminary release User’s Manual for ConnectX IB Adapter Cards

Added C-tick a nd Mic for relevant cards

Changed OFED link to Mellanox OFED

Removed Confidential

ConnectX IB Dual Port InfiniBand Adapter Cards With PCI Express x8 User’s Manual 7

Rev 1.2

Mellanox Technologies

About this Manual

This User’s Manual describes Mellanox Technologies ConnectX IB PCI Express x8 HCA Adapter cards. It provides

details as to the interfaces of the board, specifications, required software and firmware for operating the board, and

relevant documentation.

Intended Audience

This manual is intended for the installer and user of these cards.

The manual assumes basic familiarity with Infiniband™ networks and architecture specifications.

Related Documentation

Table 2 - Documents List

Online Resources

• Mellanox Technologies Web pages: http://www.mellanox.com

• Mellanox Technologies Firmware download Web page: http://www.mellanox.com/ under Firmware downloads

• Mellanox Technologies Document Distribution System (DDS): http://docs.mellanox.com (requires a customer

Document Conventions

When discussing memory sizes, MB and MBytes are used in this document to mean size in mega bytes. The use of

Mb or Mbits (small b) indicates size in mega bits.

Mellanox Firmware Tools (MFT) User’s Manual

Document no. 2204UG User’s Manual describing the set of MFT firmware management tools

for a single InfiniBand node. See http://www.mellanox.com under

‘Firmware’ downloads.

Mellanox MST User’s Manual

Document no. 2125SM This manual describes various tools and utilities, included in the Mel-

lanox Software Tools (MST) package, for accessing, burning firmware,

and tracing Mellanox silicon devices.

InfiniBand Administration (IBADM) Package User’s Manual

Document no. 2130UM User’s Manual describing the utilities included in the IBADM tools

package for system administration of an InfiniBand cluster. See

http://www.mellanox.com under ‘Management Tools’.

IB Specifications Release 1.0.a Infiniband Architecture Specifications

PCI Express 2.0 Specifications Industry Standard PCI Express 2.0 Card Electromechanical Specifica-

tion, Rev 1.3.

Overview

Rev 1.2 Mellanox Technologies

1 Overview

This document is a User’s Manual for Mellanox Technologies host channel adapter (HCA) Cards based on the

MT25408 ConnectX®IB integrated circuit device. The cards described in this manual have the following main fea-

tures:

• IBTA v1.2 compliant

• Two 4X InfiniBand CX4 copper ports for connecting InfiniBand traffic (4X IB connectors)

• PCI Express 2.0 (1.1 compatible) through an x8 edge connector up to 5GT/s

• ‘Media detect circuit’ with powered connectors supporting the use of active cables and external PHY fiber solu-

tions

• EU Restriction of Hazardous Substances (RoHS) compliant

• SDR/DDR/QDR: IB10Gb/s (SDR) or 20Gb/s (DDR) or 40Gb/s (DDR)

• Two bracket heights: short or tall

1.1 Adapter Cards

• Table 3 lists the InfiniBand HCA cards described in this manual.

Table 3 - HCA Cards

Ordering Part

Number (OPN)

PCI

Express

SERDES

Speed

IBSDR

/ DDR

Short /

Tall

Bracket

RoHS

Complian

HCA IC

Part Number HCA Card Photo (1)

1. The HCA cards have a similar form and fit. The main visible difference is in the bracket height.

MHEH28-XSC 2.5 GT/s SDR Short RoHS-R5

(with

exemp-

tion)

MT25408A0-FCC-

MHEH28-XTC 2.5 GT/s Tall

MHGH28-XSC 2.5 GT/s DDR Short RoHS-R5

(with

exemp-

tion)

MT25408A0-FCC-

MHGH28-XTC 2.5 GT/s Tall

MHGH29-XSC 5.0 GT/s DDR Tall RoHS-R5

(with

exemp-

tion)

MT25408A0-FCC-

MHGH29-XSC 5.0 GT/s Tall

MHJH29-XSC 5.0 GT/s QDR Tall RoHS-R5

(with

exemp-

tion)

MT25408A0-FCC-

MHJH29-XTC 5.0 GT/s Tall

Tall

Bracket

(-XTC)

Short

Bracket

(-XSC)

Figure 1: HCA Card

ConnectX IB Dual Port InfiniBand Adapter Cards With PCI Express x8 User’s Manual 9

Rev 1.2

Mellanox Technologies

1.2 Mellanox Part Numbering Legend

Table 4 describes the Mellanox Technologies adapter cards part numbering legend.

For example, the part number MHGH28-XSC describes Mellanox Technologies’ ConnectX™ IB HCA card with

dual CX4 ports, a PCIe2.0 x8 2.5GT/s interface, no on-board memory (mem-free), a short PCI bracket, and RoHS R5

compliance. Using the legend,

• field M = M to indicate a Mellanox Technologies product,

• field H = H to indicate an InfiniBand Adapter Card,

• field T = G to indicate CX4 DDR,

• field S = H to indicate the ConnectX family,

• field # = 2 to indicate two ports,

• field I = 8 to indicate PCI Express 2.0 x8 running at 2.5GT/s,

• field X = X to indicate no on-board memory,

• field B = S to indicate a short bracket, and

• field R = C to indicate RoHS R5 (w/ Exemptions) compliance

Table 4 - Mellanox HCA Cards Part Numbering Key

HCA Card OPN

MHTS#I-XBR Field Decoder

M Mellanox

Technologies

H Adapter Type H = InfiniBand Host Channel Adapter, N = Ethernet Network Interface Card, S = Express Module

T Media E=CX4 SDR, G=CX4 DDR, J=CX4 QDR, K=XFP SR, M=SFP+ SR, N=SFP+ LRM, O=SFP+

LR, Q=QSFP QDR, R=QSFP DDR, T=UTP

S Silicon H = ConnectX, S = InfiniHost III Lx®, T= InfiniHost®, A= InfiniHost®III Ex

# # ports 1 = 1, 2 = 2,

I Host Interface X = PCI-X, 4 = PCIe x4, 8 = PCIe x8, 9 = PCIe (SerDes @ 5.0 GT/s)

G Generation <blank> = Initial product generation

- Separator

X Memory Size X = MemFree, 1=128MB, 2=256MB, 3=512MB

B Bracket S = Short, T = Tall, N = None

R RoHS <blank> = non RoHS, C = RoHS w/ Exemption, R = RoHS Lead-Free

Overview

Rev 1.2 Mellanox Technologies

1.3 Finding the GUID and Serial Number on the Adapter Cards

All mellanox HCA adapter cards have a label on the printed side of the adapter card that has the card serial number

and the card GUID.

Questo manuale è adatto per i seguenti modelli

Indice

Altri manuali Mellanox Technologies Adattatore

Mellanox Technologies

Mellanox Technologies Innova IPsec 4 Lx Manuale utente

Mellanox Technologies

Mellanox Technologies MCX313A-BCBT? MCX314A-BCBT Manuale utente

Mellanox Technologies

Mellanox Technologies ConnectX-3 Pro Manuale utente

Mellanox Technologies

Mellanox Technologies ConnectX MHRH19-XTC Manuale utente

Mellanox Technologies

Mellanox Technologies MHRH29B-XTR Manuale utente

Mellanox Technologies

Mellanox Technologies MCX4421A-XCQN Manuale utente

Mellanox Technologies

Mellanox Technologies MCX312B-XCCT ConnectX-3 Pro Manuale utente

Mellanox Technologies

Mellanox Technologies ConnectX-4 Lx Manuale utente

Mellanox Technologies

Mellanox Technologies MCX515A-CCAT Manuale utente

Mellanox Technologies

Mellanox Technologies ConnectX-3 Pro Manuale utente

Mellanox Technologies

Mellanox Technologies Innova IPsec Manuale utente

Mellanox Technologies

Mellanox Technologies ConnectX-3 Pro Manuale utente

Manuali Adattatore popolari di altre marche

PCB Piezotronics

PCB Piezotronics 090B274 Manuale utente

Auvidea

Auvidea J20 Manuale del prodotto

Gossen MetraWatt

Gossen MetraWatt AT3-III E Manuale utente

Akribis

Akribis ITF-21-BISS-MIT Manuale utente

Tenda

Tenda W54U Manuale utente

ROHO

ROHO AGILITY Manuale utente

PROLiNK

PROLiNK WN2001 Manuale utente

Hawking

Hawking HUF2 Manuale utente

Airlink101

Airlink101 AWLC4030 Manuale utente

NETGEAR

NETGEAR XAV101v1 - Powerline AV Ethernet Adapter Manuale utente

Philips

Philips SWA4554S/10 Manuale utente

JVC

JVC TS-C9D2B Manuale di istruzioni

NETGEAR

NETGEAR A6100 Manuale utente

D-Link

D-Link DWA-121 Manuale utente

Philips

Philips SWA2037 Manuale utente

Basalte

Basalte 0610-20 Manuale utente

Yealink

Yealink EHS40 Manuale utente

Balluff

Balluff BIC 1B0-IT1A7-Q40KFU-SM4A4A Manuale utente