Nvidia Mellanox ConnectX-5 Manuale
Hardware Installation
Installation and initialization of ConnectX-5 adapter cards require attention to the mechanical attributes, power specification, and precautions for electronic
equipment.
Safety Warnings
Please observe all safety warnings to avoid injury and prevent damage to system components. Note that not all warnings are relevant to all models.
Note that not all warnings are relevant to all models.
General Installation Instructions
Read all installation instructions before connecting the equipment to the power source.
Jewelry Removal Warning
Before you install or remove equipment that is connected to power lines, remove jewelry such as bracelets, necklaces, rings, watches and
so on. Metal objects heat up when connected to power and ground and can meltdown, causing serious burns and/or welding the metal
object to the terminals.
Over-temperature
This equipment should not be operated in an area with an ambient temperature exceed-ing the maximum recommended: 55°C (131°F). An
airflow of 200LFM at this maximum ambient temperature is required for HCA cards and NICs. To guarantee proper airflow, allow at least
8cm (3 inches) of clearance around the ventila-tion openings.
During Lightning - Electrical Hazard
During periods of lightning activity, do not work on the equipment or connect or dis-connect cables.
Copper Cable Connecting/Disconnecting
Some copper cables are heavy and not flexible, as such they should be carefully attached to or detached from the connectors. Refer to the
cable manufacturer for spe-cial warnings and instructions.
Equipment Installation
This equipment should be installed, replaced, or serviced only by trained and qualified personnel.
Equipment Disposal
Disposal of this equipment should be in accordance to all national laws and regula-tions.
Local and National Electrical Codes
This equipment should be installed in compliance with local and national electrical codes.
Hazardous Radiation Exposure
Caution – Use of controls or adjustment or performance of procedures other than those specified herein may result in hazardous
radiation exposure.For products with optical ports.
CLASS 1 LASER PRODUCT and reference to the most recent laser standards:
IEC 60 825-1:1993 + A1:1997 + A2:2001 and EN 60825-1:1994+A1:1996+ A2:20
Installation Procedure Overview
The installation procedure of ConnectX-5 adapter cards involves the following steps:
Step Procedure
1 Check the system’s hardware and software requirements.
Safety warnings are provided here in the English language. For safety warnings in other languages, refer to the Adapter Installation Safety
document available on .Instructions nvidia.com
2 Pay attention to the airflow consideration within the host system.
3 Unpack the product.
4 (Optional) Replace the full-height mounting bracket with the supplied short bracket.
5 Install the adapter card in the system.
6 Connect cables or modules to the card.
7 Identify ConnectX-5 adapter card in the system.
System Requirements
Hardware Requirements
A system with a PCI Express slot of corresponding bus width is required for installing the card.
Airflow Requirements
ConnectX-5 adapter cards are offered with two airflow patterns: from the heatsink to the network ports, and vice versa, as shown below.
Please refer to the section for airflow numbers for each specific card model.Specifications
Airflow to the network ports:from the heatsink
Airflow to the heatsink:from the network ports
Unless otherwise specified, NVIDIA products are designed to work in an environmentally controlled data center with low levels of gaseous and
dust (particulate) contamination.
The operation environment should meet severity level G1 as per ISA 71.04 for gaseous contamination and ISO 14644-1 class 8 for cleanliness
level.
For proper operation and performance, please make sure to use a PCIe slot with a corresponding bus width and that can supply sufficient
power to your card. Refer to the section of the manual for more power requirements.Specifications
1.
a.
b.
2.
3.
1.
2.
Software Requirements
See section under the Introduction section.Operating Systems/Distributions
Software Stacks - NVIDIA OpenFabric software package MLNX_OFED for Linux, WinOF-2 for Windows, and VMware. See the Driver Installation
section.
Unpacking the Product
Unpack the adapter package and place them on an antistatic surface, and verify you have received the following items:
ConnectX-5 Adapter Card, with a tall bracket assembled on the card.
Short bracket (accessory)
Check the parts for visible damage that may have occurred during shipping.
Shut down your system if active:
Turn off the power to the system, and disconnect the power cord. Refer to the system documentation for instructions. Before you install the
ConnectX-5 card, make sure that the system is disconnected from power.
Bracket Replacement Instructions
The card is usually shipped with an assembled high-profile bracket. If this form factor is suitable for your requirements, you can skip the remainder of this
section and move to . If you need to replace the high-profile bracket with the short bracket that is included in the shipping box,Installation Instructions
please follow the instructions in this section.
To replace the bracket you will need the following parts:
The new brackets of the proper height
The 2 screws saved from the removal of the bracket
Removing the Existing Bracket
Using a torque driver, remove the two screws holding the bracket in place.
Separate the bracket from the ConnectX-5 card.
All cards in the system should be planned with the same airflow direction.
The adapter is being installed in a system that operates with voltages that can be lethal. Before opening the case of the system, observe the
following precautions to avoid injury and prevent damage to system components.
Remove any metallic objects from your hands and wrists.
Make sure to use only insulated tools.
Verify that the system is powered off and is unplugged.
It is strongly recommended to use an ESD strap or other antistatic devices.
Please note that if the card is removed hastily from the antistatic bag, the plastic ziplock may harm the EMI fingers on the networking
connector. Carefully remove the card from the antistatic bag to avoid damaging the EMI fingers.
Due to risk of damaging the EMI gasket, it is not recommended to replace the bracket more than three times.
2.
3.
1.
2.
1.
2.
3.
Save the two screws.
Installing the New Bracket
Place the bracket onto the card until the screw holes line up.
Screw on the bracket using the screws saved from the bracket removal procedure above.
Installation Instructions
This section provides detailed instructions on how to install your adapter card in a system.
Before installing the card, make sure that the system is off and the power cord is not connected to the server. Please follow proper electrical
grounding procedures.
Open the system case.
Place the adapter in an available PCI Express slot.
Be careful not to put stress on the LEDs on the adapter card.
Do not force the bracket onto the adapter card.
Use a torque driver to apply up to 2 lbs-in torque on the screws.
Please note that the following figures are for illustration purposes only.
4.
5.
6.
1.
2. a.
b.
c.
d.
Applying even pressure at both corners of the card, insert the adapter card into the PCI Express slot until firmly seated.
When the adapter is properly seated, the port connectors are aligned with the slot opening, and the adapter faceplate is visible against the system
chassis.
Secure the adapter with the adapter clip or screw.
Cables and Modules
To obtain the list of supported NVIDIA cables for your adapter, please refer to the Cables Reference Table at http://www.nvidia.com/products/interconnect
./cables-configurator.php
Cable Installation
All cables can be inserted or removed with the unit powered on.
To insert a cable, press the connector into the port receptacle until the connector is firmly seated.
Support the weight of the cable before connecting the cable to the adapter card. Do this by using a cable holder or tying the cable to the
rack.
Determine the correct orientation of the connector to the card before inserting the connector. Do not try and insert the connector upside
down. This may damage the adapter card.
Insert the connector into the adapter card. Be careful to insert the connector straight into the cage. Do not apply any torque, up or down,
to the connector cage in the adapter card.
Make sure that the connector locks in place.
To uninstall the adapter card, see .Uninstalling the Card
When installing cables make sure that the latches engage.
Always install and remove cables by pushing or pulling the cable and connector in a straight line with the card.
2.
d.
3.
4.
5.
6.
1.
2.
3.
4.
5.
After inserting a cable into a port, the Green LED indicator will light when the physical connection is established (that is, when the unit is powered
on and a cable is plugged into the port with the other end of the connector plugged into a functioning port). See under theLED Interface
Interfaces section.
After plugging in a cable, lock the connector using the latching mechanism particular to the cable vendor. When data is being transferred the
Green LED will blink. See under the Interfaces section. LED Interface
Care should be taken as not to impede the air exhaust flow through the ventilation holes. Use cable lengths which allow for routing horizontally
around to the side of the chassis before bending upward or downward in the rack.
To remove a cable, disengage the locks and slowly pull the connector away from the port receptacle. The LED indicator will turn off when the
cable is unseated.
Identifying the Card in Your System
On Linux
Get the device location on the PCI bus by running lspci and locating lines with the string “Mellanox Technologies”:
lspci |grep -i Mellanox
Network controller: Mellanox Technologies MT28800 Family [ConnectX-5]
On Windows
Open Device Manager on the server. Click => , and then enter .Start Run devmgmt.msc
Expand and locate your NVIDIA ConnectX-5 adapter card.System Devices
Right click the mouse on your adapter's row and select to display the adapter card properties window.Properties
Click the tab and select (Windows 2012/R2/2016) from the pull-down menu.Details Hardware Ids Property
PCI Device (Example)
In the display box, check the fields VEN and DEV (fields are separated by ‘&’). In the display example above, notice the sub-stringValue
“PCI\VEN_15B3&DEV_1003”: VEN is equal to 0x15B3 – this is the Vendor ID of NVIDIA; and DEV is equal to 1018 (for ConnectX-5) – this is a
valid NVIDIA PCI Device ID.
If the PCI device does not have a NVIDIA adapter ID, return to Step 2 to check another device.
The list of NVIDIA PCI Device IDs can be found in the PCI ID repository at .http://pci-ids.ucw.cz/read/PC/15b3
1.
2.
3.
1.
2.
3.
4.
5.
Uninstalling the Card
Safety Precautions
The adapter is installed in a system that operates with voltages that can be lethal. Before uninstalling the adapter card, please observe the following
precautions to avoid injury and prevent damage to system components.
Remove any metallic objects from your hands and wrists.
It is strongly recommended to use an ESD strap or other antistatic devices.
Turn off the system and disconnect the power cord from the server.
Card Removal
Please note that the following images are for illustration purposes only.
Verify that the system is powered off and unplugged.
Wait 30 seconds.
To remove the card, disengage the retention mechanisms on the bracket (clips or screws).
Holding the adapter card from its center, gently pull the adapter card out of the PCI Express slot.
When the port connectors reach the top of the chassis window, gently pull the adapter card in parallel to the motherboard.
Please note that the following images are for illustration purposes only.
Altri manuali per Mellanox ConnectX-5
5
Indice
Altri manuali Nvidia Hardware per computer
Nvidia
Nvidia UFM 4.0 Istruzioni per l’uso
Nvidia
Nvidia TURING GPU Manuale utente
Nvidia
Nvidia BlueField-3 Manuale utente
Nvidia
Nvidia TESLA K10 Manuale utente
Nvidia
Nvidia Quadro PLEX 7000 Manuale utente
Nvidia
Nvidia GeForce2 Ti SP6600Ti Manuale utente
Nvidia
Nvidia TESLA K20 Manuale utente
Nvidia
Nvidia PCI Express Series Manuale utente
Nvidia
Nvidia Jetson AGX Orin Series Manuale di installazione e funzionamento
Nvidia
Nvidia MCP 78S Manuale utente
Nvidia
Nvidia TESLA K20 Manuale utente
Nvidia
Nvidia BlueField-2 BF2500 Manuale utente
Nvidia
Nvidia JETSON TX2 Manuale utente
Nvidia
Nvidia BlueField-2 BF2500 Manuale utente
Nvidia
Nvidia DRIVE AGX Manuale utente
Nvidia
Nvidia GEFORCE RTX 4090 Manuale utente
Nvidia
Nvidia DGX H100 Manuale utente
Nvidia
Nvidia Mellanox Manuale utente
Nvidia
Nvidia ConnectX-6 Dx MCX623432AE-ADAB Manuale utente
Nvidia
Nvidia Computer Manuale utente
Manuali Hardware per computer popolari di altre marche
EMC2
EMC2 VNX Series Manuale del proprietario
Panasonic
Panasonic DV0PM20105 Manuale utente
Mitsubishi Electric
Mitsubishi Electric Q81BD-J61BT11 Manuale utente
Gigabyte
Gigabyte B660M DS3H AX DDR4 Manuale utente
Raidon
Raidon iT2300 Manuale utente
National Instruments
National Instruments PXI-8186 Manuale utente
