Nvidia Mellanox ConnectX-5 Handbuch

Hardware Installation

Installation and initialization of ConnectX-5 adapter cards require attention to the mechanical attributes, power specification, and precautions for electronic

equipment.

Safety Warnings

Please observe all safety warnings to avoid injury and prevent damage to system components. Note that not all warnings are relevant to all models.

Note that not all warnings are relevant to all models.

General Installation Instructions

Read all installation instructions before connecting the equipment to the power source.

Jewelry Removal Warning

Before you install or remove equipment that is connected to power lines, remove jewelry such as bracelets, necklaces, rings, watches and

so on. Metal objects heat up when connected to power and ground and can meltdown, causing serious burns and/or welding the metal

object to the terminals.

Over-temperature

This equipment should not be operated in an area with an ambient temperature exceed-ing the maximum recommended: 55°C (131°F). An

airflow of 200LFM at this maximum ambient temperature is required for HCA cards and NICs. To guarantee proper airflow, allow at least

8cm (3 inches) of clearance around the ventila-tion openings.

During Lightning - Electrical Hazard

During periods of lightning activity, do not work on the equipment or connect or dis-connect cables.

Copper Cable Connecting/Disconnecting

Some copper cables are heavy and not flexible, as such they should be carefully attached to or detached from the connectors. Refer to the

cable manufacturer for spe-cial warnings and instructions.

Equipment Installation

This equipment should be installed, replaced, or serviced only by trained and qualified personnel.

Equipment Disposal

Disposal of this equipment should be in accordance to all national laws and regula-tions.

Local and National Electrical Codes

This equipment should be installed in compliance with local and national electrical codes.

Hazardous Radiation Exposure

Caution – Use of controls or adjustment or performance of procedures other than those specified herein may result in hazardous

radiation exposure.For products with optical ports.

CLASS 1 LASER PRODUCT and reference to the most recent laser standards:

IEC 60 825-1:1993 + A1:1997 + A2:2001 and EN 60825-1:1994+A1:1996+ A2:20

Installation Procedure Overview

The installation procedure of ConnectX-5 adapter cards involves the following steps:

Step Procedure

1 Check the system’s hardware and software requirements.

Safety warnings are provided here in the English language. For safety warnings in other languages, refer to the Adapter Installation Safety

document available on .Instructions nvidia.com

2 Pay attention to the airflow consideration within the host system.

3 Unpack the product.

4 (Optional) Replace the full-height mounting bracket with the supplied short bracket.

5 Install the adapter card in the system.

6 Connect cables or modules to the card.

7 Identify ConnectX-5 adapter card in the system.

System Requirements

Hardware Requirements

A system with a PCI Express slot of corresponding bus width is required for installing the card.

Airflow Requirements

ConnectX-5 adapter cards are offered with two airflow patterns: from the heatsink to the network ports, and vice versa, as shown below.

Please refer to the section for airflow numbers for each specific card model.Specifications

Airflow to the network ports:from the heatsink

Airflow to the heatsink:from the network ports

Unless otherwise specified, NVIDIA products are designed to work in an environmentally controlled data center with low levels of gaseous and

dust (particulate) contamination.

The operation environment should meet severity level G1 as per ISA 71.04 for gaseous contamination and ISO 14644-1 class 8 for cleanliness

level.

For proper operation and performance, please make sure to use a PCIe slot with a corresponding bus width and that can supply sufficient

power to your card. Refer to the section of the manual for more power requirements.Specifications

Software Requirements

See section under the Introduction section.Operating Systems/Distributions

Software Stacks - NVIDIA OpenFabric software package MLNX_OFED for Linux, WinOF-2 for Windows, and VMware. See the Driver Installation

section.

Unpacking the Product

Unpack the adapter package and place them on an antistatic surface, and verify you have received the following items:

ConnectX-5 Adapter Card, with a tall bracket assembled on the card.

Short bracket (accessory)

Check the parts for visible damage that may have occurred during shipping.

Shut down your system if active:

Turn off the power to the system, and disconnect the power cord. Refer to the system documentation for instructions. Before you install the

ConnectX-5 card, make sure that the system is disconnected from power.

Bracket Replacement Instructions

The card is usually shipped with an assembled high-profile bracket. If this form factor is suitable for your requirements, you can skip the remainder of this

section and move to . If you need to replace the high-profile bracket with the short bracket that is included in the shipping box,Installation Instructions

please follow the instructions in this section.

To replace the bracket you will need the following parts:

The new brackets of the proper height

The 2 screws saved from the removal of the bracket

Removing the Existing Bracket

Using a torque driver, remove the two screws holding the bracket in place.

Separate the bracket from the ConnectX-5 card.

All cards in the system should be planned with the same airflow direction.

The adapter is being installed in a system that operates with voltages that can be lethal. Before opening the case of the system, observe the

following precautions to avoid injury and prevent damage to system components.

Remove any metallic objects from your hands and wrists.

Make sure to use only insulated tools.

Verify that the system is powered off and is unplugged.

It is strongly recommended to use an ESD strap or other antistatic devices.

Please note that if the card is removed hastily from the antistatic bag, the plastic ziplock may harm the EMI fingers on the networking

connector. Carefully remove the card from the antistatic bag to avoid damaging the EMI fingers.

Due to risk of damaging the EMI gasket, it is not recommended to replace the bracket more than three times.

Save the two screws.

Installing the New Bracket

Place the bracket onto the card until the screw holes line up.

Screw on the bracket using the screws saved from the bracket removal procedure above.

Installation Instructions

This section provides detailed instructions on how to install your adapter card in a system.

Before installing the card, make sure that the system is off and the power cord is not connected to the server. Please follow proper electrical

grounding procedures.

Open the system case.

Place the adapter in an available PCI Express slot.

Be careful not to put stress on the LEDs on the adapter card.

Do not force the bracket onto the adapter card.

Use a torque driver to apply up to 2 lbs-in torque on the screws.

Please note that the following figures are for illustration purposes only.

2. a.

Applying even pressure at both corners of the card, insert the adapter card into the PCI Express slot until firmly seated.

When the adapter is properly seated, the port connectors are aligned with the slot opening, and the adapter faceplate is visible against the system

chassis.

Secure the adapter with the adapter clip or screw.

Cables and Modules

To obtain the list of supported NVIDIA cables for your adapter, please refer to the Cables Reference Table at http://www.nvidia.com/products/interconnect

./cables-configurator.php

Cable Installation

All cables can be inserted or removed with the unit powered on.

To insert a cable, press the connector into the port receptacle until the connector is firmly seated.

Support the weight of the cable before connecting the cable to the adapter card. Do this by using a cable holder or tying the cable to the

rack.

Determine the correct orientation of the connector to the card before inserting the connector. Do not try and insert the connector upside

down. This may damage the adapter card.

Insert the connector into the adapter card. Be careful to insert the connector straight into the cage. Do not apply any torque, up or down,

to the connector cage in the adapter card.

Make sure that the connector locks in place.

To uninstall the adapter card, see .Uninstalling the Card

When installing cables make sure that the latches engage.

Always install and remove cables by pushing or pulling the cable and connector in a straight line with the card.

After inserting a cable into a port, the Green LED indicator will light when the physical connection is established (that is, when the unit is powered

on and a cable is plugged into the port with the other end of the connector plugged into a functioning port). See under theLED Interface

Interfaces section.

After plugging in a cable, lock the connector using the latching mechanism particular to the cable vendor. When data is being transferred the

Green LED will blink. See under the Interfaces section. LED Interface

Care should be taken as not to impede the air exhaust flow through the ventilation holes. Use cable lengths which allow for routing horizontally

around to the side of the chassis before bending upward or downward in the rack.

To remove a cable, disengage the locks and slowly pull the connector away from the port receptacle. The LED indicator will turn off when the

cable is unseated.

Identifying the Card in Your System

On Linux

Get the device location on the PCI bus by running lspci and locating lines with the string “Mellanox Technologies”:

lspci |grep -i Mellanox

Network controller: Mellanox Technologies MT28800 Family [ConnectX-5]

On Windows

Open Device Manager on the server. Click => , and then enter .Start Run devmgmt.msc

Expand and locate your NVIDIA ConnectX-5 adapter card.System Devices

Right click the mouse on your adapter's row and select to display the adapter card properties window.Properties

Click the tab and select (Windows 2012/R2/2016) from the pull-down menu.Details Hardware Ids Property

PCI Device (Example)

In the display box, check the fields VEN and DEV (fields are separated by ‘&’). In the display example above, notice the sub-stringValue

“PCI\VEN_15B3&DEV_1003”: VEN is equal to 0x15B3 – this is the Vendor ID of NVIDIA; and DEV is equal to 1018 (for ConnectX-5) – this is a

valid NVIDIA PCI Device ID.

If the PCI device does not have a NVIDIA adapter ID, return to Step 2 to check another device.

The list of NVIDIA PCI Device IDs can be found in the PCI ID repository at .http://pci-ids.ucw.cz/read/PC/15b3

Uninstalling the Card

Safety Precautions

The adapter is installed in a system that operates with voltages that can be lethal. Before uninstalling the adapter card, please observe the following

precautions to avoid injury and prevent damage to system components.

Remove any metallic objects from your hands and wrists.

It is strongly recommended to use an ESD strap or other antistatic devices.

Turn off the system and disconnect the power cord from the server.

Card Removal

Please note that the following images are for illustration purposes only.

Verify that the system is powered off and unplugged.

Wait 30 seconds.

To remove the card, disengage the retention mechanisms on the bracket (clips or screws).

Holding the adapter card from its center, gently pull the adapter card out of the PCI Express slot.

When the port connectors reach the top of the chassis window, gently pull the adapter card in parallel to the motherboard.

Please note that the following images are for illustration purposes only.

Andere Handbücher für Mellanox ConnectX-5

Inhaltsverzeichnis

Andere Nvidia Computerhardware Handbücher

Nvidia

Nvidia Mellanox ConnectX-6 Dx Series Bedienungsanleitung

Nvidia

Nvidia Tegra 250 Referenzhandbuch

Nvidia

Nvidia Mellanox ConnectX-5 Bedienungsanleitung

Nvidia

Nvidia TESLA C2050 Bedienungsanleitung

Nvidia

Nvidia Quadro Bedienungsanleitung

Nvidia

Nvidia TESLA M2090 Bedienungsanleitung

Nvidia

Nvidia TESLA M2050 Bedienungsanleitung

Nvidia

Nvidia GEFORCE RTX 4090 Bedienungsanleitung

Nvidia

Nvidia SP5200BLT Bedienungsanleitung

Nvidia

Nvidia AVerMedia D133 Series Bedienungsanleitung

Nvidia

Nvidia JETSON XAVIER NX Leitfaden

Nvidia

Nvidia Mellanox ConnectX-5 Bedienungsanleitung

Nvidia

Nvidia TESLA K40 Bedienungsanleitung

Nvidia

Nvidia DGX-2 SYSTEM Bedienungsanleitung

Nvidia

Nvidia Quadro PLEX 7000 Bedienungsanleitung

Nvidia

Nvidia GeForce FX Series Bedienungsanleitung

Nvidia

Nvidia Mellanox ConnectX-6 MCX654106A-ECAT Bedienungsanleitung

Nvidia

Nvidia ConnectX-7 Bedienungsanleitung

Nvidia

Nvidia FX4500 - Apple MAC Pro QUADRO FX 4500 Video Card... Kurzanleitung

Nvidia

Nvidia Jetson AGX Xavier Series Leitfaden

Nvidia

Nvidia Geforce PCI-Express Series Bedienungsanleitung

Nvidia

Nvidia Jetson Orin NX Leitfaden

Nvidia

Nvidia DGX A100 Bedienungsanleitung

Nvidia

Nvidia RTX 6000 Bedienungsanleitung

Beliebte Computerhardware Handbücher anderer Marken

EMC2

EMC2 VNX Series Betriebsanleitung

Panasonic

Panasonic DV0PM20105 Bedienungsanleitung

Mitsubishi Electric

Mitsubishi Electric Q81BD-J61BT11 Bedienungsanleitung

Gigabyte

Gigabyte B660M DS3H AX DDR4 Bedienungsanleitung

Raidon

Raidon iT2300 Bedienungsanleitung

National Instruments

National Instruments PXI-8186 Bedienungsanleitung

Hauppauge

Hauppauge WinTV-HVR-2250 Bedienungsanleitung

Kontron

Kontron CP6002 Bedienungsanleitung

Manhattan

Manhattan 702843 Bedienungsanleitung

Aphex

Aphex 230 Bedienungsanleitung

AMD

AMD Phenom II Betriebshandbuch

Intel

Intel NUC 12 Pro Bedienungsanleitung

dbx

dbx Zone Pro 1260 Bedienungsanleitung

Galaxy

Galaxy GHDX2-2430S-24F4D Bedienungsanleitung

Intel

Intel AXXRMFBU4 Bedienungsanleitung

Kontron

Kontron DIMM-PC/MD Bedienungsanleitung

ST X-NUCLEO-SAFEA1B Betriebsanleitung

STEINWAY LYNGDORF

STEINWAY LYNGDORF SP-1 Bedienungsanleitung