Mellanox Technologies InfiniScale MTS3600Q-1UNC Bedienungsanleitung

Mellanox Technologies

InfiniScale®IV 36-Port QSFP

InfiniBand Switch User Manual

P/N: MTS3600Q-1UNC, MTS3600Q-2UNC,

MTS3600R-1UNC, MTS3600R-2UNC

Rev 1.5

Rev 1.5 MellanoxTechnologies

Subject to change without notice.

Mellanox Technologies ConnectX, InfiniBlast, InfiniBridge, InfiniHost, InfiniRISC, InfiniScale, and

InfiniPCI are registered trademarks of Mellanox Technologies, Ltd. Virtual Protocol Interconnect is a trade-

mark of Mellanox Technologies, Ltd. All other trademarks are property of their respective owners.

InfiniScale® IV 36-Port QSFP InfiniBand Switch User Manual

Document Number: 2983

Mellanox Technologies, Inc.

350 Oakmead Parkway

Sunnyvale, CA 94086

U.S.A.

www.mellanox.com

Tel: (408) 970-3400

Fax: (408) 970-3403

Mellanox Technologies Ltd

PO Box 586 Hermon Building

Yokneam 20692

Israel

Tel: +972-4-909-7200

Fax: +972-4-959-3245

NOTE:

THIS INFORMATION IS PROVIDED BY MELLANOX FOR INFORMATIONAL PURPOSES ONLY

AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE

IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE

ARE DISCLAIMED. IN NO EVENT SHALL MELLANOX BE LIABLE FOR ANY DIRECT, INDI-

RECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING,

BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,

DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THE-

ORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEG-

LIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS HARDWARE,

EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

InfiniScale® IV 36-Port QSFP InfiniBand Switch User Manual

MellanoxTechnologies Rev 1.5

Table of Contents

Table of Contents 3

Revision History 4

About this Manual 5

Intended Audience 5

Related Documentation

Additional Documentation available from Mellanox:

Conventions

Throughout this manual, the name MTS3600 and the term switch are used to describe both the 36-port

40Gb/s InfiniBand Switch and the 36-port QSFP 20Gb/s InfiniBand Switch, unless explicitly indicated oth-

erwise.

Switch Products Covered in this User’s Manual

Table 2 - Reference Documents

Mellanox Firmware

Tools (MFT)

User’s Manual

Document # 2329

The MFT (Mellanox Firmware Tools) package is a set of firmware tools. The man-

ual supplied with this package provides an overview of the firmware its installa-

tion and replacement. The MFT can be downloaded with its documentation at:

http://www.mellanox.com/products/management_tools.php

Table 3 - Switch Products Covered by this User Manual

Product Number Description

MTS3600Q-1UNC 36-port Unmanaged QSFP 40Gb/s InfiniBand switch with one power supply

MTS3600Q-2UNC 36-port Unmanaged QSFP 40Gb/s InfiniBand switch with two power supplies

MTS3600R-1UNC 36-port Unmanaged QSFP 20Gb/s InfiniBand switch with one power supply

MTS3600R-2UNC 36-port Unmanaged QSFP 20Gb/s InfiniBand switch with two power supplies

InfiniScale® IV 36-Port QSFP InfiniBand Switch User Manual

MellanoxTechnologies Rev 1.5

1 Overview

Mellanox MTS3600 switch systems provide the highest performing fabric solution by delivering high band-

width and low latency to Enterprise Data Centers, High-Performance Computing and Embedded environ-

ments. Networks built with MTS3600 systems can carry converged traffic with the combination of assured

bandwidth and granular quality of service. Built with Mellanox’s 4th generation InfiniScale® IV InfiniBand

switch device, MTS3600 systems provide up to 40Gb/s full bidirectional bandwidth per port. With 36 ports,

these systems are among the densest switching systems available. These stand-alone switches are an ideal

choice for top of-rack leaf connectivity or for building small to medium size clusters.

The switch comes pre-installed with all necessary firmware and configured for standard operation within an

InfiniBand fabric, and requires an InfiniBand compliant Subnet Manager running from one of the hosts. All

that is required for normal operation is to follow the usual precautions for installation and to connect the

switch to the HCAs. Once connected, the Subnet Management software automatically configures and begins

utilizing the switch.

It is recommended that Mellanox OpenFabrics software package be installed on all nodes connected to the

MTS3600. The software package provides a subnet manager and network management tools as well as con-

nectivity software for servers and storage, and is available on the Mellanox web site. See Chapter 3 for more

information.

Basic installation, hot-swapping components and hardware maintenance is covered in “Installation and

Basic Operation” on page 2.

1.1 Serial Number and Product Version Information

The serial number and product version information are found on the label seen in the figure below.

Figure 1: Generic Product label

Also on this label is the GUID identifier for the switch.

Rev 1.5 MellanoxTechnologies

2 Installation and Basic Operation

2.1 Switch Platform Hardware Overview

Figure 2 shows the front and rear panel views of the QSFP switch. The figure shows port configurations for

the switch systems, including the dual hot-swap power supplies, and hot-swap fan module, I2C connector,

RJ45 connector, USB connectors, VGA port connector, and various status LEDs.

Figure 2: QSFP Switch System Front and Back Panels

All InfiniBand connectivity is via the rear panel. All connectors can support active cables.

2.1.1 Status LEDs

Figure 3: Power and System LEDs

2.1.1.1 System Status Indicators

The System Status Indicators are located just to the left of the primary power supply unit, and labeled “Sys.”.

The following status conditions are possible:

DC output from

the PSU is OK

Latch release mechanism Handle

There is a fault

in the PSU

Input AC voltage

is good

PSU Status

Indicators

Switch Fan

Status

Indicators

System

Status

Indicators

InfiniScale® IV 36-Port QSFP InfiniBand Switch User Manual

MellanoxTechnologies Rev 1.5

Table 4 - System Status LED Configurations

2.1.1.2 Power Supply Status Indicators

The MTS3600 36 Port Switch is available with one or two factory installed Power Supply Units. For

switches with only one unit installed, a second Power Supply Unit can be added to increase security and to

add redundancy.

Figure 4: MTS3600 QSFP Front Panel

The primary power supply unit (PSU1) is located on the right side of the front panel, with PSU2 on the left

side. Status indicators are located just to the left of the primary power supply unit. Each PSU also has three

status LEDs, on the right side of the PSU, that indicate the internal status of the unit.

~AC– This LED when lit indicates input voltage between 90 and 264 Volts.

–This LED when lit indicates a fault in the power supply.

OK – This LED when lit indicates that the output from the power supply is +12VDC.

The PSU status indicators are located just to the left of the primary power supply unit, and labeled “PSU1”

and “PSU2”. The following status conditions are possible:

Table 5 - PSU Status LED Configurations

LED Configuration Status

OK – The system is up and running.

Error –A fault in the system, most likely

the firmware did not BOOT properly.

Off – The system has no power.

LED Configuration Status

OK – This power supply unit is delivering the

correct DC supply.

Primary Power

Supply Unit

Place for secondary

Power Supply Unit Fan Unit

Rev 1.5 MellanoxTechnologies

2.1.1.3 Fan Status Indicators

The indicators labeled “Fans” are located just to the left of the primary power supply unit, next to PSU 1.

The following fan status conditions are possible:

Table 6 - Fan Status LED Configurations

2.1.2 I2C Connector

The MTS3600 supports an I2C compatible interface on the front panel.This interface is used to program

firmware into the Flash Memory. Firmware can also be programmed in-band over the InfiniBand network.

See Section 3 for more details.

2.1.3 Optional Management Interfaces (Advanced Management Only)

The following interfaces allow access to the optional management module. These interfaces have no func-

tion in unmanaged systems.

2.1.3.1 VGA Interface

The VGA port is for video output from the management module.

2.1.3.2 RJ-45 Ethernet Connector

The Ethernet connection provides access for remote management. The MTS3600 can be connected to an

Ethernet switch or the Ethernet port of a computer.

2.1.3.3 USB interface

There are two USB ports for connecting a keyboard and mouse for local management operation.

Error – This power supply unit is NOT deliver-

ing the correct DC supply.

Off – This power supply unit is NOT receiving

any input power, or this PSU is not installed.

LED Configuration Status

OK – All fans are operating.

Error – One or more fans is not operating. Repair

or replace the fan unit.

Off – The fan unit is not receiving any power.

Check that the fan unit is properly and com-

pletely inserted.

All fans must be operating while the power supply is plugged in. Power must be

removed within one minute of the fans failing, to prevent damage to the switch.

LED Configuration Status

InfiniScale® IV 36-Port QSFP InfiniBand Switch User Manual

MellanoxTechnologies Rev 1.5

2.2 Switch Platform Installation and Operation

Installation and initialization of the switch platform are straightforward processes, requiring attention to the

normal mechanical, power, and thermal precautions for rack-mounted equipment.

The switch platform does not require any programming or configuration to operate as a basic InfiniBand

switch and includes all of the necessary functionality to operate with external standard InfiniBand Subnet

Management software.

An Advanced Management option is available for the switch platform which includes InfiniBand Subnet

Management software embedded internally in the switch. This section describes the installation process and

basic operation of the switch platform. Please first read the warnings sub-section carefully before carrying

on with installation procedures.

2.2.1 Installation Safety Warnings

For Safety Warnings in French see Appendix E on page 32, and for German see Appendix F on page 34.

For Special Regulations Regarding Finland, Sweden, Denmark, and Norway see Appendix G on page 36.

1. Installation Instructions

2. Over-temperature

3. Stacking the Chassis

4. Redundant Power Supply Connection - Electrical Hazard

5. During Lightning - Electrical Hazard

Read all installation instructions before connecting the equipment to the power

source.

This equipment should not be operated in an area with an ambient temperature

exceeding the maximum recommended: 45°C (113°F). Moreover, to guarantee

proper air flow, allow at least 8cm (3 inches) of clearance around the ventilation

openings.

The chassis should not be stacked on any other equipment. If the chassis falls, it

can cause bodily injury and equipment damage.

This product includes a blank cover over the space for the redundant power sup-

ply. Do not operate the product if the blank cover is not securely fastened or if it

is removed.

During periods of lightning activity, do not work on the equipment or connect or

disconnect cables.

Dieses Handbuch passt für folgende Modelle

Inhaltsverzeichnis

Andere Mellanox Technologies Schalten Handbücher

Mellanox Technologies

Mellanox Technologies MetroDX MTX6000-2SFS Bedienungsanleitung

Mellanox Technologies

Mellanox Technologies Mellanox SX1018 Bedienungsanleitung

Mellanox Technologies

Mellanox Technologies InfiniScale MTS3600Q-1BNC Bedienungsanleitung

Mellanox Technologies

Mellanox Technologies MIS5022Q-1BRR Bedienungsanleitung

Mellanox Technologies

Mellanox Technologies Spectrum SN2100 Bedienungsanleitung

Mellanox Technologies

Mellanox Technologies Grid Director 4036 Bedienungsanleitung

Mellanox Technologies

Mellanox Technologies Spectrum SN2700 Gebrauchsanweisung

Mellanox Technologies

Mellanox Technologies switchx MSX1035B-1BRR Bedienungsanleitung

Mellanox Technologies

Mellanox Technologies MSX6512-NR Handbuch

Mellanox Technologies

Mellanox Technologies SX6720 Gebrauchsanweisung

Mellanox Technologies

Mellanox Technologies SwitchX-2 MSX6018F-1SFS Gebrauchsanweisung

Mellanox Technologies

Mellanox Technologies QM8700 Bedienungsanleitung

Mellanox Technologies

Mellanox Technologies TX6100 MetroX Series Gebrauchsanweisung

Mellanox Technologies

Mellanox Technologies SwitchX Bedienungsanleitung

Mellanox Technologies

Mellanox Technologies InfiniScale III Bedienungsanleitung

Mellanox Technologies

Mellanox Technologies Mellanox SX1018 Bedienungsanleitung

Mellanox Technologies

Mellanox Technologies InfiniScale MTS3600Q-1BNC Bedienungsanleitung

Mellanox Technologies

Mellanox Technologies Spectrum SN2100 Gebrauchsanweisung

Mellanox Technologies

Mellanox Technologies Spectrum SN2700 Gebrauchsanweisung

Mellanox Technologies

Mellanox Technologies MIS5022Q-1BFR Bedienungsanleitung

Mellanox Technologies

Mellanox Technologies Mellanox SX1018 Betriebsanleitung

Mellanox Technologies

Mellanox Technologies SB7700 Bedienungsanleitung

Mellanox Technologies

Mellanox Technologies TX6000 Gebrauchsanweisung

Mellanox Technologies

Mellanox Technologies Grid Director 4036E Bedienungsanleitung

Beliebte Schalten Handbücher anderer Marken

URC

URC Total Control MFS-8 Bedienungsanleitung

Azbil

Azbil HPQ-D11 Bedienungsanleitung

Sony

Sony DFS-900M Bedienungsanleitung

SICK

SICK i17S Bedienungsanleitung

F&F

F&F SZR-277 Bedienungsanleitung

Shure

Shure UAMS/BK Bedienungsanleitung

Dräger

Dräger X-zone Switch Off Bedienungsanleitung

Asco

Asco Joucomatic 349 Series Bedienungsanleitung

BT Mini Hub Bedienungsanleitung

D-Link

D-Link DES-1226G Bedienungsanleitung

Johnson Controls

Johnson Controls FS80-C Bedienungsanleitung

Alcatel-Lucent

Alcatel-Lucent 7450 ESS-12 Bedienungsanleitung

MicroNet

MicroNet SP1200A Bedienungsanleitung

Ruijie

Ruijie RG-PF2920 Series Installations- und Betriebsanleitung

Altinex

Altinex DA1914SX Bedienungsanleitung

MiLAN

MiLAN MIL-SM2401M Bedienungsanleitung

RJM

RJM MASTERMIND PBC/6X Bedienungsanleitung

Atlas

Atlas MMK-KVM8 Bedienungsanleitung