Sun Dual Port 4x IB Host Channel Adapter PCI-ExpressModule User's Guide
|
  
|
This chapter provides an overview of the Sun IB-Host Channel Adapter PCI-ExpressModule. It includes the following sections:
Product Features
Sun IB-Host Channel Adapter PCI-ExpressModule card features include:
- Dual (4X 10Gb/s) Infiniband ports
- Integrated serializer/deserializer (SerDes)
- x8 PCI-Express 16Gb/s full duplex
- InfiniBand Trade Association (IBTA) version 1.1 interoperability
- Dual copper connectors (MicroGigaCN)
- Optimal cooling architecture
- Robust form factor for enterprise class applications
- InfiniRISC
embedded RISC processor
- 256 MByte of fixed local DDR memory
Hardware Overview
The Sun IB-Host Channel Adapter PCI-ExpressModule is an InfiniBand (IB) host channel adapter (HCA) ExpressModule (EM) and is referred to as the IB-EM in this manual. This IB-EM is a high performance, highly integrated dual 4x InfiniBand adapter. The adapter supports a single x8 PCI-Express connection, which provides full duplex data transfers of up to 16 Gbps. FIGURE 1-1 shows the IB-EM card
The board characteristics are:
- Power: approximately 12 watts total
- Adapter protection from ESD and handling damage
- Requires 4x-12x InfiniBand cables
- 3.3V PCI-ExpressModule slot
- Link status indication LED
- Two 4x InfiniBand (IB) ports
The standard PCI-Express interface is used for data traffic, management traffic, and to generate and receive inbound configuration packets
FIGURE 1-1 Sun Dual Port 4x IB Host Channel Adapter PCI-ExpressModule
I/O Interfaces
The IB-EM includes the following interfaces:
- Two 4x InfiniBand copper connectors
- PCI-E x8-lane edge connector
InfiniBand Interface
The IB-EM provides two 4x InfiniBand v1.1 connector (or ports) for external copper cables and is IBTA specification 1.1-compliant.
PCI-Express Interface
The PCI-Express bus is a PCI-Express x8 version 1.0a-compliant interface. The adapter can be either a master initiating the PCI bus operations or a slave responding to PCI bus operations. The PCI-Express bus can connect to a host CPU in an HCA application.
LED Displays
Two InfiniBand ports connectors are located on the front panel of the adapter. Each port has two LEDs, as shown in FIGURE 1-2. An explanation of the LEDs is given in TABLE 1-1.
TABLE 1-1 IB-EM LEDs
Color
|
Meaning
|
Green
|
Physical Link - The physical link LED illuminates once the Tavor driver is successfully attached to the port.
|
Amber
|
Logical Link - The logical link LED illuminates once the InfiniBand port is in the Up state. This LED also blinks when there is traffic on the port.
|
FIGURE 1-2 LED Layout
Hardware, Software, and Cable Requirements
The hardware, software, and cable requirements for the Sun IB-Host Channel Adapter PCI-ExpressModule card are listed in TABLE 1-2.
TABLE 1-2 Hardware , Software , and Cable Requirements
Operating System
|
Servers
|
Solaris 10 1/06 Operating system and future compatible releases
RedHat Enterprise Linux 4.0 Update 3
|
Sun Fire X8000
|
InfiniBand Switches
|
X3152A
|
Sun InfiniBand Switch P9, interoperable with most leading IB switch vendors
|
Diagnostics Version
|
|
SunVTS Version 6.0 Patch Set 1 and subsequent compatible releases
|
Supported Cables
|
X9280A
X9281A
|
Sun 4x-to-12x InfiniBand cable, 2 meter length
Sun 4x-to-12x InfiniBand cable, 5 meter length
|
Note - Use only supported cables to ensure reliable InfiniBand interface connections. These cables can be ordered from Sun Microsystems, Inc.
Connecting to other IB switch vendor ports may require 4x-4x IB cables. Refer to the documentation for the IB switch you use.
|
Sun Dual Port 4x IB Host Channel Adapter PCI-ExpressModule User's Guide
|
819-6182-11
|
  
|
Copyright © 2006, Sun Microsystems, Inc. All Rights Reserved.