How does InfiniBand switch work?

InfiniBand provides two transfer semantics; a channel semantic sometimes called SEND/RECEIVE and a pair of memory semantics called RDMA READ and RDMA WRITE. When using the channel semantic, the message is received in a data structure provided by the application on the receiving side.

Table of Contents

What are Mellanox switches?

Mellanox provides the Highest Performing Open Ethernet Switch Systems at port speeds ranging from 1GbE through 400GbE, enabling Data Centers, Cloud Computing, Storage, Web2. 0 and High Performance Computing applications to operate with maximum functionality at scale.

Is InfiniBand a Rdma?

The InfiniBand Verbs API, which is an implementation of the remote direct memory access (RDMA) technology.

Does InfiniBand use Ethernet?

InfiniBand is a lossless fabric, which means it does not drop packets like other networks do. InfiniBand is the network that enables the next generation of data-center infrastructure and applications. It’s important to note that InfiniBand and Ethernet can’t be used together.

Who uses InfiniBand?

InfiniBand is backed by top companies in the industry, including the steering committee mem- bers: Compaq, Dell, Hewlett Packard, IBM, Intel, Microsoft, and Sun. In total, there are more than 220 members of the InfiniBand Trade Association.

What is InfiniBand Vs Ethernet?

InfiniBand also has much lower latency than Ethernet and, most importantly, it incorporates processing engines inside the network that accelerate data processing for deep learning and high-performance computing. These are key technology advantages for any compute- and data-intensive application.

Does MVAPICH2 support InfiniBand?

More recently, MPICH supported InfiniBand through a netmod (now deprecated), but MVAPICH2 has extensive optimizations that make it the preferred implementation in nearly all cases. An orthogonal axis to hardware/platform support is coverage of the MPI standard.

Which MPI for InfiniBand performance?

Also consider that there are other MPI implementations that might give better performance or compatibility, such as MVAPICH (can have the best InfiniBand performance) or Intel MPI (widely supported ISVs). HP worked hard to get their MPI qualified with lots of ISV codes too, but I’m not sure how it is faring after being sold on to Platform…

What is MPICH and why was it developed?

MPICH was originally developed during the MPI standards process starting in 1992 to provide feedback to the MPI Forum on implementation and usability issues. This original implementation was based on the Chameleon portability system to provide a light-weight implementation layer (hence the name MPICH from MPI over CHameleon).