How to Reach the Max Bandwidth Speed of a Single RDMA QPS When Using...

Unable to reach the max bandwidth speed of a single RDMA QPS with E810-CQDA2.

Resolution

The E810s cannot reach the max bandwidth speed of a single RDMA QPS (queue pairs) in either iWARP or RoCEv2 mode.Columbiaville is designed to deliver best performance using multiple QPs and unfortunately we cannot reach max bandwidth with a single QP.

Excerpt from irdma README:

———–

Performance

———–

RDMA performance may be optimized by adjusting system, application, or driver

settings.

– Flow control is required for best performance in RoCEv2 mode and is optional

in iWARP mode. Both link-level flow control (LFC) and priority flow control

(PFC) are supported, but PFC is recommended. See the “Flow Control Settings”

section of this document for configuration details.

– For bandwidth applications, multiple queue pairs (QPs) are required for best

performance. For example, in the perftest suite, use “-q 8” on the command