How to Reach the Max Bandwidth Speed of a Single RDMA QPS When Using…
Unable to reach the max bandwidth speed of a single RDMA QPS with E810-CQDA2.
Resolution
The E810s cannot reach the max bandwidth speed of a single RDMA QPS (queue pairs) in either iWARP or RoCEv2 mode.Columbiaville is designed to deliver best performance using multiple QPs and unfortunately we cannot reach max bandwidth with a single QP.
Excerpt from irdma README:
———–
Performance
———–
RDMA performance may be optimized by adjusting system, application, or driver
settings.
– Flow control is required for best performance in RoCEv2 mode and is optional
in iWARP mode. Both link-level flow control (LFC) and priority flow control
(PFC) are supported, but PFC is recommended. See the “Flow Control Settings”
section of this document for configuration details.
– For bandwidth applications, multiple queue pairs (QPs) are required for best
performance. For example, in the perftest suite, use “-q 8” on the command
line to run with 8 QP.