RDMA

Mellanox ConnectX-6 MCX653105A infiniband EDR RDMA

Mellanox ConnectX-6 MCX653105A infiniband EDR RDMArc_rdma_write_bw:bw = 12 GB/secmsg_rate = 183 K/secsend_cost = 49.7 ms/GBrecv_cost = 49.1 ms/GBsend_cpus_used = 59.6 % cpusrecv_cpus_used = 58.8 % cpus — Taguma (@taguma2) 2023年2月26日 Mel…

SMB Direct ConnectX-4 infiniband FDR linux-6.0 + ksmbd-3.4.6

SMB Direct ConnectX-4 infiniband FDR linux-6.0 + ksmbd-3.4.6Seq Q32T1 R: 2529MB/sSeq Q32T1 W: 1630MB/s4KiB Q8T8 R: 16558 IOPS4KiB Q8T8 W: 14993 IOPS4KiB Q32T1 R: 22043 IOPS4KiB Q32T1 W: 18405 IOPS4KiB Q1T1 R: 6692 IOPS4KiB Q1T1 W: 6664 IOP…

nfs over RDMA Mellanox ConnectX-5 MCX555A infiniband EDR

nfs over RDMA Mellanox ConnectX-5 MCX555A infiniband EDRSeq Q32T1 R:10649MB/sSeq Q32T1 W: 6420MB/s4KiB Q8T8 R: 225097 IOPS4KiB Q8T8 W: 201790 IOPS4KiB Q32T1 R: 185686 IOPS4KiB Q32T1 W: 171784 IOPS4KiB Q1T1 R: 26688 IOPS4KiB Q1T1 W: 25534 I…

Mellanox ConnectX-5 MCX555A infiniband EDR RDMA

Mellanox ConnectX-5 MCX555A infiniband EDR RDMArc_rdma_write_bw:bw = 12 GB/secmsg_rate = 182 K/secsend_cost = 30.8 ms/GBrecv_cost = 34.3 ms/GBsend_cpus_used = 37 % cpusrecv_cpus_used = 41 % cpus — Taguma (@taguma2) 2022年3月5日 Mellanox Co…

SMB Direct ConnectX-4 infiniband FDR linux-5.15 + ksmbd-3.4.4

SMB Direct ConnectX-4 infiniband FDR linux-5.15 + ksmbd-3.4.4Seq Q32T1 R: 4018MB/sSeq Q32T1 W: 4138MB/s4KiB Q8T8 R: 95924 IOPS4KiB Q8T8 W: 94556 IOPS4KiB Q32T1 R: 84927 IOPS4KiB Q32T1 W: 84611 IOPS4KiB Q1T1 R: 30248 IOPS4KiB Q1T1 W: 31013 …

SMB Direct ConnectX-3 infiniband FDR linux-5.13+CIFSD ksmbd-3.4.0

SMB Direct ConnectX-3 infiniband FDR linux-5.13+CIFSD ksmbd-3.4.0 Seq Q32T1 R: 4092MB/s Seq Q32T1 W: 4702MB/s 4KiB Q8T8 R: 97846 IOPS 4KiB Q8T8 W: 102027 IOPS 4KiB Q32T1 R: 84631 IOPS 4KiB Q32T1 W: 85125 IOPS 4KiB Q1T1 R: 31727 IOPS 4KiB Q…

SMB Direct ConnectX-4 infiniband EDR linux-5.13+CIFSD ksmbd-3.4.0

SMB Direct ConnectX-4 infiniband EDR linux-5.13+CIFSD ksmbd-3.4.0 Seq Q32T1 R: 4598MB/s Seq Q32T1 W: 4616MB/s 4KiB Q8T8 R: 103183 IOPS 4KiB Q8T8 W: 107164 IOPS 4KiB Q32T1 R: 93035 IOPS 4KiB Q32T1 W: 93412 IOPS 4KiB Q1T1 R: 19511 IOPS 4KiB …

Mellanox ConnectX-5 641SFP28 25GbE RDMA

Mellanox ConnectX-5 641SFP28 25GbE RDMArc_rdma_write_bw: bw = 2.89 GB/sec msg_rate = 44.1 K/sec send_cost = 54.7 ms/GB recv_cost = 116 ms/GB send_cpus_used = 16 % cpus recv_cpus_used = 33.5 % cpus — Taguma (@taguma2) 2021年4月11日 Mellanox…

SMB Direct ConnectX-3 infiniband QDR linux-5.9+kernel CIFSD ksmbd-3.3.2

SMB Direct ConnectX-3 infiniband QDR linux-5.9+kernel CIFSD ksmbd-3.3.2 Seq1M Q8T1 R: 3515MB/s Seq1M Q8T1 W: 3794MB/sSeq128K Q32T1 R: 3215MB/sSeq128K Q32T1 W: 2829MB/s4KiB Q32T16 R: 46700 IOPS4KiB Q32T16 W: 44400 IOPS 4KiB Q1T1 R: 14997 IO…

nfs over RDMA btrfs kernel-5.9 Mellanox ConnectX-3 infiniband QDR

nfs over RDMA btrfs kernel-5.9 Mellanox ConnectX-3 infiniband QDR Seq1M Q8T1 R: 3905MB/s Seq1M Q8T1 W: 2188MB/sSeq128K Q32T1 R: 3883MB/sSeq128K Q32T1 W: 2625MB/s4KiB Q32T16 R: 274000 IOPS4KiB Q32T16 W: 14200 IOPS 4KiB Q1T1 R: 17401 IOPS 4K…

nfs over RDMA zfs-2.0 Mellanox ConnectX-3 infiniband QDR

nfs over RDMA zfs-2.0 Mellanox ConnectX-3 infiniband QDR Seq1M Q8T1 R: 3901MB/s Seq1M Q8T1 W: 1396MB/sSeq128K Q32T1 R: 3883MB/sSeq128K Q32T1 W: 1527MB/s4KiB Q32T16 R: 128000 IOPS4KiB Q32T16 W: 19400 IOPS 4KiB Q1T1 R: 9765 IOPS 4KiB Q1T1 W:…

nfs over RDMA Mellanox ConnectX-3 MCX354A infiniband FDR

nfs over RDMA Mellanox ConnectX-3 MCX354A infiniband FDR Seq Q32T1 R: 6114MB/s Seq Q32T1 W: 5119MB/s 4KiB Q8T8 R: 40537 IOPS 4KiB Q8T8 W: 34990 IOPS 4KiB Q32T1 R: 192003 IOPS 4KiB Q32T1 W: 249708 IOPS 4KiB Q1T1 R: 24458 IOPS 4KiB Q1T1 W: 2…

SMB Direct ConnectX-3 infiniband FDR linux-5.6+kernel CIFS ksmbd-3.2.2

SMB Direct ConnectX-3 infiniband FDR linux-5.6+kernel CIFS ksmbd-3.2.2 Seq Q32T1 R: 2882MB/s Seq Q32T1 W: 3151MB/s 4KiB Q8T8 R: 8435 IOPS 4KiB Q8T8 W: 59187 IOPS 4KiB Q32T1 R: 46723 IOPS 4KiB Q32T1 W: 53348 IOPS 4KiB Q1T1 R: 23333 IOPS 4Ki…

nfs over RDMA Mellanox ConnectX-3 MCX354A infiniband QDR

nfs over RDMA Mellanox ConnectX-3 MCX354A infiniband QDR Seq Q32T1 R: 3928MB/s Seq Q32T1 W: 3919MB/s 4KiB Q8T8 R: 23939 IOPS 4KiB Q8T8 W: 21715 IOPS 4KiB Q32T1 R: 209360 IOPS 4KiB Q32T1 W: 218990 IOPS 4KiB Q1T1 R: 18505 IOPS 4KiB Q1T1 W: 1…

SMB Direct ConnectX-3 infiniband QDR linux-5.6+kernel CIFS ksmbd-3.2.0

SMB Direct ConnectX-3 infiniband QDR linux-5.6+kernel CIFS ksmbd-3.2.0 Seq Q32T1 R: 2523MB/s Seq Q32T1 W: 2705MB/s 4KiB Q8T8 R: 6782 IOPS 4KiB Q8T8 W: 8326 IOPS 4KiB Q32T1 R: 48312 IOPS 4KiB Q32T1 W: 58415 IOPS 4KiB Q1T1 R: 25516 IOPS 4KiB…

QLogic Corp. FastLinQ QL45000 25GbE RDMA

QLogic Corp. FastLinQ QL45000 25GbE RDMAQLogic FastLinQ 4xxxx RDMA Driver qedr 8.42.3.0QLogic 40G/100G ROCE Driver — Taguma (@taguma2) 2020年5月4日 QLogic Corp. FastLinQ QL45000 25GbE RDMArc_rdma_write_bw: bw = 2.89 GB/sec msg_rate = 44.1 …

SMB Direct Mellanox ConnectX-3 MCX354A infiniband FDR Linux client kernel-5.3+Windows Server 2019

SMB Direct Mellanox ConnectX-3 MCX354A infiniband FDR Linux client Seq Q32T1 R: 4090MB/s Seq Q32T1 W: 3837MB/s 4KiB Q8T8 R: 10160 IOPS 4KiB Q8T8 W: 10406 IOPS 4KiB Q32T1 R: 81672 IOPS 4KiB Q32T1 W: 85991 IOPS 4KiB Q1T1 R: 21021 IOPS 4KiB Q…

SMB Direct Mellanox ConnectX-3 MCX354A infiniband QDR Linux client kernel-5.3+Windows Server 2019

SMB Direct Mellanox ConnectX-3 MCX354A infiniband QDR Linux client Seq Q32T1 R: 3520MB/s Seq Q32T1 W: 3520MB/s 4KiB Q8T8 R: 9712 IOPS 4KiB Q8T8 W: 10642 IOPS 4KiB Q32T1 R: 77377 IOPS 4KiB Q32T1 W: 60724 IOPS 4KiB Q1T1 R: 25008 IOPS 4KiB Q1…

SAMSUNG MZVLB512HAJQ 512GB NVMeoF Infiniband QDR Windows Server 2019

SAMSUNG MZVLB512HAJQ 512GB NVMeoF Infiniband QDR Windows Server 2019 pic.twitter.com/QDPiElBZDj — Taguma (@taguma2) October 20, 2019 SAMSUNG MZVLB512HAJQ 512GB NVMeoF Infiniband QDR Windows Server 2019 Seq Q32T1 R: 1936MB/s Seq Q32T1 W: 19…

nfs over RDMA Mellanox ConnectX-3 infiniband QDR solaris 11.4

nfs over RDMA Mellanox ConnectX-3 infiniband QDR solaris 11.4 Seq Q32T1 R: 3090MB/s Seq Q32T1 W: 2890MB/s 4KiB Q8T8 R: 5177 IOPS 4KiB Q8T8 W: 2367 IOPS 4KiB Q32T1 R: 46872 IOPS 4KiB Q32T1 W: 23235 IOPS 4KiB Q1T1 R: 12653 IOPS 4KiB Q1T1 W: …

iSCSI Extensions for RDMA/iSER(MCX456A infiniband EDR)

iSCSI Extensions for RDMA/iSER(MCX456A infiniband EDR) Seq Q32T1 R: 4278MB/s Seq Q32T1 W: 3905MB/s 4KiB Q8T8 R: 21504 IOPS 4KiB Q8T8 W: 17914 IOPS 4KiB Q32T1 R: 145866 IOPS 4KiB Q32T1 W: 179089 IOPS 4KiB Q1T1 R: 38920 IOPS 4KiB Q1T1 W: 552…

nfs over RDMA Mellanox ConnectX-4 MCX456A infiniband EDR

nfs over RDMA Mellanox ConnectX-4 MCX456A infiniband EDR Seq Q32T1 R: 10444MB/s Seq Q32T1 W: 4559MB/s 4KiB Q8T8 R: 29745 IOPS 4KiB Q8T8 W: 13643 IOPS 4KiB Q32T1 R: 198673 IOPS 4KiB Q32T1 W: 133225 IOPS 4KiB Q1T1 R: 28691 IOPS 4KiB Q1T1 W: …

SMB Direct Mellanox ConnectX-4 MCX456A 100GbE RoCE Windows

SMB Direct Mellanox ConnectX-4 MCX456A 100GbE RoCE Windows Server 2016 pic.twitter.com/tqBkrabqoz — Taguma (@taguma2) August 24, 2019 SMB Direct Mellanox ConnectX-4 MCX456A 100GbE RoCE Windows Server 2016 Seq Q32T1 R: 3662MB/s Seq Q32T1 W:…

nfs over RDMA Mellanox ConnectX-4 MCX456A 100GbE RoCE

nfs over RDMA Mellanox ConnectX-4 MCX456A 100GbE RoCE Seq Q32T1 R: 8911MB/s Seq Q32T1 W: 4194MB/s 4KiB Q8T8 R: 26460 IOPS 4KiB Q8T8 W: 12374 IOPS 4KiB Q32T1 R: 191985 IOPS 4KiB Q32T1 W: 139948 IOPS 4KiB Q1T1 R: 30798 IOPS 4KiB Q1T1 W: 2337…

Mellanox ConnectX-4 MCX456A 100GbE RDMA

Mellanox ConnectX-4 MCX456A 100GbE RDMArc_rdma_write_bw: bw = 10.5 GB/sec msg_rate = 161 K/sec send_cost = 22.9 ms/GB recv_cost = 238 us/GB send_cpus_used = 24.1 % cpus recv_cpus_used = 0.25 % cpus — Taguma (@taguma2) August 22, 2019 Mella…

Mellanox ConnectX-4 MCX456A infiniband EDR RDMA

Mellanox ConnectX-4 MCX456A infiniband EDR RDMArc_rdma_write_bw: bw = 11.2 GB/sec msg_rate = 171 K/sec send_cost = 24.6 ms/GB recv_cost = 178 us/GB send_cpus_used = 27.6 % cpus recv_cpus_used = 0.2 % cpus — Taguma (@taguma2) August 21, 201…

Mellanox ConnectX-4 MCX456A infiniband FDR RDMA

Mellanox ConnectX-4 MCX456A infiniband FDR RDMArc_rdma_write_bw: bw = 6.46 GB/sec msg_rate = 98.5 K/sec send_cost = 37 ms/GB recv_cost = 73 ms/GB send_cpus_used = 23.9 % cpus recv_cpus_used = 47.1 % cpus — Taguma (@taguma2) June 9, 2019 Me…

SMB Multichannel+SMB Direct Mellanox ConnectX-3 MCX354A 10GbE RoCE Windows10

SMB Multichannel+SMB Direct Mellanox ConnectX-3 MCX354A 10GbE RoCE Windows10 Client pic.twitter.com/p42igo8NsL — Taguma (@taguma2) May 23, 2019 SMB Multichannel+SMB Direct Mellanox ConnectX-3 MCX354A 10GbE RoCE Windows10 Seq Q32T1 R: 1894M…

SMB Direct Mellanox ConnectX-3 MCX354A 10GbE RoCE Windows10

SMB Direct Mellanox ConnectX-3 MCX354A 10GbE RoCE Windows10 Clinet pic.twitter.com/9OsnXIXahx — Taguma (@taguma2) May 21, 2019 SMB Direct Mellanox ConnectX-3 MCX354A 10GbE RoCE Windows10 Seq Q32T1 R: 1133MB/s Seq Q32T1 W: 1136MB/s 4KiB Q8T…

SMB Direct Mellanox ConnectX-3 MCX354A infiniband QDR Windows10 clinet+Windows Server 2016

SMB Direct Mellanox ConnectX-3 MCX354A infiniband QDR Windows10 clinet+Windows Server 2016 pic.twitter.com/WrWu9Pcq7Z — Taguma (@taguma2) May 21, 2019 SMB Direct Mellanox ConnectX-3 MCX354A infiniband QDR Windows10 Seq Q32T1 R: 3012MB/s Se…