How to measure your dataflow using fio, pktgen and bandwidthTest 2018/04/12 SAKURA Internet, Inc. Research Center SR / Naoto MATSUMOTO

1. How to measure your dataflow
using fio, dpdk-pktgen
and bandwidthTest
2018/04/12 SAKURA Internet, Inc. Research Center SR / Naoto MATSUMOTO
(C) Copyright 1996-2018 SAKURA Internet Inc

2. How to measure your dataflow using fio, pktgen and bandwidthTest
2
WRITE: 12,648MB/s (bs=256KB)
READ: 13,793MB/s (bs=256KB)
RAMDISK DDR4 2133MHz 16GB x4
40Mpps (pkt=64B) 2,560MB/s
40GbE (max rate) 5,000MB/s
Mellanox Connect X-4
Intel(R) Core(TM)
i7-7800X CPU @ 3.50GHz
WRITE: 12,648MB/s (bs=256KB)
READ: 13,793MB/s (bs=256KB)
RAMDISK DDR4 2133MHz 16GB x4
Intel(R) Core(TM)
i7-7800X CPU @ 3.50GHz
# cd /opt
# git clone git://dpdk.org/dpdk
# git clone git://dpdk.org/apps/pktgen-dpdk
export RTE_SDK=/opt/dpdk
export RTE_TARGET=x86_64-native-linuxapp-gcc
# sysctl vm.nr_hugepages=2048
# cd /opt/dpdk
# make install T=x86_64-native-linuxapp-gcc
# /opt/dpdk/usertools/dpdk-devbind.py -u 0b:00.0
# /opt/dpdk/usertools/dpdk-devbind.py -u 13:00.0
# /opt/dpdk/usertools/dpdk-devbind.py -b igb_uio 0b:00.0
# /opt/dpdk/usertools/dpdk-devbind.py -b igb_uio 13:00.0
# /opt/dpdk/usertools/dpdk-devbind.py --status
# cd /opt/pktgen-dpdk/
# make
# /opt/pktgen-dpdk/tools/setup.sh
# /opt/pktgen-dpdk/app/x86_64-native-linuxapp-gcc/pktgen -- -m "1.0, 2.1"
Intel(R) Core(TM)
i7-7800X CPU @ 3.50GHz
Host to Device: 6,029MB/s
Device to Host: 6,448MB/s
GeForce GTX 1050
WRITE: 2,000MB/s (bs=4KB)
READ: 2,500MB/s (bs=4KB)
IntelOpate 900P (3DXP)
WRITE: 2,000MB/s (bs=4KB)
READ: 2,500MB/s (bs=4KB)
IntelOpate 900P (3DXP)
# mount -t tmpfs -o size=32G tmpfs /ramdisk
# fio --directory=/ramdisk --rw=write --bs=4k --size=1G --numjobs=3
--runtime=100 --group_reporting --name=data
# bash cuda_9.1.85_387.26_linux.run --silent --toolkit --override
--no-opengl-libs --driver
:
# cd NVIDIA_CUDA-9.1_Samples/1_Utilities/bandwidthTest
# ./bandwidthTest