1.2.2. Modern C++ API

The following tests have been performed by executing an RTI Perftest C++11 Publisher and Subscriber between two nodes, connected to a switch via Ethernet. The communication has been restricted to a single interface and the transport has been set to UDPv4.

Find information about the hardware, network, and command-line parameters after each of the tests.

1.2.2.1. Unkeyed, UDPv4 10Gbps Network, C++11

The graph below shows the one-way latency without load between a Publisher and a Subscriber running in two Linux nodes in a 10Gbps network. The numbers are for best-effort as well as strict reliable reliability scenarios.

Note

We use the median (50th percentile) instead of the average in order to get a more stable measurement that does not account for spurious outliers. We also calculate the average value and other percentile values, which can be seen in the Detailed Statistics section below.

Detailed Statistics

The following tables contain the raw numbers presented by RTI Perftest. These numbers are the exact output with no further processing.

  • Best Effort

Sample Size (Bytes)

Ave (μs)

Std (μs)

Min (μs)

Max (μs)

50% (μs)

90% (μs)

99% (μs)

99.99% (μs)

99.9999% (μs)

32

15

0.8

15

47

15

16

17

43

47

64

16

0.9

15

48

16

16

17

45

48

128

16

0.8

15

54

16

16

17

45

54

256

16

1.0

15

66

16

17

18

46

66

512

19

1.6

16

57

19

21

22

47

57

1024

25

3.9

17

67

26

28

33

54

67

2048

29

28.0

20

5004

30

33

40

67

5004

4096

31

20.3

25

4976

30

35

47

68

4976

8192

43

77.0

35

4992

37

55

75

4497

4992

16384

91

24.8

46

154

83

122

128

148

154

32768

156

17.9

76

233

159

175

178

200

233

63000

186

2.8

101

223

186

187

189

215

223

  • Reliable

Sample Size (Bytes)

Ave (μs)

Std (μs)

Min (μs)

Max (μs)

50% (μs)

90% (μs)

99% (μs)

99.99% (μs)

99.9999% (μs)

32

17

1.0

16

77

17

18

21

48

77

64

18

1.2

16

74

17

18

23

47

74

128

17

1.2

16

82

17

18

24

47

82

256

18

1.8

17

56

17

19

27

47

56

512

20

2.7

17

72

19

22

30

48

72

1024

25

4.8

18

81

26

28

42

57

81

2048

29

28.0

20

5004

30

33

40

67

5004

4096

31

20.3

25

4976

30

35

47

68

4976

8192

43

77.0

35

4992

37

55

75

4497

4992

16384

91

24.8

46

154

83

122

128

148

154

32768

156

17.9

76

233

159

175

178

200

233

63000

187

2.8

111

244

187

188

192

217

244

100000

214

6.6

166

274

212

222

225

252

274

500000

610

30.5

515

895

614

648

665

720

895

1048576

1172

57.0

1071

1833

1201

1209

1305

1833

1833

1548576

1699

15.1

1665

2636

1698

1712

1722

2636

2636

4194304

4089

81.9

4041

6977

4081

4094

4489

6977

6977

10485760

10225

239.0

10163

17378

10219

10231

10258

17378

17378

Perftest Scripts

To produce these tests, we executed RTI Perftest for C++11. The exact script used can be found here:

  1#!/bin/bash
  2filename=$0
  3script_location=`cd "\`dirname "$filename"\`"; pwd`
  4
  5export datasizes="32 64 128 256 512 1024 2048 4096 8192 16384 32768 63000"
  6export datasizes_extended="${datasizes} 100000 500000 1048576 1548576 4194304 10485760"
  7
  8export domain="2"
  9export exec_time=20
 10export num_reps=1
 11export instance_number=100000
 12export core=0
 13
 14# We will use some colors to improve visibility of errors and info messages.
 15RED='\033[0;31m'
 16GREEN='\033[0;32m'
 17YELLOW='\033[0;33m'
 18BLUE='\033[0;34m'
 19LIGHTBLUE='\033[0;36m'
 20NC='\033[0m'
 21INFO_TAG="${GREEN}[INFO]:${NC}"
 22WARNING_TAG="${YELLOW}[WARNING]:${NC}"
 23ERROR_TAG="${RED}[ERROR]:${NC}"
 24
 25export ip_machine_1="10.2.75.20"
 26export ip_machine_2="10.2.75.21"
 27export if10Gbps="enp1s0f0"
 28export if1Gbps="eno1"
 29
 30################################################################################
 31
 32function disable_colors() {
 33    export RED=""
 34    export GREEN=""
 35    export YELLOW=""
 36    export NC=""
 37    export BLUE=""
 38    export LIGHTBLUE=""
 39    export INFO_TAG="${GREEN}[INFO]:${NC}"
 40    export WARNING_TAG="${YELLOW}[WARNING]:${NC}"
 41    export ERROR_TAG="${RED}[ERROR]:${NC}"
 42}
 43
 44function change_domain() {
 45    if [[ "$domain" == "1" ]]; then
 46        export domain="2"
 47    else
 48        export domain="1"
 49    fi
 50}
 51
 52# Usage: execute_test <keyed/unkeyed> <rel/be> <datasizes> <batchSize>
 53function execute_test() {
 54
 55    local keyed_unkeyed=$1
 56    local rel_be=$2
 57    local datasizes_test=$3
 58    local other_args=$4
 59    local name_suffix=$5
 60
 61    local commands_string_test=$commands_string
 62    local tag=""
 63
 64    if [[ "${keyed_unkeyed}" == "keyed" ]]; then
 65        commands_string_test="${commands_string_test} -keyed -instances $instance_number"
 66        tag="[${YELLOW}${transport}${NC}|${BLUE}K${NC}|"
 67    else
 68        tag="[${YELLOW}${transport}${NC}|${LIGHTBLUE}UK${NC}|"
 69    fi 
 70
 71    if [[ "${rel_be}" == "be" ]]; then
 72        commands_string_test="${commands_string_test} -bestEffort"
 73        tag="${tag}${YELLOW}BE${NC}]"
 74    else
 75        tag="${tag}${RED}REL${NC}]"
 76    fi
 77
 78    tag="${tag}[${LIGHTBLUE}${lat_thr}${NC}]"
 79
 80    local output_file=$output_folder/${lat_thr}_${role}_${keyed_unkeyed}_${rel_be}${name_suffix}.csv
 81
 82    if [[ "$role" == "pub" ]]; then
 83        echo -e "${YELLOW}[TEST]: $keyed_unkeyed, $rel_be. ${NC}"
 84    fi
 85
 86    if [[ "$LANGUAGE" != "java" && "$LANGUAGE" != "cs" ]]; then
 87        export pre_command_string="taskset -c $core"
 88    fi
 89
 90    # Get the aprox time this will take:
 91    total_tests=$((`wc -w <<< "$datasizes_test"` * num_reps))
 92    total_time=$((total_tests * exec_time))
 93
 94    touch $output_file
 95    local no_headers=""
 96    local current_test=0
 97    for index in $(seq 1 ${num_reps}); do
 98        for DATALEN in ${datasizes_test}; do
 99            current_test=$((current_test + 1))
100            export command="$pre_command_string $executable -domain $domain -dataLen $DATALEN $commands_string_test $other_args $no_headers"
101            if [[ "$role" == "pub" ]]; then
102                echo -e "Test ${tag} (${current_test}/${total_tests}) -- Total time = ${total_time}s"
103                echo -e ${BLUE}$command${NC}
104            else
105                echo -e ${LIGHTBLUE}$command${NC}
106            fi
107            if [[ "$LANGUAGE" == "cs" && "$role" == "pub" ]]; then
108                sleep 3
109            fi
110            $command >> $output_file;
111            no_headers=" -noOutputHeaders"
112            change_domain
113        done
114    done
115}
116
117################################################################################
118# PARSE COMMAND LINE OPTIONS:
119
120while [ "$1" != "" ]; do
121    case $1 in
122        --executable)
123            executable=$2
124            shift
125            ;;
126        --output-folder)
127            output_folder=$2
128            shift
129            ;;
130        --role)
131            export role=$2
132            shift
133            ;;
134        --core)
135            export core=$2
136            shift
137            ;;
138        --test-kind)
139            export lat_thr=$2
140            shift
141            ;;
142        --interface1)
143            export interface=$2
144            shift
145            ;;
146        --interface2)
147            export interface2=$2
148            shift
149            ;;
150        --ip1)
151            export ip1=$2
152            shift
153            ;;
154        --ip2)
155            export ip2=$2
156            shift
157            ;;
158        --repetitions)
159            export num_reps=$2
160            shift
161            ;;
162        --domain)
163            export domain=$2
164            shift
165            ;;
166        --execution-time)
167            export exec_time=$2
168            shift
169            ;;
170        --transport)
171            export transport=$2
172            shift
173            ;;
174        --datalen)
175            export datalen_input=$2
176            shift
177            ;;
178        --file-suffix)
179            export file_suffix=$2
180            shift
181            ;;
182        --extra-arguments)
183            export extra_arguments=$2
184            shift
185            ;;
186        --extra-arguments-pub)
187            export extra_arguments_pub=$2
188            shift
189            ;;
190        --extra-arguments-sub)
191            export extra_arguments_sub=$2
192            shift
193            ;;
194        --skip-no-batching)
195            export skip_no_batching="1"
196            ;;
197        --skip-be)
198            export skip_be_tests="1"
199            ;;
200        --skip-rel)
201            export skip_rel_tests="1"
202            ;;
203        --skip-keyed)
204            export skip_keyed_data="1"
205            ;;
206        --skip-large-data)
207            export skip_large_data="1"
208            ;;
209        --large-data)
210            export large_data="1"
211            ;;
212        --keyed)
213            export skip_unkeyed="1"
214            ;;
215        --unkeyed)
216            export skip_keyed_data="1"
217            ;;
218        --no-batching)
219            export no_batching_only="1"
220            ;;
221        --reliable)
222            export skip_be_tests="1"
223            ;;
224        --best-effort)
225            export skip_rel_tests="1"
226            ;;
227        --security)
228            export security_only="$2"
229            shift
230            ;;
231        --micro)
232            export micro="1"
233            ;;
234        --tss)
235            export tss="1"
236            ;;
237        --no-colors)
238            export NO_COLORS="1"
239            ;;
240        --language)
241            export LANGUAGE=$2
242            shift
243            ;;
244        *)
245            echo -e "unknown parameter \"$1\""
246            exit -1
247            ;;
248    esac
249    shift
250done
251
252if [[ "$NO_COLORS" == "1" ]]; then
253    disable_colors
254fi
255
256export folder_base="$(dirname "${executable}")"/../../..
257
258if [[ $LANGUAGE == "java"  || "$LANGUAGE" == "cs" ]]; then
259    export folder_base="$(dirname "${executable}")"/../..
260fi
261if [[ $tss == "1" ]]; then
262    export folder_base="$(dirname "${executable}")"/../../../../..
263fi
264
265echo -e "${INFO_TAG} Perftest executable is: $executable"
266echo -e "${INFO_TAG} Output folder is: $output_folder"
267
268################################################################################
269
270if [[ "${skip_large_data}" == "1" ]]; then
271    export datasizes_extended=${datasizes}
272elif [[ "${large_data}" == "1" ]]; then
273    export datasizes=${datasizes_extended}
274fi
275
276if [[ "${datalen_input}" != "" ]]; then
277    echo -e "${YELLOW}[TEST] Testing only for ${datalen_input}${NC}"
278    export datasizes=${datalen_input}
279    export datasizes_extended=${datalen_input}
280    if [[ "${no_batching_only}" != "1" ]]; then
281        export skip_large_data="1"
282    fi
283fi
284
285if [[ "$role" != "pub" && "$role" != "sub" ]]; then
286    echo -e "${ERROR_TAG} It must be either publisher or subscriber"
287    exit -1
288fi
289
290if [[ "$lat_thr" != "thr" && "$lat_thr" != "lat" ]]; then
291    echo -e "${ERROR_TAG} It must be either lat or thr"
292    exit -1
293fi
294
295if [[ "${interface}" == "" ]]; then
296    echo "Using default nics"
297    export nic_publisher=${ip_machine_1}
298    export nic_subscriber=${ip_machine_2}
299else
300    export nic_publisher=$interface
301    echo -e "${INFO_TAG} Using nic_publisher: ${nic_publisher}"
302
303    if [[ "${interface2}" == "" ]]; then
304        export nic_subscriber=$interface
305    else
306        export nic_subscriber=$interface2
307    fi
308    echo -e "${INFO_TAG} Using nic_subscriber: ${nic_subscriber}"
309
310    if [[ "${ip1}" != "" ]]; then
311        export ip_publisher=$ip1
312        echo "Using ip_publisher: ${ip_publisher}"
313    fi
314
315    if [[ "${ip2}" != "" ]]; then
316        export ip_subscriber=$ip2
317        echo "Using ip_subscriber: ${ip_subscriber}"
318    fi
319
320fi
321
322export transport_string="-transport $transport"
323
324if [[ "$transport" == "UDPv4" ]]; then
325
326    export transport_string_pub="$transport_string -nic $nic_publisher"
327    export transport_string_sub="$transport_string -nic $nic_subscriber"
328
329    if [[ "$micro" == "1" ]]; then
330        export transport_string_pub="$transport_string_pub -peer ${ip_subscriber}"
331        export transport_string_sub="$transport_string_sub -peer ${ip_publisher}"
332    fi
333
334elif [[ "$transport" == "TCP" ]]; then
335    export transport_string_pub="$transport_string \
336        -nic $nic_publisher \
337        -peer 0@tcpv4_lan://${ip_subscriber}:7400"
338    export transport_string_sub="$transport_string \
339        -nic $nic_subscriber \
340        -peer 0@tcpv4_lan://${ip_publisher}:7400"
341elif [[ "$transport" == "TLS" ]]; then
342    export transport_string_pub="$transport_string \
343        -nic $nic_publisher \
344        -peer tlsv4_lan://${ip_subscriber}:7400"
345    export transport_string_sub="$transport_string \
346        -nic $nic_subscriber \
347        -peer tlsv4_lan://${ip_publisher}:7400"
348elif [[ "$transport" == "UDPv4_WAN" ]]; then
349    export transport_string_pub="$transport_string \
350        -nic $nic_publisher \
351        -transportPublicAddress $ip_publisher:7400"
352    export transport_string_sub="$transport_string \
353        -nic $nic_subscriber \
354        -peer 0@udpv4_wan://${ip_publisher}:7400"
355else
356    export transport_string_pub="$transport_string"
357    export transport_string_sub="$transport_string"
358fi 
359
360################################################################################
361
362export pub_string="-pub \
363        ${transport_string_pub} \
364        -noPrintIntervals \
365        -executionTime $exec_time"
366
367if [[ ${lat_thr} == "lat" ]]; then
368    export pub_string="$pub_string \
369        -latencyTest"
370fi
371
372export sub_string="-sub \
373        ${transport_string_sub} \
374        -noPrintIntervals"
375
376if [[ "$role" == "pub" ]]; then
377    echo -e "$INFO_TAG Publisher side running"
378    export commands_string=${pub_string}
379    export extra_arguments="${extra_arguments} ${extra_arguments_pub}"
380else
381    echo -e "$INFO_TAG Subscriber side running"
382    export commands_string=${sub_string}
383    export extra_arguments="${extra_arguments} ${extra_arguments_sub}"
384fi
385
386###############################################################################
387
388echo -e "${INFO_TAG} Executing: /set_${lat_thr}_mode.sh"
389sudo /set_${lat_thr}_mode.sh
390sleep 5
391
392cd $folder_base
393echo -e "${INFO_TAG} Folder Base is: $PWD"
394mkdir -p $output_folder
395
396# Tests that may use batching (when doing throughput tests)
397if [[ ${no_batching_only} != "1" ]]; then 
398
399    # UNKEYED
400    if [[ "${skip_unkeyed}" == "" ]]; then
401
402        # RELIABLE
403        if [[ "${skip_rel_tests}" == "" ]]; then
404            execute_test "unkeyed" "rel" "${datasizes_extended}" "${extra_arguments}" "$file_suffix"
405        fi
406
407        # BEST EFFORT
408        if [[ "${skip_be_tests}" == "" ]]; then
409            execute_test "unkeyed" "be" "${datasizes}" "${extra_arguments}" "$file_suffix"
410        fi
411    fi
412
413    # KEYED
414    if [[ "${skip_keyed_data}" == "" ]]; then
415
416        # RELIABLE
417        if [[ "${skip_rel_tests}" == "" ]]; then
418            execute_test "keyed" "rel" "${datasizes}" "${extra_arguments}" "$file_suffix"
419        fi
420
421        # BEST EFFORT
422        if [[ "${skip_be_tests}" == "" ]]; then
423            execute_test "keyed" "be" "${datasizes}" "${extra_arguments}" "$file_suffix"
424        fi
425    fi
426
427fi
428
429if [[ "${skip_no_batching}" == "" || "${no_batching_only}" == "1" ]]; then
430    no_batching_tests="1"
431fi 
432
433# Tests that will not use batching
434if [[ "${lat_thr}" == "thr" && "${no_batching_tests}" == "1" ]]; then
435
436    if [[ "$role" == "pub" ]]; then
437        export commands_string="${commands_string} -batchSize 0"
438    fi
439
440    # UNKEYED
441    if [[ "${skip_unkeyed}" == "" ]]; then
442
443        # RELIABLE
444        if [[ "${skip_rel_tests}" == "" ]]; then
445            execute_test "unkeyed" "rel" "${datasizes}" "${extra_arguments}" "_noBatch${file_suffix}"
446        fi
447
448        # BEST EFFORT
449        if [[ "${skip_be_tests}" == "" ]]; then
450            execute_test "unkeyed" "be" "${datasizes}" "${extra_arguments}" "_noBatch${file_suffix}"
451        fi
452    fi
453fi

1#!/bin/bash
2filename=$0
3script_location=`cd "\`dirname "$filename"\`"; pwd`
4
5echo -e "[Calling base_script/script.sh]"
6${script_location}/../base_script/script.sh $@ --transport UDPv4

Test Hardware

The following hardware was used to perform these tests:

Linux Nodes

Dell R340 Servers (13 Units)
Processor: Intel Xeon E-2278G (3.4-5GHz, 8c/16t, 16MB cache, 2 memory channels @2666MHz)
RAM: 4x 16GB 2666MHz DIMM (64GB RAM)
HD: 480GB SATA SSD
NIC 1: Intel 710 dual port 10Gbps SFP
OS: Ubuntu 20.04 -- gcc 9.3.0

Switch

Dell 2048 -- 10Gbps switch

1.2.2.2. Keyed, UDPv4 10Gbps Network, C++11

The graph below shows the one-way latency without load between a Publisher and a Subscriber running in two Linux nodes in a 10Gbps network. The numbers are for best-effort as well as strict reliable reliability scenarios.

Note

We use the median (50th percentile) instead of the average in order to get a more stable measurement that does not account for spurious outliers. We also calculate the average value and other percentile values, which can be seen in the Detailed Statistics section below.

Detailed Statistics

The following tables contain the raw numbers presented by RTI Perftest. These numbers are the exact output with no further processing.

  • Best Effort

Sample Size (Bytes)

Ave (μs)

Std (μs)

Min (μs)

Max (μs)

50% (μs)

90% (μs)

99% (μs)

99.99% (μs)

99.9999% (μs)

32

18

0.9

17

160

18

19

20

48

160

64

18

1.1

17

160

18

19

21

48

160

128

18

1.0

17

160

18

19

21

48

160

256

19

1.1

17

160

19

19

21

48

160

512

19

1.1

18

164

19

20

22

50

164

1024

26

6.8

21

3086

26

28

53

59

3086

2048

29

12.8

23

3936

30

32

46

67

3936

4096

30

1.7

26

171

30

32

34

60

171

8192

45

8.1

38

1252

41

56

75

104

1252

16384

90

28.8

48

261

89

132

145

160

261

32768

177

2.9

72

318

177

178

180

208

318

63000

172

15.0

109

263

168

191

194

220

263

  • Reliable

Sample Size (Bytes)

Ave (μs)

Std (μs)

Min (μs)

Max (μs)

50% (μs)

90% (μs)

99% (μs)

99.99% (μs)

99.9999% (μs)

32

20

1.2

18

159

19

20

24

49

159

64

20

1.2

18

161

19

20

24

49

161

128

20

1.3

18

162

19

20

26

49

162

256

20

1.8

19

160

20

21

28

50

160

512

21

8.1

19

5057

21

24

29

51

5057

1024

26

6.8

21

3086

26

28

53

59

3086

2048

29

12.8

23

3936

30

32

46

67

3936

8192

45

8.1

38

1252

41

56

75

104

1252

32768

173

9.9

78

251

178

180

184

207

251

63000

172

15.0

109

263

168

191

194

220

263

Perftest Scripts

To produce these tests, we executed RTI Perftest for C++11. The exact script used can be found here:

  1#!/bin/bash
  2filename=$0
  3script_location=`cd "\`dirname "$filename"\`"; pwd`
  4
  5export datasizes="32 64 128 256 512 1024 2048 4096 8192 16384 32768 63000"
  6export datasizes_extended="${datasizes} 100000 500000 1048576 1548576 4194304 10485760"
  7
  8export domain="2"
  9export exec_time=20
 10export num_reps=1
 11export instance_number=100000
 12export core=0
 13
 14# We will use some colors to improve visibility of errors and info messages.
 15RED='\033[0;31m'
 16GREEN='\033[0;32m'
 17YELLOW='\033[0;33m'
 18BLUE='\033[0;34m'
 19LIGHTBLUE='\033[0;36m'
 20NC='\033[0m'
 21INFO_TAG="${GREEN}[INFO]:${NC}"
 22WARNING_TAG="${YELLOW}[WARNING]:${NC}"
 23ERROR_TAG="${RED}[ERROR]:${NC}"
 24
 25export ip_machine_1="10.2.75.20"
 26export ip_machine_2="10.2.75.21"
 27export if10Gbps="enp1s0f0"
 28export if1Gbps="eno1"
 29
 30################################################################################
 31
 32function disable_colors() {
 33    export RED=""
 34    export GREEN=""
 35    export YELLOW=""
 36    export NC=""
 37    export BLUE=""
 38    export LIGHTBLUE=""
 39    export INFO_TAG="${GREEN}[INFO]:${NC}"
 40    export WARNING_TAG="${YELLOW}[WARNING]:${NC}"
 41    export ERROR_TAG="${RED}[ERROR]:${NC}"
 42}
 43
 44function change_domain() {
 45    if [[ "$domain" == "1" ]]; then
 46        export domain="2"
 47    else
 48        export domain="1"
 49    fi
 50}
 51
 52# Usage: execute_test <keyed/unkeyed> <rel/be> <datasizes> <batchSize>
 53function execute_test() {
 54
 55    local keyed_unkeyed=$1
 56    local rel_be=$2
 57    local datasizes_test=$3
 58    local other_args=$4
 59    local name_suffix=$5
 60
 61    local commands_string_test=$commands_string
 62    local tag=""
 63
 64    if [[ "${keyed_unkeyed}" == "keyed" ]]; then
 65        commands_string_test="${commands_string_test} -keyed -instances $instance_number"
 66        tag="[${YELLOW}${transport}${NC}|${BLUE}K${NC}|"
 67    else
 68        tag="[${YELLOW}${transport}${NC}|${LIGHTBLUE}UK${NC}|"
 69    fi 
 70
 71    if [[ "${rel_be}" == "be" ]]; then
 72        commands_string_test="${commands_string_test} -bestEffort"
 73        tag="${tag}${YELLOW}BE${NC}]"
 74    else
 75        tag="${tag}${RED}REL${NC}]"
 76    fi
 77
 78    tag="${tag}[${LIGHTBLUE}${lat_thr}${NC}]"
 79
 80    local output_file=$output_folder/${lat_thr}_${role}_${keyed_unkeyed}_${rel_be}${name_suffix}.csv
 81
 82    if [[ "$role" == "pub" ]]; then
 83        echo -e "${YELLOW}[TEST]: $keyed_unkeyed, $rel_be. ${NC}"
 84    fi
 85
 86    if [[ "$LANGUAGE" != "java" && "$LANGUAGE" != "cs" ]]; then
 87        export pre_command_string="taskset -c $core"
 88    fi
 89
 90    # Get the aprox time this will take:
 91    total_tests=$((`wc -w <<< "$datasizes_test"` * num_reps))
 92    total_time=$((total_tests * exec_time))
 93
 94    touch $output_file
 95    local no_headers=""
 96    local current_test=0
 97    for index in $(seq 1 ${num_reps}); do
 98        for DATALEN in ${datasizes_test}; do
 99            current_test=$((current_test + 1))
100            export command="$pre_command_string $executable -domain $domain -dataLen $DATALEN $commands_string_test $other_args $no_headers"
101            if [[ "$role" == "pub" ]]; then
102                echo -e "Test ${tag} (${current_test}/${total_tests}) -- Total time = ${total_time}s"
103                echo -e ${BLUE}$command${NC}
104            else
105                echo -e ${LIGHTBLUE}$command${NC}
106            fi
107            if [[ "$LANGUAGE" == "cs" && "$role" == "pub" ]]; then
108                sleep 3
109            fi
110            $command >> $output_file;
111            no_headers=" -noOutputHeaders"
112            change_domain
113        done
114    done
115}
116
117################################################################################
118# PARSE COMMAND LINE OPTIONS:
119
120while [ "$1" != "" ]; do
121    case $1 in
122        --executable)
123            executable=$2
124            shift
125            ;;
126        --output-folder)
127            output_folder=$2
128            shift
129            ;;
130        --role)
131            export role=$2
132            shift
133            ;;
134        --core)
135            export core=$2
136            shift
137            ;;
138        --test-kind)
139            export lat_thr=$2
140            shift
141            ;;
142        --interface1)
143            export interface=$2
144            shift
145            ;;
146        --interface2)
147            export interface2=$2
148            shift
149            ;;
150        --ip1)
151            export ip1=$2
152            shift
153            ;;
154        --ip2)
155            export ip2=$2
156            shift
157            ;;
158        --repetitions)
159            export num_reps=$2
160            shift
161            ;;
162        --domain)
163            export domain=$2
164            shift
165            ;;
166        --execution-time)
167            export exec_time=$2
168            shift
169            ;;
170        --transport)
171            export transport=$2
172            shift
173            ;;
174        --datalen)
175            export datalen_input=$2
176            shift
177            ;;
178        --file-suffix)
179            export file_suffix=$2
180            shift
181            ;;
182        --extra-arguments)
183            export extra_arguments=$2
184            shift
185            ;;
186        --extra-arguments-pub)
187            export extra_arguments_pub=$2
188            shift
189            ;;
190        --extra-arguments-sub)
191            export extra_arguments_sub=$2
192            shift
193            ;;
194        --skip-no-batching)
195            export skip_no_batching="1"
196            ;;
197        --skip-be)
198            export skip_be_tests="1"
199            ;;
200        --skip-rel)
201            export skip_rel_tests="1"
202            ;;
203        --skip-keyed)
204            export skip_keyed_data="1"
205            ;;
206        --skip-large-data)
207            export skip_large_data="1"
208            ;;
209        --large-data)
210            export large_data="1"
211            ;;
212        --keyed)
213            export skip_unkeyed="1"
214            ;;
215        --unkeyed)
216            export skip_keyed_data="1"
217            ;;
218        --no-batching)
219            export no_batching_only="1"
220            ;;
221        --reliable)
222            export skip_be_tests="1"
223            ;;
224        --best-effort)
225            export skip_rel_tests="1"
226            ;;
227        --security)
228            export security_only="$2"
229            shift
230            ;;
231        --micro)
232            export micro="1"
233            ;;
234        --tss)
235            export tss="1"
236            ;;
237        --no-colors)
238            export NO_COLORS="1"
239            ;;
240        --language)
241            export LANGUAGE=$2
242            shift
243            ;;
244        *)
245            echo -e "unknown parameter \"$1\""
246            exit -1
247            ;;
248    esac
249    shift
250done
251
252if [[ "$NO_COLORS" == "1" ]]; then
253    disable_colors
254fi
255
256export folder_base="$(dirname "${executable}")"/../../..
257
258if [[ $LANGUAGE == "java"  || "$LANGUAGE" == "cs" ]]; then
259    export folder_base="$(dirname "${executable}")"/../..
260fi
261if [[ $tss == "1" ]]; then
262    export folder_base="$(dirname "${executable}")"/../../../../..
263fi
264
265echo -e "${INFO_TAG} Perftest executable is: $executable"
266echo -e "${INFO_TAG} Output folder is: $output_folder"
267
268################################################################################
269
270if [[ "${skip_large_data}" == "1" ]]; then
271    export datasizes_extended=${datasizes}
272elif [[ "${large_data}" == "1" ]]; then
273    export datasizes=${datasizes_extended}
274fi
275
276if [[ "${datalen_input}" != "" ]]; then
277    echo -e "${YELLOW}[TEST] Testing only for ${datalen_input}${NC}"
278    export datasizes=${datalen_input}
279    export datasizes_extended=${datalen_input}
280    if [[ "${no_batching_only}" != "1" ]]; then
281        export skip_large_data="1"
282    fi
283fi
284
285if [[ "$role" != "pub" && "$role" != "sub" ]]; then
286    echo -e "${ERROR_TAG} It must be either publisher or subscriber"
287    exit -1
288fi
289
290if [[ "$lat_thr" != "thr" && "$lat_thr" != "lat" ]]; then
291    echo -e "${ERROR_TAG} It must be either lat or thr"
292    exit -1
293fi
294
295if [[ "${interface}" == "" ]]; then
296    echo "Using default nics"
297    export nic_publisher=${ip_machine_1}
298    export nic_subscriber=${ip_machine_2}
299else
300    export nic_publisher=$interface
301    echo -e "${INFO_TAG} Using nic_publisher: ${nic_publisher}"
302
303    if [[ "${interface2}" == "" ]]; then
304        export nic_subscriber=$interface
305    else
306        export nic_subscriber=$interface2
307    fi
308    echo -e "${INFO_TAG} Using nic_subscriber: ${nic_subscriber}"
309
310    if [[ "${ip1}" != "" ]]; then
311        export ip_publisher=$ip1
312        echo "Using ip_publisher: ${ip_publisher}"
313    fi
314
315    if [[ "${ip2}" != "" ]]; then
316        export ip_subscriber=$ip2
317        echo "Using ip_subscriber: ${ip_subscriber}"
318    fi
319
320fi
321
322export transport_string="-transport $transport"
323
324if [[ "$transport" == "UDPv4" ]]; then
325
326    export transport_string_pub="$transport_string -nic $nic_publisher"
327    export transport_string_sub="$transport_string -nic $nic_subscriber"
328
329    if [[ "$micro" == "1" ]]; then
330        export transport_string_pub="$transport_string_pub -peer ${ip_subscriber}"
331        export transport_string_sub="$transport_string_sub -peer ${ip_publisher}"
332    fi
333
334elif [[ "$transport" == "TCP" ]]; then
335    export transport_string_pub="$transport_string \
336        -nic $nic_publisher \
337        -peer 0@tcpv4_lan://${ip_subscriber}:7400"
338    export transport_string_sub="$transport_string \
339        -nic $nic_subscriber \
340        -peer 0@tcpv4_lan://${ip_publisher}:7400"
341elif [[ "$transport" == "TLS" ]]; then
342    export transport_string_pub="$transport_string \
343        -nic $nic_publisher \
344        -peer tlsv4_lan://${ip_subscriber}:7400"
345    export transport_string_sub="$transport_string \
346        -nic $nic_subscriber \
347        -peer tlsv4_lan://${ip_publisher}:7400"
348elif [[ "$transport" == "UDPv4_WAN" ]]; then
349    export transport_string_pub="$transport_string \
350        -nic $nic_publisher \
351        -transportPublicAddress $ip_publisher:7400"
352    export transport_string_sub="$transport_string \
353        -nic $nic_subscriber \
354        -peer 0@udpv4_wan://${ip_publisher}:7400"
355else
356    export transport_string_pub="$transport_string"
357    export transport_string_sub="$transport_string"
358fi 
359
360################################################################################
361
362export pub_string="-pub \
363        ${transport_string_pub} \
364        -noPrintIntervals \
365        -executionTime $exec_time"
366
367if [[ ${lat_thr} == "lat" ]]; then
368    export pub_string="$pub_string \
369        -latencyTest"
370fi
371
372export sub_string="-sub \
373        ${transport_string_sub} \
374        -noPrintIntervals"
375
376if [[ "$role" == "pub" ]]; then
377    echo -e "$INFO_TAG Publisher side running"
378    export commands_string=${pub_string}
379    export extra_arguments="${extra_arguments} ${extra_arguments_pub}"
380else
381    echo -e "$INFO_TAG Subscriber side running"
382    export commands_string=${sub_string}
383    export extra_arguments="${extra_arguments} ${extra_arguments_sub}"
384fi
385
386###############################################################################
387
388echo -e "${INFO_TAG} Executing: /set_${lat_thr}_mode.sh"
389sudo /set_${lat_thr}_mode.sh
390sleep 5
391
392cd $folder_base
393echo -e "${INFO_TAG} Folder Base is: $PWD"
394mkdir -p $output_folder
395
396# Tests that may use batching (when doing throughput tests)
397if [[ ${no_batching_only} != "1" ]]; then 
398
399    # UNKEYED
400    if [[ "${skip_unkeyed}" == "" ]]; then
401
402        # RELIABLE
403        if [[ "${skip_rel_tests}" == "" ]]; then
404            execute_test "unkeyed" "rel" "${datasizes_extended}" "${extra_arguments}" "$file_suffix"
405        fi
406
407        # BEST EFFORT
408        if [[ "${skip_be_tests}" == "" ]]; then
409            execute_test "unkeyed" "be" "${datasizes}" "${extra_arguments}" "$file_suffix"
410        fi
411    fi
412
413    # KEYED
414    if [[ "${skip_keyed_data}" == "" ]]; then
415
416        # RELIABLE
417        if [[ "${skip_rel_tests}" == "" ]]; then
418            execute_test "keyed" "rel" "${datasizes}" "${extra_arguments}" "$file_suffix"
419        fi
420
421        # BEST EFFORT
422        if [[ "${skip_be_tests}" == "" ]]; then
423            execute_test "keyed" "be" "${datasizes}" "${extra_arguments}" "$file_suffix"
424        fi
425    fi
426
427fi
428
429if [[ "${skip_no_batching}" == "" || "${no_batching_only}" == "1" ]]; then
430    no_batching_tests="1"
431fi 
432
433# Tests that will not use batching
434if [[ "${lat_thr}" == "thr" && "${no_batching_tests}" == "1" ]]; then
435
436    if [[ "$role" == "pub" ]]; then
437        export commands_string="${commands_string} -batchSize 0"
438    fi
439
440    # UNKEYED
441    if [[ "${skip_unkeyed}" == "" ]]; then
442
443        # RELIABLE
444        if [[ "${skip_rel_tests}" == "" ]]; then
445            execute_test "unkeyed" "rel" "${datasizes}" "${extra_arguments}" "_noBatch${file_suffix}"
446        fi
447
448        # BEST EFFORT
449        if [[ "${skip_be_tests}" == "" ]]; then
450            execute_test "unkeyed" "be" "${datasizes}" "${extra_arguments}" "_noBatch${file_suffix}"
451        fi
452    fi
453fi

1#!/bin/bash
2filename=$0
3script_location=`cd "\`dirname "$filename"\`"; pwd`
4
5echo -e "[Calling base_script/script.sh]"
6${script_location}/../base_script/script.sh $@ --transport UDPv4

Test Hardware

The following hardware was used to perform these tests:

Linux Nodes

Dell R340 Servers (13 Units)
Processor: Intel Xeon E-2278G (3.4-5GHz, 8c/16t, 16MB cache, 2 memory channels @2666MHz)
RAM: 4x 16GB 2666MHz DIMM (64GB RAM)
HD: 480GB SATA SSD
NIC 1: Intel 710 dual port 10Gbps SFP
OS: Ubuntu 20.04 -- gcc 9.3.0

Switch

Dell 2048 -- 10Gbps switch