1.2.3. Java API

The following tests have been performed by executing an RTI Perftest Java Publisher and Subscriber between two nodes, connected to a switch via Ethernet. The communication has been restricted to a single interface and the transport has been set to UDPv4.

Find information about the hardware, network, and command-line parameters after each of the tests.

1.2.3.1. Unkeyed, UDPv4 10Gbps Network, Java

Linux x64

Minimum LatencyMaximum Throughput

The graph below shows the one-way latency without load between a Publisher and a Subscriber running in two Linux nodes in a 10Gbps network. The numbers are for best-effort as well as strict reliable reliability scenarios.

Note

We use the median (50th percentile) instead of the average in order to get a more stable measurement that does not account for spurious outliers. We also calculate the average value and other percentile values, which can be seen in the Detailed Statistics section below.

Detailed Statistics

The following tables contain the raw numbers presented by RTI Perftest. These numbers are the exact output with no further processing.

• Best Effort

Sample Size (Bytes)	Ave (us)	Std (us)	Min (us)	Max (us)	50% (μs)	90% (us)	99% (us)	99.99% (us)	99.9999% (us)
32	19	5.8	18	2501	19	20	23	18	18
64	20	5.8	18	2589	19	20	23	18	18
128	20	5.6	19	2234	20	20	24	19	19
256	21	132.6	19	87444	20	21	24	19	19
512	20	6.0	19	2479	20	21	24	19	19
1024	26	7.4	21	2848	26	28	30	21	21
2048	49	228.2	23	100112	49	64	78	23	23
4096	34	135.9	28	100102	30	51	64	28	28
8192	46	11.0	39	2483	41	59	62	39	39
16384	96	26.7	50	2456	85	129	135	50	50
32768	168	18.7	79	2385	168	186	190	79	79
63000	193	14.4	113	2570	193	195	202	113	113

• Reliable

Sample Size (Bytes)	Ave (us)	Std (us)	Min (us)	Max (us)	50% (μs)	90% (us)	99% (us)	99.99% (us)	99.9999% (us)
32	21	7.6	20	2969	21	22	25	20	20
64	21	6.0	20	2488	21	22	26	20	20
128	21	5.7	20	2256	21	22	24	20	20
256	22	6.1	20	2446	21	22	28	20	20
512	23	6.1	21	2438	22	23	27	21	21
1024	27	7.4	22	2201	26	29	55	22	22
2048	31	36.1	24	4984	30	34	57	24	24
4096	33	42.4	29	4993	31	34	64	29	29
8192	48	24.4	40	9582	43	60	85	40	40
16384	94	29.7	51	2925	93	134	152	51	51
32768	170	20.1	86	2353	171	188	191	86	86
63000	177	19.8	148	2446	176	195	199	148	148

Perftest Scripts

To produce these tests, we executed RTI Perftest for Java. The exact script used can be found here:

echo EXECUTABLE IS $1
export executable=$1

export folder_base="$(dirname "${executable}")"/../..

echo OUTPUT PATH IS $2
export output_folder=$2
export pub_sub="pub"
export lat_thr="lat"
export num_reps="1 2"
export dataLens="32 64 128 256 512 1024 2048 4096 8192 16384 32768 63000"
export domain="2"

if [[ -z "$3" ]]; then
    echo "You need a third argument with publisher or subscriber"
    exit -1
else
    if [[ "$3" == "publisher" ]]; then
        echo "Publisher"
        export pub_sub="pub"
        
    elif [[ "$3" == "subscriber" ]]; then
        echo "Subscriber"
        export pub_sub="sub"
    else
        echo "It must be either publisher or subscriber"
        exit -1
    fi
fi

if [[ -z "$4" ]]; then
    echo "You need a forth argument with lat or thr"
    exit -1
else
    if [[ "$4" == "thr" ]]; then
        echo "Throughput test"
        export ${lat_thr}_thr="thr"
        
    elif [[ "$4" == "lat" ]]; then
        echo "Latency test"
        export ${lat_thr}_thr="lat"
    else
        echo "It must be either lat or thr"
        exit -1
    fi
fi

if [[ -z "$5" ]]; then
    echo "Using default nics"
    export nic1=172.16.0.1
    export nic2=172.16.0.2
else
    echo "Using custom nic: $5"
    export nic1=$5
    export nic2=$5
fi

sudo /set_${lat_thr}_mode.sh
sleep 10

export exec_time=20

export pub_string="-pub \
        -transport UDPv4 \
        -nic $nic1 \
        -noPrint \
        -exec $exec_time"

if [[ ${lat_thr} == "lat" ]]; then
    export pub_string="$pub_string \
        -latencyTest"
fi

export sub_string="-sub \
        -transport UDPv4 \
        -nic $nic2 \
        -noPrint"

if [[ "$pub_sub" == "pub" ]]; then
    echo "Publisher side"
    export commands_string=${pub_string}
else
    echo "Subscriber side"
    export commands_string=${sub_string}
fi


cd $folder_base
mkdir -p $output_folder

export my_file=$output_folder/${lat_thr}_${pub_sub}_unkeyed_rel.csv
touch $my_file
export extra_args=""
for index in ${num_reps}; do
    for DATALEN in ${dataLens}; do
        export command="$executable -domain $domain -datalen $DATALEN $commands_string $extra_args"
        echo $command ---- $index
        $command >> $my_file;
        if [[ "$domain" == "1" ]]; then
            export domain="2"
        else
            export domain="1"
        fi
        export extra_args=" -noOutputHeaders "
    done
done

export my_file=$output_folder/${lat_thr}_${pub_sub}_unkeyed_be.csv
touch $my_file
export extra_args=""
for index in ${num_reps}; do
    for DATALEN in ${dataLens}; do
        export command="$executable -domain $domain -datalen $DATALEN -best $commands_string $extra_args"
        echo $command ---- $index
        $command >> $my_file;
        if [[ "$domain" == "1" ]]; then
            export domain="2"
        else
            export domain="1"
        fi
        export extra_args=" -noOutputHeaders "
    done
done

export my_file=$output_folder/${lat_thr}_${pub_sub}_keyed_rel.csv
touch $my_file
export extra_args=""
for index in ${num_reps}; do
    for DATALEN in ${dataLens}; do
        export command="$executable -domain $domain -datalen $DATALEN -keyed -instances 100000 $commands_string $extra_args"
        echo $command ---- $index
        $command >> $my_file;
        if [[ "$domain" == "1" ]]; then
            export domain="2"
        else
            export domain="1"
        fi
        export extra_args=" -noOutputHeaders "
    done
done

export my_file=$output_folder/${lat_thr}_${pub_sub}_keyed_be.csv
touch $my_file
export extra_args=""
for index in ${num_reps}; do
    for DATALEN in ${dataLens}; do
        export command="$executable -domain $domain -datalen $DATALEN -keyed -instances 100000 -best $commands_string $extra_args"
        echo $command ---- $index
        $command >> $my_file;
        if [[ "$domain" == "1" ]]; then
            export domain="2"
        else
            export domain="1"
        fi
        export extra_args=" -noOutputHeaders "
    done
done

# if [[ ${lat_thr} == "thr" ]]; then

#     if [[ "$pub_sub" == "pub" ]]; then
#         echo "Publisher side"
#         export commands_string="${commands_string} -batchSize 0"
#     fi

#     export my_file=$output_folder/${lat_thr}_${pub_sub}_unkeyed_be_noBatch.csv
#     touch $my_file
#     export extra_args=""
#     for index in ${num_reps}; do
#         for DATALEN in ${dataLens}; do
#             export command="    $executable -domain $domain -datalen $DATALEN -best $commands_string $extra_args"
#             echo $command ---- $index
#             $command >> $my_file;
#             if [[ "$domain" == "1" ]]; then
#                 export domain="2"
#             else
#                 export domain="1"
#             fi
#             export extra_args=" -noOutputHeaders "
#         done
#     done

#     export my_file=$output_folder/${lat_thr}_${pub_sub}_unkeyed_rel_noBatch.csv
#     touch $my_file
#     export extra_args=""
#     for index in ${num_reps}; do
#         for DATALEN in ${dataLens}; do
#             export command="    $executable -domain $domain -datalen $DATALEN $commands_string $extra_args"
#             echo $command ---- $index
#             $command >> $my_file;
#             if [[ "$domain" == "1" ]]; then
#                 export domain="2"
#             else
#                 export domain="1"
#             fi
#             export extra_args=" -noOutputHeaders "
#         done
#     done

# fi

Test Software

The following software was used to perform these tests:

RTI Connext DDS 7.0.0 Host and Target Libraries for x64 Linux (x64Linux4gcc7.3.0)

Test Hardware

The following hardware was used to perform these tests:

Linux Nodes

Dell R340 Servers (13 Units)
Processor: Intel Xeon E-2278G (3.4-5GHz, 8c/16t, 16MB cache, 2 memory channels @2666MHz)
RAM: 4x 16GB 2666MHz DIMM (64GB RAM)
HD: 480GB SATA SSD
NIC 1: Intel 710 dual port 10Gbps SFP
OS: Ubuntu 20.04 -- gcc 9.3.0

Switch

Dell 2048 -- 10Gbps switch

1.2.3.2. Keyed, UDPv4 10Gbps Network, Java

Linux x64

Minimum LatencyMaximum Throughput

The graph below shows the one-way latency without load between a Publisher and a Subscriber running in two Linux nodes in a 10Gbps network. The numbers are for best-effort as well as strict reliable reliability scenarios.

Note

We use the median (50th percentile) instead of the average in order to get a more stable measurement that does not account for spurious outliers. We also calculate the average value and other percentile values, which can be seen in the Detailed Statistics section below.

Detailed Statistics

The following tables contain the raw numbers presented by RTI Perftest. These numbers are the exact output with no further processing.

• Best Effort

Sample Size (Bytes)	Ave (us)	Std (us)	Min (us)	Max (us)	50% (μs)	90% (us)	99% (us)	99.99% (us)	99.9999% (us)
32	23	149.8	21	82639	22	24	26	21	21
64	23	148.3	21	80660	22	24	26	21	21
128	23	141.4	21	74572	22	24	26	21	21
256	23	145.8	21	77213	22	24	26	21	21
512	24	160.1	22	87385	23	25	27	22	22
1024	27	158.7	23	77786	26	28	29	23	23
2048	49	342.4	25	100147	46	65	76	25	25
4096	47	293.4	31	100146	43	63	65	31	31
8192	49	174.8	42	77736	45	59	62	42	42
16384	100	25.4	53	265	89	135	142	53	53
32768	183	2.6	83	259	183	185	188	83	83
63000	198	2.8	114	273	198	199	202	114	114

• Reliable

Sample Size (Bytes)	Ave (us)	Std (us)	Min (us)	Max (us)	50% (μs)	90% (us)	99% (us)	99.99% (us)	99.9999% (us)
32	24	144.6	22	77017	24	25	27	22	22
64	25	158.8	23	85518	24	26	27	23	23
128	24	148.8	22	80069	24	25	26	22	22
256	25	145.9	23	75280	24	25	29	23	23
512	26	148.6	24	72971	25	27	30	24	24
1024	28	156.5	24	76960	27	29	35	24	24
2048	32	179.1	27	83329	30	34	56	27	27
4096	37	200.8	31	85327	34	38	66	31	31
8192	51	209.2	43	76057	46	60	91	43	43
16384	100	28.0	54	185	96	139	162	54	54
32768	174	15.5	115	240	183	186	189	115	115
63000	198	2.7	123	272	198	200	205	123	123

Perftest Scripts

To produce these tests, we executed RTI Perftest for Java. The exact script used can be found here:

echo EXECUTABLE IS $1
export executable=$1

export folder_base="$(dirname "${executable}")"/../..

echo OUTPUT PATH IS $2
export output_folder=$2
export pub_sub="pub"
export lat_thr="lat"
export num_reps="1 2"
export dataLens="32 64 128 256 512 1024 2048 4096 8192 16384 32768 63000"
export domain="2"

if [[ -z "$3" ]]; then
    echo "You need a third argument with publisher or subscriber"
    exit -1
else
    if [[ "$3" == "publisher" ]]; then
        echo "Publisher"
        export pub_sub="pub"
        
    elif [[ "$3" == "subscriber" ]]; then
        echo "Subscriber"
        export pub_sub="sub"
    else
        echo "It must be either publisher or subscriber"
        exit -1
    fi
fi

if [[ -z "$4" ]]; then
    echo "You need a forth argument with lat or thr"
    exit -1
else
    if [[ "$4" == "thr" ]]; then
        echo "Throughput test"
        export ${lat_thr}_thr="thr"
        
    elif [[ "$4" == "lat" ]]; then
        echo "Latency test"
        export ${lat_thr}_thr="lat"
    else
        echo "It must be either lat or thr"
        exit -1
    fi
fi

if [[ -z "$5" ]]; then
    echo "Using default nics"
    export nic1=172.16.0.1
    export nic2=172.16.0.2
else
    echo "Using custom nic: $5"
    export nic1=$5
    export nic2=$5
fi

sudo /set_${lat_thr}_mode.sh
sleep 10

export exec_time=20

export pub_string="-pub \
        -transport UDPv4 \
        -nic $nic1 \
        -noPrint \
        -exec $exec_time"

if [[ ${lat_thr} == "lat" ]]; then
    export pub_string="$pub_string \
        -latencyTest"
fi

export sub_string="-sub \
        -transport UDPv4 \
        -nic $nic2 \
        -noPrint"

if [[ "$pub_sub" == "pub" ]]; then
    echo "Publisher side"
    export commands_string=${pub_string}
else
    echo "Subscriber side"
    export commands_string=${sub_string}
fi


cd $folder_base
mkdir -p $output_folder

export my_file=$output_folder/${lat_thr}_${pub_sub}_unkeyed_rel.csv
touch $my_file
export extra_args=""
for index in ${num_reps}; do
    for DATALEN in ${dataLens}; do
        export command="$executable -domain $domain -datalen $DATALEN $commands_string $extra_args"
        echo $command ---- $index
        $command >> $my_file;
        if [[ "$domain" == "1" ]]; then
            export domain="2"
        else
            export domain="1"
        fi
        export extra_args=" -noOutputHeaders "
    done
done

export my_file=$output_folder/${lat_thr}_${pub_sub}_unkeyed_be.csv
touch $my_file
export extra_args=""
for index in ${num_reps}; do
    for DATALEN in ${dataLens}; do
        export command="$executable -domain $domain -datalen $DATALEN -best $commands_string $extra_args"
        echo $command ---- $index
        $command >> $my_file;
        if [[ "$domain" == "1" ]]; then
            export domain="2"
        else
            export domain="1"
        fi
        export extra_args=" -noOutputHeaders "
    done
done

export my_file=$output_folder/${lat_thr}_${pub_sub}_keyed_rel.csv
touch $my_file
export extra_args=""
for index in ${num_reps}; do
    for DATALEN in ${dataLens}; do
        export command="$executable -domain $domain -datalen $DATALEN -keyed -instances 100000 $commands_string $extra_args"
        echo $command ---- $index
        $command >> $my_file;
        if [[ "$domain" == "1" ]]; then
            export domain="2"
        else
            export domain="1"
        fi
        export extra_args=" -noOutputHeaders "
    done
done

export my_file=$output_folder/${lat_thr}_${pub_sub}_keyed_be.csv
touch $my_file
export extra_args=""
for index in ${num_reps}; do
    for DATALEN in ${dataLens}; do
        export command="$executable -domain $domain -datalen $DATALEN -keyed -instances 100000 -best $commands_string $extra_args"
        echo $command ---- $index
        $command >> $my_file;
        if [[ "$domain" == "1" ]]; then
            export domain="2"
        else
            export domain="1"
        fi
        export extra_args=" -noOutputHeaders "
    done
done

# if [[ ${lat_thr} == "thr" ]]; then

#     if [[ "$pub_sub" == "pub" ]]; then
#         echo "Publisher side"
#         export commands_string="${commands_string} -batchSize 0"
#     fi

#     export my_file=$output_folder/${lat_thr}_${pub_sub}_unkeyed_be_noBatch.csv
#     touch $my_file
#     export extra_args=""
#     for index in ${num_reps}; do
#         for DATALEN in ${dataLens}; do
#             export command="    $executable -domain $domain -datalen $DATALEN -best $commands_string $extra_args"
#             echo $command ---- $index
#             $command >> $my_file;
#             if [[ "$domain" == "1" ]]; then
#                 export domain="2"
#             else
#                 export domain="1"
#             fi
#             export extra_args=" -noOutputHeaders "
#         done
#     done

#     export my_file=$output_folder/${lat_thr}_${pub_sub}_unkeyed_rel_noBatch.csv
#     touch $my_file
#     export extra_args=""
#     for index in ${num_reps}; do
#         for DATALEN in ${dataLens}; do
#             export command="    $executable -domain $domain -datalen $DATALEN $commands_string $extra_args"
#             echo $command ---- $index
#             $command >> $my_file;
#             if [[ "$domain" == "1" ]]; then
#                 export domain="2"
#             else
#                 export domain="1"
#             fi
#             export extra_args=" -noOutputHeaders "
#         done
#     done

# fi

Test Software

The following software was used to perform these tests:

RTI Connext DDS 7.0.0 Host and Target Libraries for x64 Linux (x64Linux4gcc7.3.0)

Test Hardware

The following hardware was used to perform these tests:

Linux Nodes

Dell R340 Servers (13 Units)
Processor: Intel Xeon E-2278G (3.4-5GHz, 8c/16t, 16MB cache, 2 memory channels @2666MHz)
RAM: 4x 16GB 2666MHz DIMM (64GB RAM)
HD: 480GB SATA SSD
NIC 1: Intel 710 dual port 10Gbps SFP
OS: Ubuntu 20.04 -- gcc 9.3.0

Switch

Dell 2048 -- 10Gbps switch