2.2.3. Java API

The following tests have been performed by executing an RTI Perftest Java Publisher and Subscriber between two nodes, connected to a switch via Ethernet. The communication has been restricted to a single interface and the transport has been set to UDPv4.

Find information about the hardware, network, and command-line parameters after each of the tests.

2.2.3.1. Unkeyed, UDPv4 10Gbps Network, Java

Linux x64

Minimum LatencyMaximum Throughput

The graph below shows the one-way latency without load between a Publisher and a Subscriber running in two Linux nodes in a 10Gbps network. The numbers are for best-effort as well as strict reliable reliability scenarios.

Note

We use the median (50th percentile) instead of the average in order to get a more stable measurement that does not account for spurious outliers. We also calculate the average value and other percentile values, which can be seen in the Detailed Statistics section below.

Detailed Statistics

The following tables contain the raw numbers presented by RTI Perftest. These numbers are the exact output with no further processing.

• Best Effort

Sample Size (Bytes)	Ave (us)	Std (us)	Min (us)	Max (us)	50% (μs)	90% (us)	99% (us)	99.99% (us)	99.9999% (us)
32	19	5.7	18	2432	19	19	22	18	18
64	19	5.7	18	2420	19	20	23	18	18
128	19	5.6	18	2371	19	20	23	18	18
256	20	5.7	19	2383	20	20	24	19	19
512	20	5.7	19	2262	20	21	23	19	19
1024	26	7.0	20	2499	27	28	29	20	20
2048	49	284.8	23	100085	48	62	70	23	23
4096	32	131.7	27	100100	30	35	63	27	27
8192	46	11.2	38	2368	42	59	62	38	38
16384	91	24.7	49	2362	90	127	147	49	49
32768	179	13.9	101	2448	179	181	187	101	101
63000	193	14.7	137	2462	192	195	200	137	137

• Reliable

Sample Size (Bytes)	Ave (us)	Std (us)	Min (us)	Max (us)	50% (μs)	90% (us)	99% (us)	99.99% (us)	99.9999% (us)
32	20	5.7	19	2244	20	21	24	19	19
64	21	5.8	19	2324	21	21	24	19	19
128	21	5.8	20	2170	21	22	25	20	20
256	22	9.9	20	5050	21	22	28	20	20
512	22	9.8	20	5052	22	24	27	20	20
1024	26	14.1	21	5055	26	29	46	21	21
2048	30	38.7	24	4999	30	33	52	24	24
4096	33	40.3	28	4986	31	34	63	28	28
8192	47	14.8	40	3889	43	60	85	40	40
16384	95	29.4	50	2407	93	132	147	50	50
32768	178	16.4	78	2586	181	183	189	78	78
63000	195	13.5	142	2286	195	197	203	142	142

Perftest Scripts

To produce these tests, we executed RTI Perftest for Java. The exact script used can be found here:

echo EXECUTABLE IS $1
export executable=$1

export folder_base="$(dirname "${executable}")"/../..

echo OUTPUT PATH IS $2
export output_folder=$2
export pub_sub="pub"
export lat_thr="lat"
export num_reps="1 2"
export dataLens="32 64 128 256 512 1024 2048 4096 8192 16384 32768 63000"
export domain="2"

if [[ -z "$3" ]]; then
    echo "You need a third argument with publisher or subscriber"
    exit -1
else
    if [[ "$3" == "publisher" ]]; then
        echo "Publisher"
        export pub_sub="pub"
        
    elif [[ "$3" == "subscriber" ]]; then
        echo "Subscriber"
        export pub_sub="sub"
    else
        echo "It must be either publisher or subscriber"
        exit -1
    fi
fi

if [[ -z "$4" ]]; then
    echo "You need a forth argument with lat or thr"
    exit -1
else
    if [[ "$4" == "thr" ]]; then
        echo "Throughput test"
        export ${lat_thr}_thr="thr"
        
    elif [[ "$4" == "lat" ]]; then
        echo "Latency test"
        export ${lat_thr}_thr="lat"
    else
        echo "It must be either lat or thr"
        exit -1
    fi
fi

if [[ -z "$5" ]]; then
    echo "Using default nics"
    export nic1=172.16.0.1
    export nic2=172.16.0.2
else
    echo "Using custom nic: $5"
    export nic1=$5
    export nic2=$5
fi

sudo /set_${lat_thr}_mode.sh
sleep 10

export exec_time=20

export pub_string="-pub \
        -transport UDPv4 \
        -nic $nic1 \
        -noPrint \
        -exec $exec_time"

if [[ ${lat_thr} == "lat" ]]; then
    export pub_string="$pub_string \
        -latencyTest"
fi

export sub_string="-sub \
        -transport UDPv4 \
        -nic $nic2 \
        -noPrint"

if [[ "$pub_sub" == "pub" ]]; then
    echo "Publisher side"
    export commands_string=${pub_string}
else
    echo "Subscriber side"
    export commands_string=${sub_string}
fi


cd $folder_base
mkdir -p $output_folder

export my_file=$output_folder/${lat_thr}_${pub_sub}_unkeyed_rel.csv
touch $my_file
export extra_args=""
for index in ${num_reps}; do
    for DATALEN in ${dataLens}; do
        export command="$executable -domain $domain -datalen $DATALEN $commands_string $extra_args"
        echo $command ---- $index
        $command >> $my_file;
        if [[ "$domain" == "1" ]]; then
            export domain="2"
        else
            export domain="1"
        fi
        export extra_args=" -noOutputHeaders "
    done
done

export my_file=$output_folder/${lat_thr}_${pub_sub}_unkeyed_be.csv
touch $my_file
export extra_args=""
for index in ${num_reps}; do
    for DATALEN in ${dataLens}; do
        export command="$executable -domain $domain -datalen $DATALEN -best $commands_string $extra_args"
        echo $command ---- $index
        $command >> $my_file;
        if [[ "$domain" == "1" ]]; then
            export domain="2"
        else
            export domain="1"
        fi
        export extra_args=" -noOutputHeaders "
    done
done

export my_file=$output_folder/${lat_thr}_${pub_sub}_keyed_rel.csv
touch $my_file
export extra_args=""
for index in ${num_reps}; do
    for DATALEN in ${dataLens}; do
        export command="$executable -domain $domain -datalen $DATALEN -keyed -instances 100000 $commands_string $extra_args"
        echo $command ---- $index
        $command >> $my_file;
        if [[ "$domain" == "1" ]]; then
            export domain="2"
        else
            export domain="1"
        fi
        export extra_args=" -noOutputHeaders "
    done
done

export my_file=$output_folder/${lat_thr}_${pub_sub}_keyed_be.csv
touch $my_file
export extra_args=""
for index in ${num_reps}; do
    for DATALEN in ${dataLens}; do
        export command="$executable -domain $domain -datalen $DATALEN -keyed -instances 100000 -best $commands_string $extra_args"
        echo $command ---- $index
        $command >> $my_file;
        if [[ "$domain" == "1" ]]; then
            export domain="2"
        else
            export domain="1"
        fi
        export extra_args=" -noOutputHeaders "
    done
done

# if [[ ${lat_thr} == "thr" ]]; then

#     if [[ "$pub_sub" == "pub" ]]; then
#         echo "Publisher side"
#         export commands_string="${commands_string} -batchSize 0"
#     fi

#     export my_file=$output_folder/${lat_thr}_${pub_sub}_unkeyed_be_noBatch.csv
#     touch $my_file
#     export extra_args=""
#     for index in ${num_reps}; do
#         for DATALEN in ${dataLens}; do
#             export command="    $executable -domain $domain -datalen $DATALEN -best $commands_string $extra_args"
#             echo $command ---- $index
#             $command >> $my_file;
#             if [[ "$domain" == "1" ]]; then
#                 export domain="2"
#             else
#                 export domain="1"
#             fi
#             export extra_args=" -noOutputHeaders "
#         done
#     done

#     export my_file=$output_folder/${lat_thr}_${pub_sub}_unkeyed_rel_noBatch.csv
#     touch $my_file
#     export extra_args=""
#     for index in ${num_reps}; do
#         for DATALEN in ${dataLens}; do
#             export command="    $executable -domain $domain -datalen $DATALEN $commands_string $extra_args"
#             echo $command ---- $index
#             $command >> $my_file;
#             if [[ "$domain" == "1" ]]; then
#                 export domain="2"
#             else
#                 export domain="1"
#             fi
#             export extra_args=" -noOutputHeaders "
#         done
#     done

# fi

Test Hardware

The following hardware was used to perform these tests:

Linux Nodes

Dell R340 Servers (13 Units)
Processor: Intel Xeon E-2278G (3.4-5GHz, 8c/16t, 16MB cache, 2 memory channels @2666MHz)
RAM: 4x 16GB 2666MHz DIMM (64GB RAM)
HD: 480GB SATA SSD
NIC 1: Intel 710 dual port 10Gbps SFP
OS: Ubuntu 20.04 -- gcc 9.3.0

Switch

Dell 2048 -- 10Gbps switch

2.2.3.2. Keyed, UDPv4 10Gbps Network, Java

Linux x64

Minimum LatencyMaximum Throughput

The graph below shows the one-way latency without load between a Publisher and a Subscriber running in two Linux nodes in a 10Gbps network. The numbers are for best-effort as well as strict reliable reliability scenarios.

Note

We use the median (50th percentile) instead of the average in order to get a more stable measurement that does not account for spurious outliers. We also calculate the average value and other percentile values, which can be seen in the Detailed Statistics section below.

Detailed Statistics

The following tables contain the raw numbers presented by RTI Perftest. These numbers are the exact output with no further processing.

• Best Effort

Sample Size (Bytes)	Ave (us)	Std (us)	Min (us)	Max (us)	50% (μs)	90% (us)	99% (us)	99.99% (us)	99.9999% (us)
32	22	139.7	20	76073	21	23	25	20	20
64	22	139.5	20	77896	22	23	25	20	20
128	23	137.9	21	73111	22	24	26	21	21
256	23	148.4	21	79488	22	24	25	21	21
512	24	146.8	22	75814	23	25	27	22	22
1024	27	154.7	23	76554	27	28	29	23	23
2048	49	336.3	25	100142	47	65	74	25	25
4096	52	335.1	29	100143	55	63	76	29	29
8192	49	181.0	41	80380	46	59	62	41	41
16384	97	22.4	52	228	96	133	158	52	52
32768	185	2.8	84	260	185	187	189	84	84
63000	196	2.7	116	270	196	198	202	116	116

• Reliable

Sample Size (Bytes)	Ave (us)	Std (us)	Min (us)	Max (us)	50% (μs)	90% (us)	99% (us)	99.99% (us)	99.9999% (us)
32	24	143.5	22	75003	23	24	25	22	22
64	24	137.7	22	69765	23	24	26	22	22
128	24	153.7	22	82448	24	25	26	22	22
256	25	152.3	23	78269	24	25	27	23	23
512	25	150.2	23	78692	25	26	28	23	23
1024	27	157.4	25	77513	27	29	34	25	25
2048	32	161.6	27	71640	30	33	55	27	27
4096	37	191.3	31	78810	34	39	66	31	31
8192	50	225.9	43	84549	46	60	90	43	43
16384	98	29.2	54	251	98	141	159	54	54
32768	185	3.2	87	260	185	187	190	87	87
63000	197	6.0	113	272	198	199	205	113	113

Perftest Scripts

To produce these tests, we executed RTI Perftest for Java. The exact script used can be found here:

echo EXECUTABLE IS $1
export executable=$1

export folder_base="$(dirname "${executable}")"/../..

echo OUTPUT PATH IS $2
export output_folder=$2
export pub_sub="pub"
export lat_thr="lat"
export num_reps="1 2"
export dataLens="32 64 128 256 512 1024 2048 4096 8192 16384 32768 63000"
export domain="2"

if [[ -z "$3" ]]; then
    echo "You need a third argument with publisher or subscriber"
    exit -1
else
    if [[ "$3" == "publisher" ]]; then
        echo "Publisher"
        export pub_sub="pub"
        
    elif [[ "$3" == "subscriber" ]]; then
        echo "Subscriber"
        export pub_sub="sub"
    else
        echo "It must be either publisher or subscriber"
        exit -1
    fi
fi

if [[ -z "$4" ]]; then
    echo "You need a forth argument with lat or thr"
    exit -1
else
    if [[ "$4" == "thr" ]]; then
        echo "Throughput test"
        export ${lat_thr}_thr="thr"
        
    elif [[ "$4" == "lat" ]]; then
        echo "Latency test"
        export ${lat_thr}_thr="lat"
    else
        echo "It must be either lat or thr"
        exit -1
    fi
fi

if [[ -z "$5" ]]; then
    echo "Using default nics"
    export nic1=172.16.0.1
    export nic2=172.16.0.2
else
    echo "Using custom nic: $5"
    export nic1=$5
    export nic2=$5
fi

sudo /set_${lat_thr}_mode.sh
sleep 10

export exec_time=20

export pub_string="-pub \
        -transport UDPv4 \
        -nic $nic1 \
        -noPrint \
        -exec $exec_time"

if [[ ${lat_thr} == "lat" ]]; then
    export pub_string="$pub_string \
        -latencyTest"
fi

export sub_string="-sub \
        -transport UDPv4 \
        -nic $nic2 \
        -noPrint"

if [[ "$pub_sub" == "pub" ]]; then
    echo "Publisher side"
    export commands_string=${pub_string}
else
    echo "Subscriber side"
    export commands_string=${sub_string}
fi


cd $folder_base
mkdir -p $output_folder

export my_file=$output_folder/${lat_thr}_${pub_sub}_unkeyed_rel.csv
touch $my_file
export extra_args=""
for index in ${num_reps}; do
    for DATALEN in ${dataLens}; do
        export command="$executable -domain $domain -datalen $DATALEN $commands_string $extra_args"
        echo $command ---- $index
        $command >> $my_file;
        if [[ "$domain" == "1" ]]; then
            export domain="2"
        else
            export domain="1"
        fi
        export extra_args=" -noOutputHeaders "
    done
done

export my_file=$output_folder/${lat_thr}_${pub_sub}_unkeyed_be.csv
touch $my_file
export extra_args=""
for index in ${num_reps}; do
    for DATALEN in ${dataLens}; do
        export command="$executable -domain $domain -datalen $DATALEN -best $commands_string $extra_args"
        echo $command ---- $index
        $command >> $my_file;
        if [[ "$domain" == "1" ]]; then
            export domain="2"
        else
            export domain="1"
        fi
        export extra_args=" -noOutputHeaders "
    done
done

export my_file=$output_folder/${lat_thr}_${pub_sub}_keyed_rel.csv
touch $my_file
export extra_args=""
for index in ${num_reps}; do
    for DATALEN in ${dataLens}; do
        export command="$executable -domain $domain -datalen $DATALEN -keyed -instances 100000 $commands_string $extra_args"
        echo $command ---- $index
        $command >> $my_file;
        if [[ "$domain" == "1" ]]; then
            export domain="2"
        else
            export domain="1"
        fi
        export extra_args=" -noOutputHeaders "
    done
done

export my_file=$output_folder/${lat_thr}_${pub_sub}_keyed_be.csv
touch $my_file
export extra_args=""
for index in ${num_reps}; do
    for DATALEN in ${dataLens}; do
        export command="$executable -domain $domain -datalen $DATALEN -keyed -instances 100000 -best $commands_string $extra_args"
        echo $command ---- $index
        $command >> $my_file;
        if [[ "$domain" == "1" ]]; then
            export domain="2"
        else
            export domain="1"
        fi
        export extra_args=" -noOutputHeaders "
    done
done

# if [[ ${lat_thr} == "thr" ]]; then

#     if [[ "$pub_sub" == "pub" ]]; then
#         echo "Publisher side"
#         export commands_string="${commands_string} -batchSize 0"
#     fi

#     export my_file=$output_folder/${lat_thr}_${pub_sub}_unkeyed_be_noBatch.csv
#     touch $my_file
#     export extra_args=""
#     for index in ${num_reps}; do
#         for DATALEN in ${dataLens}; do
#             export command="    $executable -domain $domain -datalen $DATALEN -best $commands_string $extra_args"
#             echo $command ---- $index
#             $command >> $my_file;
#             if [[ "$domain" == "1" ]]; then
#                 export domain="2"
#             else
#                 export domain="1"
#             fi
#             export extra_args=" -noOutputHeaders "
#         done
#     done

#     export my_file=$output_folder/${lat_thr}_${pub_sub}_unkeyed_rel_noBatch.csv
#     touch $my_file
#     export extra_args=""
#     for index in ${num_reps}; do
#         for DATALEN in ${dataLens}; do
#             export command="    $executable -domain $domain -datalen $DATALEN $commands_string $extra_args"
#             echo $command ---- $index
#             $command >> $my_file;
#             if [[ "$domain" == "1" ]]; then
#                 export domain="2"
#             else
#                 export domain="1"
#             fi
#             export extra_args=" -noOutputHeaders "
#         done
#     done

# fi

Test Hardware

The following hardware was used to perform these tests:

Linux Nodes

Dell R340 Servers (13 Units)
Processor: Intel Xeon E-2278G (3.4-5GHz, 8c/16t, 16MB cache, 2 memory channels @2666MHz)
RAM: 4x 16GB 2666MHz DIMM (64GB RAM)
HD: 480GB SATA SSD
NIC 1: Intel 710 dual port 10Gbps SFP
OS: Ubuntu 20.04 -- gcc 9.3.0

Switch

Dell 2048 -- 10Gbps switch