S3GW Performance Report

Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB)

Throughput
2023-08-07T10:15:43.342784 image/svg+xml Matplotlib v3.7.2, https://matplotlib.org/
Operations
2023-08-07T10:15:43.396086 image/svg+xml Matplotlib v3.7.2, https://matplotlib.org/

Test Failures

All good

Comparison Tables

> 1 faster, = 1 no change, < 1 slower, > 1.3x 😎

️0.16.0 ➙ ️0.17.0

Warp mixed 30m ➙ Warp mixed 30m

Test
delete-bw-mean
byte/s
delete-iops-mean
iops
read-bw-mean
byte/s
read-iops-mean
iops
stat-bw-mean
byte/s
stat-iops-mean
iops
write-bw-mean
byte/s
write-iops-mean
iops
Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB) - 1.03x 1.03x 1.03x - 1.03x 1.02x 1.02x

️0.16.0 ➙ ️0.18.0

Warp mixed 30m ➙ Warp mixed 30m

Test
delete-bw-mean
byte/s
delete-iops-mean
iops
read-bw-mean
byte/s
read-iops-mean
iops
stat-bw-mean
byte/s
stat-iops-mean
iops
write-bw-mean
byte/s
write-iops-mean
iops
Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB) - 0.93x 0.93x 0.93x - 0.93x 0.67x 0.67x

️0.16.0 ➙ ️0.19.0

Warp mixed 30m ➙ Warp mixed 30m

Test
delete-bw-mean
byte/s
delete-iops-mean
iops
read-bw-mean
byte/s
read-iops-mean
iops
stat-bw-mean
byte/s
stat-iops-mean
iops
write-bw-mean
byte/s
write-iops-mean
iops
Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB) - 1.23x 1.23x 1.23x - 1.23x 1.00x 1.00x

️0.17.0 ➙ ️0.18.0

Warp mixed 30m ➙ Warp mixed 30m

Test
delete-bw-mean
byte/s
delete-iops-mean
iops
read-bw-mean
byte/s
read-iops-mean
iops
stat-bw-mean
byte/s
stat-iops-mean
iops
write-bw-mean
byte/s
write-iops-mean
iops
Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB) - 0.90x 0.90x 0.90x - 0.90x 0.66x 0.66x

️0.17.0 ➙ ️0.19.0

Warp mixed 30m ➙ Warp mixed 30m

Test
delete-bw-mean
byte/s
delete-iops-mean
iops
read-bw-mean
byte/s
read-iops-mean
iops
stat-bw-mean
byte/s
stat-iops-mean
iops
write-bw-mean
byte/s
write-iops-mean
iops
Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB) - 1.20x 1.20x 1.20x - 1.20x 0.98x 0.98x

️0.18.0 ➙ ️0.19.0

Warp mixed 30m ➙ Warp mixed 30m

Test
delete-bw-mean
byte/s
delete-iops-mean
iops
read-bw-mean
byte/s
read-iops-mean
iops
stat-bw-mean
byte/s
stat-iops-mean
iops
write-bw-mean
byte/s
write-iops-mean
iops
Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB) - 1.32x 1.32x 1.32x - 1.32x 1.50x 1.50x

Test Environment

human-id ️0.16.0 ️0.17.0 ️0.18.0 ️0.19.0
description Warp mixed 30m Warp mixed 30m Warp mixed 30m Warp mixed 30m
suite_id 7dc8ff95-2fad-417c-a75e-10d7b0b7a3a0 be3eb510-d489-44fe-a4b4-c466f627a642 38c4984d-6801-477b-a793-2c4da6877350 15001eec-a90a-4f82-8a95-10b45a76115e
name warp-mixed-long warp-mixed-long warp-mixed-long warp-mixed-long
under-test-image-tags quay.io/s3gw/s3gw:v0.16.0 quay.io/s3gw/s3gw:v0.17.0 quay.io/s3gw/s3gw:latest;quay.io/s3gw/s3gw:v0.18.0 quay.io/s3gw/s3gw:v0.19.0
under-test-image-id sha256:a291e837ab02b144d01c2e14cc4b02eb53f7921de491bdce1b126d94ae1b30e3 sha256:73d706b7ee89ab0c28f7929b6810067431c7a9982e87b576ecc60cf9071b8d0f sha256:ae552220ad42b3b86cd6650f8654ff9088b93fe65d33afaa29443ec855091a10 sha256:cb2644fbe9e2756f5a5585ba63ffdcc6712b17c908467757555676c45ece8621
under-test-s3gw-version ceph version Development (no_version) reef (dev) ceph version Development (no_version) reef (dev) ceph version Development (no_version) reef (dev) ceph version Development (no_version) reef (dev)
avg_test_runtime 38.1368500739336 38.23024995625019 43.95616672933102 38.67848329246044
cpu-count 8 8 8 8
cpu-model Intel(R) Xeon(R) CPU E3-1260L v5 @ 2.90GHz Intel(R) Xeon(R) CPU E3-1260L v5 @ 2.90GHz Intel(R) Xeon(R) CPU E3-1260L v5 @ 2.90GHz Intel(R) Xeon(R) CPU E3-1260L v5 @ 2.90GHz
disk-model INTEL SSDPED1K375GA INTEL SSDPED1K375GA INTEL SSDPED1K375GA INTEL SSDPED1K375GA
finished 2023-07-12 09:48:50.693 2023-07-12 10:27:07.146 2023-07-14 11:40:17.182 2023-08-03 20:33:38.299
memtotalkb 65666824 65666824 65666824 65666824
n_tests 1 1 1 1
node-name ares ares ares ares
os-release 5.14.21-150400.24.41-default 5.14.21-150400.24.41-default 5.14.21-150400.24.41-default 5.14.21-150400.24.41-default
runtime_min 38.0 38.0 44.0 39.0
start 2023-07-12 09:10:42.412 2023-07-12 09:48:53.281 2023-07-14 10:56:19.766 2023-08-03 19:54:57.515
test-image-id sha256:bacd98d777965bcc8a2f1a53cbe6ab1116aa5a02ace8f13818f733489d66eaf7 sha256:bacd98d777965bcc8a2f1a53cbe6ab1116aa5a02ace8f13818f733489d66eaf7 sha256:bacd98d777965bcc8a2f1a53cbe6ab1116aa5a02ace8f13818f733489d66eaf7 sha256:3421d68ddd4f7086cc02680bb0211d69395d50ab993bb1d476e3930eb55a4192
test-image-tags minio/warp:latest minio/warp:latest minio/warp:latest minio/warp:latest
test-warp-version warp version 0.7.4 - 560cb38 warp version 0.7.4 - 560cb38 warp version 0.7.4 - 560cb38 warp version 0.7.5 - 77be8b7

Latency Graphs

Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB)

Test
️0.16.0
2023-08-07T10:15:43.467982 image/svg+xml Matplotlib v3.7.2, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
DELETE 17 2792 155 146
2023-08-07T10:15:43.528843 image/svg+xml Matplotlib v3.7.2, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
GET 47 4301 226 211
2023-08-07T10:15:43.602534 image/svg+xml Matplotlib v3.7.2, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
PUT 128 758 280 271
2023-08-07T10:15:43.665410 image/svg+xml Matplotlib v3.7.2, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
STAT 41 4027 200 187
️0.17.0
2023-08-07T10:15:43.726715 image/svg+xml Matplotlib v3.7.2, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
DELETE 24 2554 150 142
2023-08-07T10:15:43.785565 image/svg+xml Matplotlib v3.7.2, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
GET 47 3285 222 209
2023-08-07T10:15:43.846083 image/svg+xml Matplotlib v3.7.2, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
PUT 132 838 266 260
2023-08-07T10:15:43.904841 image/svg+xml Matplotlib v3.7.2, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
STAT 37 2568 193 183
️0.18.0
2023-08-07T10:15:43.969334 image/svg+xml Matplotlib v3.7.2, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
DELETE 12 22969 80 64
2023-08-07T10:15:44.027167 image/svg+xml Matplotlib v3.7.2, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
GET 21 25864 132 112
2023-08-07T10:15:44.087915 image/svg+xml Matplotlib v3.7.2, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
PUT 185 5420 1471 1404
2023-08-07T10:15:44.173987 image/svg+xml Matplotlib v3.7.2, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
STAT 13 31067 77 61
️0.19.0
2023-08-07T10:15:44.235542 image/svg+xml Matplotlib v3.7.2, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
DELETE 15 490 109 102
2023-08-07T10:15:44.294070 image/svg+xml Matplotlib v3.7.2, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
GET 23 31349 158 144
2023-08-07T10:15:44.354564 image/svg+xml Matplotlib v3.7.2, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
PUT 122 6685 647 524
2023-08-07T10:15:44.413590 image/svg+xml Matplotlib v3.7.2, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
STAT 16 30017 106 96