S3GW Performance Report

Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB)

Throughput
2023-07-29T04:14:50.220230 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
Operations
2023-07-29T04:14:50.337024 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/

Test Failures

All good

Comparison Tables

> 1 faster, = 1 no change, < 1 slower, > 1.3x 😎

️0.18.0 ➙ 🌃2023-07-25

Warp mixed 30m ➙ Warp mixed 30m

Test
 delete-bw-mean
byte/s 		delete-iops-mean
iops 		read-bw-mean
byte/s 		read-iops-mean
iops 		stat-bw-mean
byte/s 		stat-iops-mean
iops 		write-bw-mean
byte/s 		write-iops-mean
iops
Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB) - 0.98x 0.98x 0.98x - 0.98x 0.98x 0.98x

️0.18.0 ➙ 🌃2023-07-26

Warp mixed 30m ➙ Warp mixed 30m

Test
 delete-bw-mean
byte/s 		delete-iops-mean
iops 		read-bw-mean
byte/s 		read-iops-mean
iops 		stat-bw-mean
byte/s 		stat-iops-mean
iops 		write-bw-mean
byte/s 		write-iops-mean
iops
Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB) - 0.98x 0.99x 0.99x - 0.98x 0.98x 0.98x

️0.18.0 ➙ 🌃2023-07-27

Warp mixed 30m ➙ Warp mixed 30m

Test
 delete-bw-mean
byte/s 		delete-iops-mean
iops 		read-bw-mean
byte/s 		read-iops-mean
iops 		stat-bw-mean
byte/s 		stat-iops-mean
iops 		write-bw-mean
byte/s 		write-iops-mean
iops
Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB) - 1.36x 1.36x 1.36x - 1.36x 1.53x 1.53x

️0.18.0 ➙ 🌃2023-07-28

Warp mixed 30m ➙ Warp mixed 30m

Test
 delete-bw-mean
byte/s 		delete-iops-mean
iops 		read-bw-mean
byte/s 		read-iops-mean
iops 		stat-bw-mean
byte/s 		stat-iops-mean
iops 		write-bw-mean
byte/s 		write-iops-mean
iops
Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB) - 1.33x 1.33x 1.33x - 1.33x 1.50x 1.51x

️0.18.0 ➙ 🌃2023-07-29

Warp mixed 30m ➙ Warp mixed 30m

Test
 delete-bw-mean
byte/s 		delete-iops-mean
iops 		read-bw-mean
byte/s 		read-iops-mean
iops 		stat-bw-mean
byte/s 		stat-iops-mean
iops 		write-bw-mean
byte/s 		write-iops-mean
iops
Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB) - 1.33x 1.33x 1.33x - 1.33x 1.50x 1.50x

🌃2023-07-25 ➙ 🌃2023-07-26

Warp mixed 30m ➙ Warp mixed 30m

Test
 delete-bw-mean
byte/s 		delete-iops-mean
iops 		read-bw-mean
byte/s 		read-iops-mean
iops 		stat-bw-mean
byte/s 		stat-iops-mean
iops 		write-bw-mean
byte/s 		write-iops-mean
iops
Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB) - 1.00x 1.01x 1.01x - 1.01x 1.00x 1.00x

🌃2023-07-25 ➙ 🌃2023-07-27

Warp mixed 30m ➙ Warp mixed 30m

Test
 delete-bw-mean
byte/s 		delete-iops-mean
iops 		read-bw-mean
byte/s 		read-iops-mean
iops 		stat-bw-mean
byte/s 		stat-iops-mean
iops 		write-bw-mean
byte/s 		write-iops-mean
iops
Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB) - 1.38x 1.38x 1.38x - 1.38x 1.56x 1.56x

🌃2023-07-25 ➙ 🌃2023-07-28

Warp mixed 30m ➙ Warp mixed 30m

Test
 delete-bw-mean
byte/s 		delete-iops-mean
iops 		read-bw-mean
byte/s 		read-iops-mean
iops 		stat-bw-mean
byte/s 		stat-iops-mean
iops 		write-bw-mean
byte/s 		write-iops-mean
iops
Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB) - 1.36x 1.36x 1.36x - 1.36x 1.53x 1.53x

🌃2023-07-25 ➙ 🌃2023-07-29

Warp mixed 30m ➙ Warp mixed 30m

Test
 delete-bw-mean
byte/s 		delete-iops-mean
iops 		read-bw-mean
byte/s 		read-iops-mean
iops 		stat-bw-mean
byte/s 		stat-iops-mean
iops 		write-bw-mean
byte/s 		write-iops-mean
iops
Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB) - 1.35x 1.35x 1.35x - 1.35x 1.53x 1.53x

🌃2023-07-26 ➙ 🌃2023-07-27

Warp mixed 30m ➙ Warp mixed 30m

Test
 delete-bw-mean
byte/s 		delete-iops-mean
iops 		read-bw-mean
byte/s 		read-iops-mean
iops 		stat-bw-mean
byte/s 		stat-iops-mean
iops 		write-bw-mean
byte/s 		write-iops-mean
iops
Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB) - 1.38x 1.38x 1.38x - 1.38x 1.56x 1.56x

🌃2023-07-26 ➙ 🌃2023-07-28

Warp mixed 30m ➙ Warp mixed 30m

Test
 delete-bw-mean
byte/s 		delete-iops-mean
iops 		read-bw-mean
byte/s 		read-iops-mean
iops 		stat-bw-mean
byte/s 		stat-iops-mean
iops 		write-bw-mean
byte/s 		write-iops-mean
iops
Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB) - 1.35x 1.35x 1.35x - 1.35x 1.53x 1.53x

🌃2023-07-26 ➙ 🌃2023-07-29

Warp mixed 30m ➙ Warp mixed 30m

Test
 delete-bw-mean
byte/s 		delete-iops-mean
iops 		read-bw-mean
byte/s 		read-iops-mean
iops 		stat-bw-mean
byte/s 		stat-iops-mean
iops 		write-bw-mean
byte/s 		write-iops-mean
iops
Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB) - 1.35x 1.35x 1.35x - 1.35x 1.52x 1.52x

🌃2023-07-27 ➙ 🌃2023-07-28

Warp mixed 30m ➙ Warp mixed 30m

Test
 delete-bw-mean
byte/s 		delete-iops-mean
iops 		read-bw-mean
byte/s 		read-iops-mean
iops 		stat-bw-mean
byte/s 		stat-iops-mean
iops 		write-bw-mean
byte/s 		write-iops-mean
iops
Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB) - 0.98x 0.98x 0.98x - 0.98x 0.98x 0.98x

🌃2023-07-27 ➙ 🌃2023-07-29

Warp mixed 30m ➙ Warp mixed 30m

Test
 delete-bw-mean
byte/s 		delete-iops-mean
iops 		read-bw-mean
byte/s 		read-iops-mean
iops 		stat-bw-mean
byte/s 		stat-iops-mean
iops 		write-bw-mean
byte/s 		write-iops-mean
iops
Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB) - 0.98x 0.98x 0.98x - 0.98x 0.98x 0.98x

🌃2023-07-28 ➙ 🌃2023-07-29

Warp mixed 30m ➙ Warp mixed 30m

Test
 delete-bw-mean
byte/s 		delete-iops-mean
iops 		read-bw-mean
byte/s 		read-iops-mean
iops 		stat-bw-mean
byte/s 		stat-iops-mean
iops 		write-bw-mean
byte/s 		write-iops-mean
iops
Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB) - 1.00x 1.00x 1.00x - 1.00x 1.00x 1.00x

Test Environment

human-id ️0.18.0 🌃2023-07-25 🌃2023-07-26 🌃2023-07-27 🌃2023-07-28 🌃2023-07-29
description Warp mixed 30m Warp mixed 30m Warp mixed 30m Warp mixed 30m Warp mixed 30m Warp mixed 30m
suite_id 38c4984d-6801-477b-a793-2c4da6877350 9fab664d-d2dc-488a-bf0b-e87b93e3a756 c84ff832-a5f9-44e9-9f84-2e614d1709bd 1a9b5cce-642e-4e6c-9c66-ac848ba5e7e1 4b6ab800-58eb-47fe-9128-9bd6bdfee52d 45c1c3a7-e0b5-4937-98d3-b378be240fd4
name warp-mixed-long warp-mixed-long warp-mixed-long warp-mixed-long warp-mixed-long warp-mixed-long
under-test-image-id sha256:ae552220ad42b3b86cd6650f8654ff9088b93fe65d33afaa29443ec855091a10 sha256:c8bb070021b0dc95b95e4b31feaf240fad4ce342c95202bb05c68a21e1f0b933 sha256:db0eb937980eacd78a94593bbc0df433191bcb9f876dfef36fe52ca7e4e1798e sha256:c51d596fb22c3614f1d1152522839183ab0bf2bfd5b43db4688c951287881d42 sha256:8c7b85851c5b9f54361b2684907c505206140471886069e5b40a122ed9e00360 sha256:eaa7e4eb75f6ceccd8e2d70566625d51417539676d9959cf5bdfd4bdba7a8a35
under-test-s3gw-version ceph version Development (no_version) reef (dev) ceph version Development (no_version) reef (dev) ceph version Development (no_version) reef (dev) ceph version Development (no_version) reef (dev) ceph version Development (no_version) reef (dev) ceph version Development (no_version) reef (dev)
under-test-image-tags quay.io/s3gw/s3gw:latest;quay.io/s3gw/s3gw:v0.18.0 quay.io/s3gw/s3gw:nightly-2023-07-25 quay.io/s3gw/s3gw:nightly-2023-07-26 quay.io/s3gw/s3gw:nightly-2023-07-27 quay.io/s3gw/s3gw:nightly-2023-07-28 quay.io/s3gw/s3gw:nightly-2023-07-29
avg_test_runtime 43.95616672933102 43.69416654109955 43.762216195464134 38.49030017852783 38.61118331551552 38.592116832733154
cpu-count 8 8 8 8 8 8
cpu-model Intel(R) Xeon(R) CPU E3-1260L v5 @ 2.90GHz Intel(R) Xeon(R) CPU E3-1260L v5 @ 2.90GHz Intel(R) Xeon(R) CPU E3-1260L v5 @ 2.90GHz Intel(R) Xeon(R) CPU E3-1260L v5 @ 2.90GHz Intel(R) Xeon(R) CPU E3-1260L v5 @ 2.90GHz Intel(R) Xeon(R) CPU E3-1260L v5 @ 2.90GHz
disk-model INTEL SSDPED1K375GA INTEL SSDPED1K375GA INTEL SSDPED1K375GA INTEL SSDPED1K375GA INTEL SSDPED1K375GA INTEL SSDPED1K375GA
finished 2023-07-14 11:40:17.182 2023-07-25 01:46:52.848 2023-07-26 01:35:20.085 2023-07-27 02:00:29.311 2023-07-28 01:48:55.011 2023-07-29 01:37:16.223
memtotalkb 65666824 65666824 65666824 65666824 65666824 65666824
n_tests 1 1 1 1 1 1
node-name ares ares ares ares ares ares
os-release 5.14.21-150400.24.41-default 5.14.21-150400.24.41-default 5.14.21-150400.24.41-default 5.14.21-150400.24.41-default 5.14.21-150400.24.41-default 5.14.21-150400.24.41-default
runtime_min 44.0 44.0 44.0 38.0 39.0 39.0
start 2023-07-14 10:56:19.766 2023-07-25 01:03:11.164 2023-07-26 00:51:34.317 2023-07-27 01:21:59.860 2023-07-28 01:10:18.298 2023-07-29 00:58:40.660
test-image-id sha256:bacd98d777965bcc8a2f1a53cbe6ab1116aa5a02ace8f13818f733489d66eaf7 sha256:3421d68ddd4f7086cc02680bb0211d69395d50ab993bb1d476e3930eb55a4192 sha256:3421d68ddd4f7086cc02680bb0211d69395d50ab993bb1d476e3930eb55a4192 sha256:3421d68ddd4f7086cc02680bb0211d69395d50ab993bb1d476e3930eb55a4192 sha256:3421d68ddd4f7086cc02680bb0211d69395d50ab993bb1d476e3930eb55a4192 sha256:3421d68ddd4f7086cc02680bb0211d69395d50ab993bb1d476e3930eb55a4192
test-image-tags minio/warp:latest minio/warp:latest minio/warp:latest minio/warp:latest minio/warp:latest minio/warp:latest
test-warp-version warp version 0.7.4 - 560cb38 warp version 0.7.5 - 77be8b7 warp version 0.7.5 - 77be8b7 warp version 0.7.5 - 77be8b7 warp version 0.7.5 - 77be8b7 warp version 0.7.5 - 77be8b7

Latency Graphs

Warp(workload=mixed, args=--duration=30m,--get-distrib=45,--stat-distrib=30,--put-distrib=15,--delete-distrib=10,--objects=20000,--obj.size=10MiB)

Test
️0.18.0
2023-07-29T04:14:50.514583 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
DELETE 12 22969 80 64
2023-07-29T04:14:50.665718 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
GET 21 25864 132 112
2023-07-29T04:14:50.799183 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
PUT 185 5420 1471 1404
2023-07-29T04:14:50.933552 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
STAT 13 31067 77 61
🌃2023-07-25
2023-07-29T04:14:51.072970 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
DELETE 11 27813 79 63
2023-07-29T04:14:51.204290 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
GET 23 27335 132 112
2023-07-29T04:14:51.338749 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
PUT 522 5885 1499 1428
2023-07-29T04:14:51.473143 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
STAT 11 28652 78 62
🌃2023-07-26
2023-07-29T04:14:51.656836 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
DELETE 14 402 78 64
2023-07-29T04:14:51.785149 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
GET 20 30032 132 113
2023-07-29T04:14:51.917248 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
PUT 206 7352 1491 1422
2023-07-29T04:14:52.049538 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
STAT 10 15913 77 63
🌃2023-07-27
2023-07-29T04:14:52.181542 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
DELETE 18 21636 107 97
2023-07-29T04:14:52.310162 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
GET 24 29007 155 141
2023-07-29T04:14:52.442215 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
PUT 120 5465 640 514
2023-07-29T04:14:52.575379 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
STAT 14 28955 101 92
🌃2023-07-28
2023-07-29T04:14:52.755089 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
DELETE 12 31411 114 102
2023-07-29T04:14:52.884155 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
GET 21 31746 156 143
2023-07-29T04:14:53.016354 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
PUT 121 5770 644 522
2023-07-29T04:14:53.148669 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
STAT 14 27629 105 95
🌃2023-07-29
2023-07-29T04:14:53.281231 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
DELETE 15 21588 111 102
2023-07-29T04:14:53.409810 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
GET 24 30222 157 143
2023-07-29T04:14:53.542417 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
PUT 123 5432 642 519
2023-07-29T04:14:53.674280 image/svg+xml Matplotlib v3.6.3, https://matplotlib.org/
op fastest [ms] slowest [ms] avg [ms] median [ms]
STAT 14 27094 105 96