#standard-error #criterion #benchmark #error-value #cargo-command #cargo

app cargo-criterion-means

Cargo command to gather the mean and standard error values from criterion benchmarks

3 releases

0.1.0 Dec 5, 2023
0.1.0-beta.2 Nov 30, 2023
0.1.0-beta.1 Nov 28, 2023

#222 in Profiling

MIT/Apache

8KB
57 lines

cargo-criterion-means

Cargo command to gather the mean and standard error values from criterion benchmarks.

Install

cargo install cargo-criterion-means

Run

cargo criterion-means [optional path to project root]

Output

It sends comma-delimited text to standard out. For example:

Group,Id,Mean(ns),StdErr(ns)
compare_is_consecutive,regular/avx2,3.0443,0.0080137
compare_is_consecutive,regular/avx512f,3.0232,0.0023419
compare_is_consecutive,regular/sse2,3.0785,0.0016257
compare_is_consecutive,regular2/sse2,4.3907,0.0038452
compare_is_consecutive,rotate/avx2,1.3775,0.0039389
compare_is_consecutive,rotate/avx512f,1.2408,0.0060673
compare_is_consecutive,rotate/sse2,1.996,0.0055311

You can then analyze and tabulate via a spreadsheet (pivot tables work great) or via a dataframe library such as Polars.

Dependencies

~0.6–8.5MB
~59K SLoC