How to use Chairmarks for regression testing

Regression Testing is a Work in Progress

Regression testing is a difficult task. RegressionTests.jl has ambitious goals and is already state of the art within the Julia ecosystem, but it is very much a work in progress. Proceed at your own risk, or wait for that package to reach maturity.

Use RegressionTests.jl! Make a file bench/runbenchmarks.jl with the following content:

using Chairmarks, RegressionTests
using MyPackage

@track @be MyPackage.compute_thing(1)
@track @be MyPackage.compute_thing(1000)

And add the following to your test/runtests.jl:

using RegressionTests

@testset "Regression tests" begin
    RegressionTests.test(skip_unsupported_platforms=true)
end

See the RegressionTests.jl documentation for more information.