Regular CI systems are optimised for workloads that do not require stable performance over time. This makes them unsuitable for running performance benchmarks.
current-bench provides a predictable environment for performance benchmarks and a UI for analysing results over time. Similar to a CI system it runs on pull requests and branches allowing performance to be analysed and compared. It can currently be enabled on as an app on GitHub repositories with zero configuration. current-bench is running on several public repositories, including irmin and dune, and we plan to enable it on more projects in the future.
In this presentation, we will give a technical overview of current-bench, showing how results are collected and analysed, requirements for using it and how we built the infrastructure for stable benchmarks. We also describe future work that would allow more OCaml projects to run current-bench.
Gargi Sharma Tarides
Rizo Isrof Tarides
Magnus Skjegstad Tarides and OCaml Labs