Pilot is a framework that is designed for collecting precise benchmark results in the shortest possible time. This is useful when a designer or administrator needs to evaluate many candidate parameters. Pilot analyzes time series data in real time and tells you when the desired width of confidence interval is reached. Pilot can also automate many benchmark chores, such as measuring the overhead, detecting warm-up and tear-down phases, discovering bottleneck of the system, and comparing very close benchmark results. Pilto is in BSD 3clause or GPLv2+ license, and comes with easy-to-use scriptable and CLI interfaces with C/C++/Python bindings.
Our MASCOTS'16 paper contains technical details of Pilot.
Join Slack or the mailing lists to receive future release announcements or share your experiences:
Pilot was a research project from the Storage Systems Research Center in UC Santa Cruz from 2015 to 2016. This research was supported in part by the National Science Foundation under awards IIP-1266400, CCF-1219163, CNS-1018928, CNS-1528179, by the Department of Energy under award DE-FC02-10ER26017/DESC0005417, by a Symantec Graduate Fellowship, by a grant from Intel Corporation, and by industrial members of the Center for Research in Storage Systems.
This project does not reflect the opinion or endorsement of the sponsors listed above.