Commit graph

18 commits

Author SHA1 Message Date
Allan Jeremy
985d553c4d build: re-enable win32 runs 2022-09-07 08:45:38 +03:00
Allan Jeremy
b2f011c4bb build: re-enabled remaining jobs 2022-09-07 08:44:07 +03:00
Allan Jeremy
19314f4f4a build: re-enable composite action steps 2022-09-07 08:34:56 +03:00
Allan Jeremy
99de501a02 chore: remove debug steps 2022-09-07 08:26:38 +03:00
Allan Jeremy
87692a63a6 debug wip 2022-09-06 20:55:03 +03:00
Allan Jeremy
72a49d5536 debug wip 2022-09-06 16:51:10 +03:00
Allan Jeremy
87371a83b9 test: testing out benchmark run 2022-09-06 16:38:15 +03:00
Allan Jeremy
9332ea2e49 test: testing out benchmark run 2022-09-06 16:01:14 +03:00
Allan Jeremy
8d1a6b5427 build: added retry attempts to benchmark workflow 2022-09-05 17:30:32 +03:00
Allan Jeremy
d7293a7924 debug wip: testing running sub-command with retry 2022-08-23 14:42:32 +03:00
Allan Jeremy
2afb09483e debug wip 2022-08-22 18:58:46 +03:00
Allan Jeremy
372921b97d debug wip
Co-authored-by: Jamie Kuppens <reshurum@gmail.com>
Co-authored-by: Ignacio Falk <flakolefluk@gmail.com>
2022-08-22 18:36:30 +03:00
Allan Jeremy
ea8e2cc412 debug wip 2022-08-17 18:47:27 +03:00
Allan Jeremy
652155fb83 fix: fixed composite action issue 2022-08-17 18:45:12 +03:00
Allan Jeremy
5953634fb4 build: added base benchmark base 2022-08-17 18:36:29 +03:00
Allan N Jeremy
dbcd5fb28e
build: changed data output to be different for each os (#581)
- macos: data-macos-latest.json
- ubuntu: data-ubuntu-latest.json
- windows: data-windows-latest.json
2022-07-07 08:21:40 -07:00
Arseny Kapoulkine
2460e38998
bench: Implement luau-analyze and luau --compile benchmarks (#575)
This change adds another file for benchmarking luau-analyze and sets up
benchmarks for both non-strict/strict modes for analysis and all three
optimization levels for compilation performance.

To avoid issues with race conditions on repository update we do all this
in the same job in benchmark.yml.

To be able to benchmark both modes from a single file, luau-analyze
gains --mode argument which allows to override the default typechecking
mode. Not sure if we'll want this to be a hard override on top of the
module-specified mode in the future, but this works for now.
2022-07-05 08:23:09 -07:00
Arseny Kapoulkine
48aa7a5162
bench: Implement first class support for callgrind (#570)
Since callgrind allows to control stats collection from the guest, this
allows us to reset the collection right before the benchmark starts.

This change exposes this to the benchmark runner and integrates
callgrind data parsing into bench.py, so that we can run bench.py with
--callgrind argument and, as long as the runner was built with callgrind
support, we get instruction counts from the run.

We convert instruction counts to seconds using 10G instructions/second
rate; there's no correct way to do this without simulating the full CPU
pipeline but it results in time units on a similar scale to real runs.
2022-07-04 11:13:07 -07:00