Skip to content

parallelize dashboard unit tests in drone #69027

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 26 commits into
base: staging
Choose a base branch
from
Draft

parallelize dashboard unit tests in drone #69027

wants to merge 26 commits into from
+22 −19

Conversation

davidsbailey
Copy link
Member

@davidsbailey davidsbailey commented Oct 22, 2025 •
edited
Loading

results

baseline

Finished in 2967.79050s
8643 tests, 31816 assertions, 0 failures, 0 errors, 60 skips
[test] dashboard tests succeeded in 51:07 minutes

parallel 4x

[test] dashboard tests succeeded in 12:41 minutes
[test] dashboard ruby unit tests succeeded in 15:09 minutes

parallel 6x

[test] dashboard tests succeeded in 10:21 minutes
[test] dashboard ruby unit tests succeeded in 12:55 minutes

parallel 8x

[test] dashboard tests succeeded in 9:36 minutes
[test] dashboard ruby unit tests succeeded in 12:14 minutes

parallel 10x

dashboard tests failed in 22:42 minutes
dashboard ruby unit tests failed in 25:28 minutes

Testing story

Deployment strategy

Follow-up work

@davidsbailey davidsbailey changed the title invalidate fixtures hash, and also force dashboard unit tests to run parallelize dashboard unit tests in drone Oct 22, 2025
davidsbailey and others added 21 commits October 22, 2025 16:53
@davidsbailey
suppress fixture diff output
602878e
@davidsbailey
reduce to 4 parallel test processors
84894e4
@davidsbailey
Merge branch 'staging' into parallelize-drone-dash-unit-tests
15508e9
@Hamms
speculatively stop optimizing the size of the cache file to see how b…
a6da85f 
…ig of a difference it makes
@Hamms
temporarily build cache on PR
5141b06
@Hamms
Revert "temporarily build cache on PR"
3491f50 
This reverts commit 5141b06.
@Hamms
re-sign drone
54242ab
@Hamms
temporarily build cache on PR
58bad50
@Hamms
Revert "temporarily build cache on PR"
8e3317c 
This reverts commit 58bad50.
@davidsbailey
Merge remote-tracking branch 'origin/elijah/remove-drone-optimization…
ea252af 
…s' into parallelize-drone-dash-unit-tests
@davidsbailey
Merge branch 'staging' into parallelize-drone-dash-unit-tests
227987b
@davidsbailey
reduce parallelization to 2
432b4a6
@davidsbailey
reduce parallelization to 1
b6f9e11
@davidsbailey
use regular pegasus_test db for dashboard unit tests
8dc13c5
@davidsbailey
increase parallelization to 4
c766c29
@davidsbailey
increase parallelization to 8
81bae6e
@davidsbailey
increase parallelization to 12
7392272
@davidsbailey
10 parallel test processors
0a11f63
@davidsbailey
6 parallel test processors
138f58b
@davidsbailey
set parallelization to 7
c852d55
@davidsbailey
set parallelization to 9
0326cca
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@davidsbailey @Hamms