-
assigned issue to
GitLab BIG_TESTS hack breaks CI_TESTS
The summit/pgi gitlabs are partially ignoring CI_TESTS as a result of the BIG_TESTS hack.
Eg: https://gitlab-ci.alcf.anl.gov/anl/upcpp/-/jobs/51554/raw
As a result the pipeline runs unintended tests, which (as in this example) can lead to spurious failure of overall pipeline if the experiment is specific to a particular test set and not intended to be appropriate for other tests.
Ideally the script would perform an intersection, but failing that a better solution when CI_TESTS is set would be to just disable parallel test execution and the BIG_TESTS hack
Comments (3)
-
reporter -
- changed status to resolved
I was over thinking the problem initially.
Basically if
CI_TESTS
andBIG_TESTS
are both set, we set the latter equal to the former to achieve both goals: tests are limited to those inCI_TESTS
and (at least) those inBIG_TESTS
are compiled sequentially. The loss in parallelism for a presumed small set of tests inCI_TESTS
should be acceptable.Fixed, as can be seen in the following retry of the job in the original report
-
reporter - changed component to CI and Testing scripts
- Log in to comment