Issue #3401971 by fjgarlin: Test-only job shouldn't require constant rebases to detect which files were changed
(cherry picked from commit b90362e8)
Closes #3409413