Code hosts
GitHub and GitLab
When a test run comes from a pull request on GitHub or a merge request on GitLab, TestLookup keeps one comment on it up to date. The comment lists newly failed tests, failures from known flaky tests that pass and fail at random, and tests the change fixed. Runs with a full commit ID also post a GitHub check or a GitLab commit status.
- A GitHub check can show notes on up to 50 tests
- If every failure comes from a known flaky test or one set aside (quarantined), the check ends as neutral
- GitHub milestones become releases, and the commits in a change are ranked by how likely each one caused a failure
- TestLookup connects to GitHub with a token or as an installed GitHub App
