Roadmap

Where TestLookup is heading

What shipped recently, what's being built now and what comes next. Shipped items come from the public changelog. Everything else is the maintainer's current plan.

Last updated · No dates are promised, and plans can change.

Recently shipped 9

Already in the code today, and coming in the first official release.

  • ShippedData

    Project export with run history

    Move a project and up to 2,000 finished test runs to another TestLookup installation, packed in one signed archive file.

    In the changelog
  • ShippedCollecting results

    More live reporters

    Send results while tests are still running from five more test tools: Playwright, Vitest, Cypress, Cucumber JS and Robot Framework. They join pytest, Jest, Mocha, TestNG, JUnit 5 and 6, and Go.

    Collecting results
  • ShippedReleases

    Release planning

    Plan a release in phases, copied from an earlier release or drafted from a product requirements document. Add a release calendar and rules that decide which test runs count toward each release.

    Release readiness
  • ShippedAI

    AI history and corrections

    TestLookup keeps every AI analysis as a version. When a person corrects it, the correction becomes the next version. You can also compare a run with the previous run of the same suite.

    Failure analysis
  • ShippedAI

    Agent actions you approve

    AI helpers called agents suggest actions, such as setting aside a test that fails at random so it stops blocking builds. A QA lead approves each one in the inbox, and every action is logged.

    Failure analysis
  • ShippedSearch

    Search by meaning and similar failures

    Search test results by meaning, by exact words or both at once. Save your searches, and open a Similar failures tab on any failed test.

    AI you control
  • ShippedIdentity

    Single sign-on and automatic user setup

    Sign in with your company account through SAML 2.0 or OpenID Connect, and map company groups to TestLookup roles. Your company directory can create groups automatically through SCIM, and settings can point to secrets kept in HashiCorp Vault.

    Self-hosting
  • ShippedData

    Retention holds

    Put a hold on test data that must be kept, and archive test runs before a deletion removes them.

    Self-hosting
  • ShippedPrivacy

    Personal data requests

    People can download their own data. An administrator can export everything TestLookup holds about one person, or erase it after checking a preview.

    Governance and audit

In progress 0

Nothing is listed here right now. To see work under way, look at the open pull requests, the proposed changes waiting for review on GitHub.

    Planned next 8

    Worked out and lined up to follow the current work.

    • PlannedReleases

      First official release, 0.1.0

      A version tag in Git, ready-made container images, an offline install bundle with checksums, and release notes taken from the changelog.

    • PlannedDeveloper experience

      Test reporters on package registries

      Install the test reporters and the command-line tool from PyPI, npm, Maven Central and the Go module proxy, without building them from source.

    • PlannedDashboards

      Cross-project dashboards

      Compare test quality across all your projects on one dashboard.

    • PlannedIntegrations

      Jira epics for recurring failures

      Automatically link a group of similar failures that keeps coming back to a Jira epic, a large work item that groups related issues.

    • PlannedContinuous integration

      Test-impact analysis

      See which tests a code change is most likely to affect.

    • PlannedTest management

      Manage test cases from the command line and AI assistants

      The command-line tool can already list and export test cases. The plan is to let you create and edit them there, from AI assistants and from the code libraries. Signed evidence bundles for test cases and links to requirements in Jira or application lifecycle management tools are planned too.

    • PlannedAI

      Tune the local AI model

      Train the local AI model further on failures your team has already labelled.

    • PlannedCollecting results

      Import results saved to a storage folder

      Save test result files into TestLookup's bundled file storage, and TestLookup imports them automatically.

    Exploring 2

    Ideas being looked into. They may change or be dropped.

    • ExploringReleases

      Error budgets for releases

      An error budget is the amount of failure your service's reliability target allows. This idea would track how much of it is used up and tie that to the limits your release check uses.

    • ExploringMonitoring

      One timeline for failures and operations

      See test failures next to deployments, logs and system metrics on one timeline.

    Help shape what comes next

    Tell us what would make TestLookup more useful for your software team. Feature requests and discussion happen on GitHub.