Scope

Better applications through better testing

Scope turns tests into the insights you need to ship higher quality software more frequently.

Testing is a core competency to build great software. But testing has failed to keep up with the fundamental shift in how we build applications. Scope gives engineering teams production-level visibility on every test for every app – spanning mobile, monoliths, and microservices.

See inside every test

Bring observability to your integration and end-to-end tests: quickly debug with distributed traces, queries, logs, exceptions, and much more. Prevent your CI from becoming a bottleneck in your pipeline.

Distributed traces make it easy to debug tests

Tap the full potential of your tests

Use Scope to leverage your test data. Gain a deep understanding of your applications before you ship them to your customers. Scope automatically and continuously identifies regressions, bottlenecks, flakiness, and other bugs.

Historical performance of an end-to-end test across five commits

Frictionless engineering collaboration

Reproducing and manually routing issues to the right team is frustrating and wastes engineering time. Scope eliminates the need to reproduce failure or guess which team, service, test, or API is to blame – teams can remediate issues faster than ever.

Deliver more perfect software

Simple to set up. Simple to use. Start building better, more resilient software experiences. Scope automatically instruments client libraries and testing frameworks for maximum visibility and debug-ability.

Add our agent as a dependency to your Maven or Gradle project. For example, in your pom.xml:

<properties>
<scope.agent.version>0.1.9</scope.agent.version>
</properties>
...
<dependency>
<groupId>com.undefinedlabs.scope</groupId>
<artifactId>scope-agent</artifactId>
<version>${scope.agent.version}</version>
<scope>provided</scope>
</dependency>

Then, configure a Maven plugin or Gradle task to use our agent (see how in our documentation).

Finally, set the API key as an environment variable:

export SCOPE_APIKEY=REPLACE_WITH_API_KEY

After this, you can run your tests as you normally do. For example, with Maven:

mvn clean verify

For more information you may refer to our documentation.

Inspired by

High performing organizations use their testing strategy as the catalyst to their high performance journey. Scope is inspired by how the following organizations develop, test, and debug their applications:

Developers are far more likely to have a flaky test case if it is new or modified, compared to tests that may have already been running [...] it's too expensive to find out a test is flaky after they're merged.

Stability Pipeline Testing

Athena reduces the human effort required to keep the build green by:

  • Identifying commits that make a test deterministically fail, and notifying the author to revert the commit
  • Identifying tests that are flaky and unreliable, and automatically quarantining them

Athena: Our automated build health management system

Recent research at Google proposed a new project to “model, empirically understand, and leverage the correlations that exist between our code, test cases, developers, programming languages, and code-change and test-execution frequencies, to improve our CI and development processes”.

Taming Google-Scale Continuous Testing

We have developed a better way to perform this regression testing, using a new system that leverages machine learning to create a probabilistic model for selecting regression tests for a particular code change. This method needs to run only a small subset of tests in order to reliably detect faulty changes.

Predictive test selection: A more efficient way to ensure reliability of code changes

Works where you work

GitHub

Support for GitHub.com and GitHub Enterprise.

MacOS

A native app allows you to use Scope for local development.

Windows

A native app allows you to use Scope for local development.

GitHub Actions

Add Scope as another GitHub Action within your pipeline.

Any CI Provider

Scope supports any CI – even teams with more than one.

Email

Notifications for test failures and performance regressions.

Get Early Access