Why isn’t your dev-test loop faster?

Your delivery pipeline comprises test suites that a commit must pass to go to production. Since tests form the bulk of your delivery process, any impact here radically affects your delivery times. As the application matures, test suites and the number of test suites keep growing, further compounding the problem where every test suite run delays your release.

The gauntlet of tests that a commit must pass through

Fixing the dev-test feedback loop with AI

Auto triaging: answering the “Is this my issue?” problem

With Personal Notifications via Slack & Test results and reports, Launchable provides a richer view of test results, helping developers triage and fix failures quickly. Personal notifications imply that a developer gets notified of test status that impacts them. When paired with Predictive Test Selection, the iterative loop for the dev-test becomes lightning-fast.

Use Predictive Test Selection to drastically shorten execution times

Predictive Test Selection to testing gives another dimension (test execution times) to testing efforts that can be used to reduce the cost of testing without impacting either quality or speed of delivery.

It can be used in a variety of use cases, such as:

It applies to verticals including:

Pre-merge tests optimized to run in a shorter timeframe

Our AI secret sauce: Predictive Test Selection

Facebook pioneered predictive test selection, a pragmatic risk-based approach to testing. This new approach to Test Impact Analysis uses machine learning to dynamically select which tests to run based on the characteristics of a code change. Historical test results and information about the tested changes are used to train a machine-learning model to achieve this. The model learns the relationships between the characteristics of code changes and which tests passed and failed, enabling a high-quality prediction of which tests to run.

Launchable's Predictive Test Selection product has made the approach turn-key and accessible to every team.

The ML model for this test suite indicates that by cutting execution time by 50%, we can find 99% of failing builds.

Insights to fix DevX issues caused by unhealthy tests

Most developers know there are unhealthy (e.g., flaky) tests in their test suites that cause friction in their development cycle, but they cannot quantify the impact of these tests to their management leaders. Additionally, the picture is not shared across developers—one dev might perceive the impact differently than others. Consequently, insufficient resources are allocated to fixing issues, increasing development friction. Our ML algorithm will find unhealthy tests, such as flaky tests and others. Developers can use this information to fix the problems that impact their developer experience.

The Launchable AI Test Intelligence Platform

An AI-based Test Intelligence Platform that brings advancements in AI to your development teams. The platform analyzes code and tests metadata to enable developers & team leads to

  • Improve the dev-test loop by bringing feedback from tests into Slack and provides a test sessions dashboard that brings insights on test failures to developers

  • Get meaningful insights on tests suite to eliminate tests causing friction

  • Radically reduce test times while maintaining quality

Code and test metadata are sent from your CI service to the Launchable SaaS. Your code is never sent over to Launchable. Your tests continue executing wherever they reside (on-premises or cloud).

The three benefits of the Launchable SaaS approach for engineering teams

  • Use AI & ML without having to manage and maintain massive AI infrastructure

  • Launchable constantly tunes ML models, offloading such tasks from engineering

  • Results in weeks while the engineering teams focus on other efforts

Launchable provides fast and smart subsets of tests, which are run by our developers on every commit, as well as during nightly and release regressions, benefitting us by giving targeted testing, and saving money on resources.
Roma M. Engineering Manager, Delphix

Works with your existing tools, languages, and processes

Results in weeks—no months-long DevOps transformations

Launchable's ML-based approach means it can work with existing languages and tools. Developers start seeing their dev cycles go faster without changing their processes.

Launchable works with your existing tools