Improve Gradle & Maven Flaky Test Management with Test Failure Analytics
Gradle Enterprise is now... Develocity!
📢 We're excited to announce our rebranding of Gradle Enterprise to Develocity. With our new name, we aim to achieve even greater innovation in build & test performance acceleration technologies and analytics. Visit our refreshed site to explore Develocity's powerful capabilities. Click the link below to get started: https://gradle.com/develocity
Video Description:
Flaky, or non-deterministic, tests are a serious and prevalent problem in modern software development. According to Martin Fowler "Non-deterministic tests have two problems, firstly they are useless, secondly they are a virulent infection that can completely ruin your entire test suite. As a result they need to be dealt with as soon as you can, before your entire deployment pipeline is compromised (Eradicating Non-Determinism in Tests). Flaky Tests are a problem for every software team, but most teams lack effective flaky test tracking and analysis tools. This video explains how you can use Develocity to help you identify, prioritize, and fix flaky tests using a data-driven approach.
Some questions you should ask yourself when fixing flaky tests:
When exactly did the flakiness start occurring? What changed right before this started?
How do flaky test runs differ from passed test runs?
Is the test flaky only on certain build hosts?
How has the test execution duration changed over time?
This video demonstrates how you can gather flaky test data and answer these questions in order to deal with flaky tests before they impact your business.
IF AFTER WATCHING THIS VIDEO YOU WOULD LIKE TO TRY DEVELOCITY FAILURE ANALYTICS, PLEASE VISIT https://tv.gradle.com/trial TO REQUEST A TRIAL.
Table of Contents:
00:00:00 - Intro to Failure Analytics and Flaky Test Management: Identity, Prioritize, Fix
00:00:20 - Example of How to Deal with Unexpected Build Failures
00:02:11 - Using Develocity Failure Analytics and Failures Dashboard
00:03:34 - Analyzing Failure Clusters
00:08:26 - Example of how to use Develocity to Troubleshoot Dependency-Related Build Failures
00:10:34 - Leveraging the Develocity Build Scan Comparison Feature to Troubleshoot an Unexpected Failure
To learn more about Reliable Build & Test topics, check out this playlist: https://tv.gradle.com/more-reliable
To get the bigger picture and learn more about other major Develocity benefits, check out these playlists.
Faster Troubleshooting: https://tv.gradle.com/build-faster
Faster Feedback Cycles: https://tv.gradle.com/build-faster
Continuous Learning & Improvement with Trends & Insights: https://tv.gradle.com/improve
CI Cost & Resource Efficiency: https://tv.gradle.com/efficient-ci
Develocity Essentials: https://tv.gradle.com/ge-essentials
Check out our upcoming live workshops: https://tv.gradle.com/training
Use this URL to share: tv.gradle.com/improving-test-reliability