Date Range Customization
I would like the ability to customize the date ranges for your insights tab. Essentially, the week, 30 day, 60, and 90 day options can be limiting.
Query Build & Insights API by tag
Ability to query Insights by tags as well as branches. We run workflows for deployments which are triggered by a git tag. We're currently unable to view performance data for these tags via the Insights UI or API. Related to this, we can currently only view the build runs for git tags by not scoping results to a branch and searching for the tags in the list of builds. We'd like to be able to scope the builds by git tags as well as branches.
Add When Test Became Flaky And Timeframes To Insights
It would be helpful if the flaky test information in Insights also included: A link to when the test first became flaky The ability to see flaky test information from a customized time period
I believe my developers are wasting time and money because of flakey tests -- they rerun a workflow from failed because of a single red test case, and we re-run thousands of previously green tests which eats up CircleCI credits. I'd like to understand re-run behavior; it would be lovely if Insights could collect this data for me and display it!
Warning Status Code
My team is integrating performance metrics into the build and we would like the ability to have a job with a status of warning that turns yellow instead of just having the success/fail statuses so that we can warn developers when performance metrics are getting close to thresholds.
I want to know which tests are failing the most across all branches, not just master. It's nice that Insights shows the most failed test in each branch but 99% of the time what I care about is which tests are flaky when I submit a PR. CCI-I-785
Metrics that track shipping speed
The metrics in insights are currently all focused on the workflows and jobs that Circle runs. Metrics that help me track my team's shipping speed would add a ton of value. Metrics could include: Time to review: the time it takes for a GitHub PR to be reviewed after it is opened Time to prod: the time it takes from when a branch is started to when the branch is merged to master and gets deployed Number of review cycles: stats about the number of rejections a PR gets There are lots of interesting stats here that would bring me back to the Circle dashboard even when I'm not trying to figure out why my build broke.
Link to failed tests
When looking into failed tests from the Top 10 list, I want to be able to drill down into the samples of the failures. As it works now, I have to go click through all failed runs to find one that contains the failed flaky test that I'm investigating. If the test is failing 40% of the time, then I've got a 4 in 10 chance of finding that failure by browsing through failed runs.
Avg time of steps in insights
It would be nice to get info on step timing across builds. CCI-I-505