test status summary
When using the feature to persist reports, allow better view of the % of tests passing / failing within workflows that export them. This would also be great to have historical charts of within the job view as well (one of the few things that Jenkins does well), but would be useful for the insights feature as well.
Insights by Job
We use a monorepo in which insights by Job (historical, graphs) is just as essential as insights by Workflow and Repo.
Configurable Time Range
Select a start and end date for the data displaying on the dashboard.
Add metrics for the time that jobs spend waiting for containers to become available in order to be able to run.
Allow Insights API data to be easily exported to dashboard solutions such as Grafana or Prometheus
Having reviewed https://circleci.com/docs/2.0/insights/#sumo-logic-integrationhis could either be , this is quite interesting and has some relevant to what we wanted information, like "Top Slowest Failed/Successful Jobs" with overview for project. We are not using SUMO, but if you are looking for extending to be supported by alike services to feed something like Grafana or Prometheus, etc. This could either be via an orb or the Insights API. CCI-I-1526
Show resource consumption per job
Being able to see resource consumption by category (e.g. CPU, memory), per build and job would be extremely useful when debugging issues. If this was available via the Insights API or UI then we'd rarely need to manually re-run jobs via SSH to inspect state and work out what had occurred.
Alerts and notifications for Insights
As an administrator, operator, or team lead, I would like the ability to configure notifications on Insights to be alerted to unusual behaviors. For example, cited use case was having a lot of junior developers misusing CI resources - they'd like to have alerts or be notified for unusually high-spending jobs, unusually high failure percentages on workflows/jobs/tests, etc.
Insights: Option to filter on multiple branches
Currently, both the Insights UI and API, can only retrieve statistics filtered on a single branch. However, it is very limited if the exact same workflows are run on multiple branches. It would be great to have filter that can filter on multiple branches and all branches,
Report the Accelerate Metrics
The book Accelerate describes four core metrics to measure the performance of your team: Development Frequency, Lead time for changes, Time to restore service, and Change failure rate. Having these metrics in CircleCI would be brilliant, as I see CircleCI as having all these metrics ready to calculate. This article nicely describes the concept: https://www.gocd.org/2018/10/30/measure-continuous-delivery-process/ Here's the link to the book: https://www.amazon.com/Accelerate-Software-Performing-Technology-Organizations-ebook/dp/B07B9F83WM
Workflow success vs. failure rate calculation
How is the workflow success vs. failure rate calculated? I'm looking at the Workflow Success Rate chart and failures seem to be overstated? We make use of cancelled workflow jobs a lot in our deployment pipelines -- for these charts to be useful, we need a way to either exclude cancelled workflows or treat them as success not failure.