CircleCI Ideas

Show insights by project and not only by the branch

Lately, the "Insights" show us the frequency that a test breaks in a branch in our repo. But this information is not sufficient for us, so it would be great if there was a way that Insights showed what tests were broken by project and not only by branches.

  • Avatar32.5fb70cce7410889e661286fd7f1897de Guest
  • Feb 14 2018
  • Taking votes
  • Attach files
  • Avatar40.8f183f721a2c86cd98fddbbe6dc46ec9
    Guest commented
    28 Jan 07:08pm

    +1 this.
    I really want to see failed tests insights at the project level. Flaky tests in PRs delay delivery and having insight into which tests need attention would allow me to advocate for spending time fixing specific tests.

  • Avatar40.8f183f721a2c86cd98fddbbe6dc46ec9
    Guest commented
    2 Jul, 2019 11:31pm

    Thank you so much for your feedback. Internally, we have discussed to provide this data at different levels eg. organization or project.

    Would any of you be interested in doing a formal user interview with us? It is 45 min video call to capture feedback around metrics that you are expecting out of a CI tool. If you are interested, please fill this survey.

    Thank you so much!

  • Avatar40.8f183f721a2c86cd98fddbbe6dc46ec9
    Guest commented
    18 Jun, 2019 08:08am

    +1 - it would definitely be more useful to see insights rolled up to the project level rather than being forgotten about at the individual branch level.

  • Avatar40.8f183f721a2c86cd98fddbbe6dc46ec9
    Guest commented
    27 Feb, 2019 11:59pm

    +1, the default slicing of builds by branch leads to mostly useless results, since some builds include migrations etc and we want a more consistent trend graph of how long our tests are taking.

  • Avatar40.8f183f721a2c86cd98fddbbe6dc46ec9
    Guest commented
    14 Mar, 2018 03:28pm

    +1 this.

    Half of our runs are on master, and half are on PR status checks.  The PR status checks are not shown in Insights because they are always on different branches.  Those are the ones more likely to fail, and therefore more interesting to analyze.