Pipelines - allow filtering by dates
Canny AI
Merged in a post:
Pipelines - Filter Between Dates
N
Nate Goethel
Add two date-picker filters to find pipelines between two given dates/times.
Canny AI
Merged in a post:
Date-filtering API endpoints
N
Nick Venenga
We'd like to be able to efficiently ETL data out of CircleCI into our data warehouse so we're able to perform joins to other data sources and advanced analytics. In order to facilitate this process, we're using Fivetran. However, Fivetran makes over a million API requests to pull data which takes a significant amount of time.
In order to facilitate incremental syncs, we'd like to see API endpoints provide filtering on "updated_at" and "created_at" attributes
Canny AI
Merged in a post:
API Date Filtering
S
Stewart T
We'd like to be able to extract pipeline data from CircleCI by date. Currently, if I want to get pipelines for a project from May 2024, I would have to utilize the following api request and then paginate backwards until my target date. For some repos, this can be thousands of requests to just reach the location I need.
Harry Betancourt
Having to paginate back thousands of times to retrieve pipeline data by date is inefficient, retro bowl, and requires a date filtering solution from the start.
Simon McManis
Specifically in the CircleCI UI. It is tedious to scroll through the paginated results to find an old pipeline.
c
chris.hronek@dominodatalab.com
Ditto on this, for those of us ETL'ing CircleCI data into a data warehouse - we cannot incrementally load pipelines. We have to full load all of them every time. This is very inefficient. I've included a screenshot of the desired behavior here.