Currently it's very tidous,

every new repo i open it defaults to alerting me on all of the pipelines instead of just mine

I suggest that there will be a record in setting.json that specifies the value for that instead of it being in memory