Hi, two related feature requests in one...
It would be great to have the ability to run affected tests before deploying to checkly. This would:
Run any newly added tests
Run any modified tests
Run any tests that depend on a resource that has been modified (e.g. a snippet).
Having this would allow for CI pipelines to ensure that tests actually work before they are deployed when running within Checklys infra.
We have implemented a basic version of the above by using git diff to see what has changed, however it doesn't pick up changes to resources like snippets and is not as powerful as a more native solution that would be comparing against deployed state.
A related request is that npx checkly deploy --preview shows not only new tests as it does now, but also (in the same way as git does) shows tests that have been edited.