Skip to main content

Run Affected Tests + Show Changes in Deploy Preview

Feature RequestCLI

Hi, two related feature requests in one...

It would be great to have the ability to run affected tests before deploying to checkly. This would:

  • Run any newly added tests

  • Run any modified tests

  • Run any tests that depend on a resource that has been modified (e.g. a snippet).

Having this would allow for CI pipelines to ensure that tests actually work before they are deployed when running within Checklys infra.

We have implemented a basic version of the above by using git diff to see what has changed, however it doesn't pick up changes to resources like snippets and is not as powerful as a more native solution that would be comparing against deployed state.

A related request is that npx checkly deploy --preview shows not only new tests as it does now, but also (in the same way as git does) shows tests that have been edited.

Posted by James McNee ·
1 comment

Log in to comment and vote

Comments1

  • Tim Nolet

    •

    Oct 13, 2023

    @James McNee thanks for mentioning this. Seem to all be good use cases. We will have to see where the best trade off is between native support of change sets, and where we need to lean on git.