Skip to content

IsoFunctional Testing

This feature is an option of both the smoke tests and the replay (same command, same config) but it compares the results of two different environments.

How to

With the option --isoWith env, Zoidberg runs all the tests defined in the artillery.yml file on the environment passed to -e and on the environment passed to --isoWith. It then compares the results of the two environments and generates a report.

Example — compare a deployed PR against develop:

zoidberg smokeTests -e develop --versionPR 12 --isoWith develop
zoidberg replay -e develop --versionPR 12 --isoWith develop

Note

The --isoWith option has no way to define a PR number, which means we cannot compare two PRs — we can only compare a PR with a "main environment".