Add CTA regression test with and/or to EOS
In some occasions there have been new EOS releases that break backward compatibility with CTA.
This is usually only detected after a new EOS version is released and tested against CTA, which may happen weeks or months after the bug has been introduced. At this point the cost of fixing it is higher for both teams.
One example of this regression (being solved ATM) can be found here:
Ideally, we should have an automatic way to test CTA against new versions of EOS. However, there are a few obstacles such as:
- Maintenance cost of this CI test for the EOS team.
- Running MHVTL with Kubernetes is challenging!
- We cannot provide a simple Helm Chart to run CTA.
- ...