Add CA-based version of CollectionMerger configuration tests. Also addresses an issue in the legacy configuration tests found in !61874.
Tagging @tadej