A bit more economical replacement for MR62850

This should have the same effect as !62850 (merged) but we set things already at the "cache" level for the special maps.

ping @schaffer , @jmaurer , @goetz