allow excluding passive detectors from modules - analogous to aux detectors

I noticed that a detector with role="passive" will also show up in a lot of places I would not expect it - e.g. histograms created in the clustering module, the prealignment module tries to align it, ...

If my understanding of what a "passive" detector is supposed to be is right, wouldn't it make sense to have the option to exclude it from certain modules, same as for auxiliary detectors?