athena.py: implement native support for CA (backport to 24.0)

Cherry-pick of !69664 (merged) into 24.0. These changes have been in main for ten days now without any problems. So it should be safe to back-port this in order to have a common user experience on the athena command line.

ℹ These changes have already been reviewed as part of the original MR.