grafana dashboard are not loading in kubernetes-1.32.2-1 template

cluster created with the following configuration os coe cluster create jack-132 --cluster-template kubernetes-1.32.2-1 --keypair jmunday --merge-labels --label monitoring_enabled=true --master-flavor=m2.large --flavor=m2.large

this is not an issue in any of the other cluster templates, so i would assume that is it the addition of the cilium with monitoring enabled that is breaking things, but I can not see how / why yet. I will need diana's help to debug this further...

$ kubectl -n kube-system logs cern-magnum-grafana-589f7495c6-ncghq -c grafana-sc-dashboard --since=10s
{"time": "2025-03-14T09:49:07.393328+00:00", "level": "ERROR", "msg": "ApiException when calling kubernetes: (504)\nReason: Timeout: Timeout: Too large resource version: 4402, current: 2393\n\n"}
{"time": "2025-03-14T09:49:08.196672+00:00", "level": "ERROR", "msg": "ApiException when calling kubernetes: (504)\nReason: Timeout: Timeout: Too large resource version: 4405, current: 2859\n\n"}
{"time": "2025-03-14T09:49:15.436444+00:00", "level": "ERROR", "msg": "ApiException when calling kubernetes: (504)\nReason: Timeout: Timeout: Too large resource version: 4430, current: 2393\n\n"}

$ kubectl get configmaps -o custom-columns="NAME:.metadata.name,RESOURCE_VERSION:.metadata.resourceVersion" -A | grep -E '2393|2859'
prometheus-cern-magnum-kube-prometheu-prometheus-rulefiles-0   2393

Looking at the rule file statuses in prometheus they are all healthy so I am unsure.