This patch redefines the metrics flow to improve reliability and mitigate errors previously encountered in Fluent Bit components during metrics scraping from Prometheus. It transitions from Fluent Bit scraping Prometheus to a model where Prometheus performs remote writes directly to Fluent Bit, which then forwards data to the monitoring infrastructure as before. Key updates include:
Service for Fluent Bit to enable Prometheus remote write.prometheus.yaml and statefulset.yaml for robust remote write handling.values.yaml to support configurable Fluent Bit replicas and advanced remote write settings.This refactor addresses issue MONIT-4077 and aims to enhance the stability and maintainability of the monitoring pipeline.