Evidently helps evaluate, test and monitor your AI-powered products. From ML-based classifiers to LLM chatbots and agents. Built on top of the leading open-source library with over 20 million downloads: github.com/evidentlyai/evidently
It does a good job at detecting data drift and alerting you when your models are underperforming. The analytics and visualisations pretty useful in multiple occasions.