Grafana

Comprehensive observability for Amazon SageMaker AI LLM inference: From GPU utilization to LLM quality

This post showcases a comprehensive observability solution utilizing Amazon Managed Grafana dashboards. It provides a holistic view of both the quality and quantity of LLMs served on Amazon SageMaker AI inference endpoints.