Sign upSign InSign upSign InSeifeddine RajhiFollowITNEXT--ListenShareA Comprehensive Guide to Monitoring AWS EKSAmazon Elastic Kubernetes Service (EKS) is a managed Kubernetes service that makes it easy to run Kubernetes on AWS. However, EKS doesn’t come with a built-in monitoring solution. This means that you need to set up your own Monitoring Stack if you want to track the health and performance of your EKS cluster.In this article, we will show you how to create a monitoring stack for AWS EKS using Grafana, Prometheus, AlertManager, Promtail, and Loki. These open source tools provide a comprehensive monitoring solution that can help you track all aspects of your EKS cluster, from metrics to logs.We will walk you through the steps of installing and configuring these tools, and we will show you how to create dashboards in Grafana to visualize your data. By the end of this article, you will have a solid understanding of how to monitor your AWS EKS cluster using open source tools.If you are looking for a comprehensive and cost-effective monitoring solution for your AWS EKS cluster, then this monitoring stack is a great option.So, roll your sleeves and let's get cracking! 🔥Kube-Prometheus-stack, also as Prometheus Operator, is a popular open-source project providing complete monitoring and alerting solutions for Kubernetes clusters. It combines tools and components to create a monitoring stack for Kubernetes environments.We will use the official Helm Chart Kube-Prometheus-stack,with a customized value file.To deploy the monitoring stack, follow these steps:Edit the ValuesRun the Helm Deployment Command.After we deploy the Kube-Prometheus stack, we get :To check if all work, you can below command:You’ll have to look at the Prometheus and Grafana dashboard.Prometheus Dashboard from Kube-Prometheus-Stack Helm ChartGrafana Dashboard from Kube-Prometheus-stack Helm ChartCreate a self a ServiceMonitorPrometheus Operator uses ServiceMonitors to auto-detect target pods based on the label selectors and associate them with the Prometheus instances. Let’s take a look at the manifest below:The ServiceMonitor defined above will select pods labeled app: kube-prometheus-stack-prometheus using spec.selector.matchLabels field.Run ServiceMonitor manifest in this command:Promtail is a log agent that ships logs to Loki, a horizontally scalable, highly available, and efficient log store. Loki can be integrated with Grafana to create dashboards that visualize your logs and metrics. This integration provides a powerful way to monitor your applications and infrastructure.Loki uses Promtail as its primary log collector, but it can also accept log flows from other sources, such as Syslog or other log senders.It offers high uptime and supports data replication across multiple replicas for durability and fault tolerance. Loki is tightly integrated with Grafana, allowing you to visualize log metrics.Like Prometheus, but for logs.After we deploy Loki, we need to update the Kube-Prometheus-stack values file to add additional Data Sources.Please refer to helm values here.Promtail can log files from different sources, including local files, container output streams (stdout and stderr), and systemd journals.It supports the development, filtering, and relabeling of logs before sending them to Loki.Please refer to helm values here.Run the Helm upgrade Command.After we have done deploying Promtail and Loki,two new data sources will be presented to Grafana.Run the command:Connect to Grafana -> Menu -> Data SourcesThe work is done.Setting up a monitoring stack for Kubernetes is a complex task, but it is essential for ensuring the health and performance of your applications. The steps outlined in this article provide a good starting point, but they are just the beginning. In most cases, workloads will not be limited to Kubernetes pods and containers. There will also be a need to monitor virtual machines and other infrastructure components. A unified logging mechanism based on the same tools is essential for getting a complete view of your system.Thank you for Reading, see you in the next post. 🤟🚀 Feel free to connect with me :♻️ LinkedIn: https://www.linkedin.com/in/rajhi-saif/♻️ Twitter : https://twitter.com/rajhisaifeddineThe end ✌🏻----ITNEXTI build and break stuff, preferably in the cloud, ❤ OpenSource.Seifeddine Rajhi--1Juntao QiuinITNEXT--10Daniel GlejznerinITNEXT--11Seifeddine RajhiinITNEXT--3Love SharmainByteByteGo System Design Alliance--55Lahiru Peramune--2Rico FritzscheinLevel Up Coding--25Thilina Ashen GamageinPlatform Engineer--2Akriotis Kyriakos--Tuhin BanerjeeinCloud Native Daily--HelpStatusWritersBlogCareersPrivacyTermsAboutText to speechTeams