Garanti del Talento

dgt_sre08 – Error Budget, Metrics and Monitoring

Module Title: dgt_sre08 – Error Budget, Metrics and Monitoring

Overview:

This module covers error budgets, metrics, and monitoring in the context of Site Reliability Engineering, and is intended for Site Reliability Engineers (SREs) and related professionals. The curriculum combines the theoretical foundations and the practical strategies needed to manage system reliability and performance effectively in dynamic software environments.

Error budgets are arithmetic before they are tooling, so you first learn to reason about SLIs, SLOs and burn rates on paper. Then you move to natural language: you tell the AI agent which user journeys matter and what “reliable enough” means for them, and ask it to turn that into SLIs, recording rules, burn-rate alerts and an error budget dashboard. Your job is to check that the queries measure what users actually experience, that the alert windows match the math, and that nothing the machine proposes quietly redefines the SLO.

Module Objectives:

  • Understand the concept of error budgets as a key component of SRE practices.
  • Learn how to define and measure metrics that align with business objectives and service level agreements (SLAs), and how to specify them to the machine without ambiguity.
  • Understand the monitoring techniques and tools essential for maintaining system health and reliability, well enough to direct their setup and validate the results.
  • Develop skills in using error budgets to balance innovation and stability within software teams.

Key Topics:

  1. Introduction to SRE Principles
  2. Overview of Site Reliability Engineering

  3. The role of SRE in modern tech organizations

  4. Understanding Error Budgets

  5. Definition and importance of error budgets in SRE
  6. How to calculate and manage an error budget

  7. Strategies for using error budgets to drive decision-making

  8. Metrics and KPIs in SRE

  9. Key performance indicators (KPIs) relevant to SRE
  10. Designing effective metrics aligned with business goals

  11. Tools and techniques for collecting and analyzing SRE-related data, and how to verify the data the machine collects

  12. Advanced Monitoring Techniques

  13. Overview of monitoring frameworks and tools
  14. Alerts and incident response mechanisms: describing them in natural language and reviewing the rules generated

  15. Utilizing logs, traces, and metrics for comprehensive system visibility

  16. Case Studies and Best Practices

  17. Real-world examples of successful error budget management

  18. Lessons learned from industry leaders in SRE

  19. Balancing Innovation with Reliability

  20. Using error budgets to foster a culture of experimentation while maintaining reliability
  21. Strategies for incremental improvement without sacrificing stability

Module Materials:

  • Recommended readings include foundational texts such as “Site Reliability Engineering: How Google Runs Production Systems” by Niall Richard Murphy, Betsy Beyer, Chris Jones, and Jennifer Petoff.
  • Supplementary articles and whitepapers from SRE practitioners and organizations.

Target Audience:

This module is intended for SRE professionals, DevOps engineers, system administrators, and anyone involved in the management of software reliability. It is suitable both for beginners and for experienced practitioners.

Module Format:

The module is delivered through a blend of lectures, interactive workshops, case studies, and natural-language exercises in which you instruct the machine to implement SLOs, alerts and dashboards, then review, verify, and correct its work. Participants have access to online resources, forums, and mentorship throughout the program.

The students can push their exercises to the Academy DevOps & SRE Git project. For this module, create a folder with your username as its name in the following subfolder: https://github.com/Garanti-Del-Talento/gdt_academy