Building an Automated Engineering Telemetry Pipeline with GitLab CI/CD

Description and use

An automated GitLab CI/CD pipeline aggregates commit metrics from 50+ repositories, generates a daily Markdown log, and publishes an interactive dashboard, eliminating manual reporting.

Problem

Managing dozens of repositories across multiple projects makes tracking engineering velocity difficult, relying on fragmented meetings or manual reports.

Outcome

The pipeline automatically aggregates telemetry, produces a daily markdown log, and publishes a live dashboard, eliminating manual reporting and providing real‑time velocity insights.

Workflow

• Schedule a daily GitLab CI/CD pipeline at 00:00 UTC
• Run Telemetry Collector Job that queries GitLab GraphQL API for commits, merge requests, and test runs
• Aggregate lines changed, PR review velocity, and test run data
• Format aggregated data into a human‑readable markdown ledger (DAILY_UPDATE.md)
• Commit the ledger back to a telemetry repository via GitLab Bot
• Publish the live interactive dashboard through GitLab Pages

Evidence

your version control platform already holds 100% of the ground truth: commit logs, merge requests, review comments, and pipeline durations.

Source

This system autonomously aggregates commit metrics across 50+ repositories, detects velocity bottlenecks, generates a daily markdown audit log, and publishes a live dashboard with zero human intervention.

Source