GCP Monitoring & Observability Hub 📈

Google Cloud Observability (formerly Stackdriver) provides an integrated, enterprise-scale telemetry suite covering the four pillars of modern observability: Metrics, Logs, Traces, and Continuous Profiles. Engineered to run natively at hyper-scale, it provides full-stack visibility across Google Cloud infrastructure, multi-cloud platforms, and Kubernetes clusters with deep OpenTelemetry (OTel) standard integration.


Service Catalog & Architecture Map

ServiceTelemetry PillarCore Architecture & EngineReference Guide
Cloud MonitoringMetrics & AlertingMetric scopes, Monitoring Query Language (MQL), SRE SLO error budgets, and Managed Service for Prometheus (GMP).Cloud Monitoring Deep Dive
Cloud LoggingStructured Log StreamHigh-throughput Log Router, exclusion filters, BigQuery SQL log analytics, and log-based metric generation.Cloud Logging Deep Dive
Cloud TraceDistributed TracingDistributed latency tracing, OTLP ingestion, span waterfall visualization, and automated bottleneck detection.Cloud Trace Deep Dive
Cloud ProfilerContinuous ProfilingZero-cost continuous production CPU, wall time, heap, and thread profiling with flame graph analysis.Cloud Profiler Deep Dive
GKE Observability & GMPKubernetes TelemetryContainerLogV2 logging, PodMonitoring / ClusterPodMonitoring CRDs, and native PromQL querying.GKE Observability & GMP

The Unified Observability Data Flow

flowchart LR
    subgraph WorkloadEcosystem ["Workloads & Infrastructure"]
        GKE["GKE Workloads (OTel Collector & PromQL)"]
        GCE["Compute Engine VMs (Ops Agent)"]
        Run["Cloud Run & Serverless Endpoints"]
    end

    subgraph ObservabilityPillars ["Google Cloud Observability Suite"]
        direction TB
        Logging["Cloud Logging (Log Router & Sinks)"]
        Monitoring["Cloud Monitoring (MQL & Alerting)"]
        Trace["Cloud Trace (Span Aggregation & Waterfall)"]
        Profiler["Cloud Profiler (Continuous Flame Graphs)"]
    end

    subgraph AnalyticalSinks ["Downstream Sinks & Storage"]
        LogAnalytics[("BigQuery SQL Log Analytics")]
        GCS_Archive[("Cloud Storage (Long-Term Retention)")]
        Grafana["Managed Prometheus / Grafana Dashboards"]
    end

    WorkloadEcosystem --> Logging
    WorkloadEcosystem --> Monitoring
    WorkloadEcosystem --> Trace
    WorkloadEcosystem --> Profiler

    Logging --> LogAnalytics
    Logging --> GCS_Archive
    Monitoring --> Grafana