Netflix Technology Blog (Sep 25) β Closes the gap between cloud-provider identity (AWS IAM execution roles on managed compute) and first-class internal service identity (Metatron private PKI β short-lived X.509 + mTLS). Shown for Spark on EMR; design is general beyond Spark/EMR. Anchor: each Data Project maps 1:1 to a dedicated IAM role, sharded across accounts past tens-of-thousands role limits. Flow: control plane signs a claim (identity + role + scope); driver proves possession via pre-signed sts:GetCallerIdentity URL (AWS answers which role signed β workload cannot lie); Identity service corroborates provider statement with platform statement and issues scoped certs only at the intersection. Fan-out: executors inherit driver credentials over authenticated AES-GCM Spark RPC (avoids STS/attestation amplification). Renewal is a repeatable driver timer β not a one-shot bootstrap.
π₯ What Changed
π Worth Your Time
USENIX NSDI β26 β Replaces uniform 2Γ dual-region capacity with tiered failover classes (Always-On / Active-Migrate / Restore-Later / Terminate) aligned to business criticality. Non-critical workloads oversubscribe critical servicesβ idle failover buffers at steady state; on rare full-peak regional failover, OMG orchestrates eviction β batch-cluster βburstβ conversion β optional cloud burst. Safety stack: runtime fail-close dependency analysis over trillions of RPCs/week, static Go/Java error-propagation analysis, canary regression gate (~8k deploys/week). Impact: steady-state 2Γ β 1.3Γ, utilization ~20% β ~30%, ~1M CPU cores returned, 4,155 fail-close violations hardened, 99.97% trip availability through a documented 17-hour production failover. Scope: stateless microservices (~75% of cores); stateful deferred.