BRIEF #16
August 24, 2026

Platform Pulse: Quantum-Safe KMS, 10B Vector ScaNN, and Zero-Trust Agents

In this 16th edition of the Engineering Brief, we explore quantum-safe key import in Cloud KMS, examine AlloyDB's four-level ScaNN index scaling to 10 billion vectors, and unpack zero-trust architectures for enterprise AI agents.

🔐 Zero-Trust Security, Identity & Threat Defence

Security architectures are actively transitioning towards post-quantum cryptography, verifiable content provenance, and strict cryptographic boundaries for autonomous AI agents.

  1. PQC in Plaintext: Google Cloud’s post-quantum cryptography roadmap: An updated architectural blueprint detailing Google Cloud's strategic timeline to migrate infrastructure and cryptographic services to post-quantum cryptography (PQC) standards by 2029.
  2. Announcing quantum-safe key import in Cloud KMS: Cloud KMS introduces preview support for quantum-safe key import using hybrid post-quantum key encapsulation mechanisms (HPKE_KEM_ML_KEM_768 and 1024), enabling quantum-resilient Bring Your Own Key (BYOK) workflows.
  3. Build zero-trust AI agents with Google's Agent Development Kit: Securing autonomous Agent Development Kit (ADK) pipelines through hardware-backed cryptographic signatures for database writes, kernel-level gVisor sandboxing for dynamic execution, and deterministic semantic gateways for I/O validation.
  4. Staying Ahead of Adversarial AI Through Agentic Source Code Review: A deep dive into Mandiant's internal AI-driven vulnerability discovery architecture, which has discovered hundreds of vulnerabilities in customer codebases and coordinated dozens of CVE disclosures.
  5. Introducing Credentio: Open Source C++ Library for C2PA Content Credentials from Google: Google has open-sourced Credentio, an ultra-fast C++ library providing local-first parsing and validation of C2PA digital content provenance for multi-gigabyte media without cloud latency or data privacy risks.
  6. Going with the Flow(s): Distinct Clusters Target Individuals of Interest to Russia: Threat intelligence analysts track the evolution of Russian cyber espionage clusters targeting Application Specific Passwords (ASP), OAuth authorisation flows, and bespoke malware delivery mechanisms.
  7. Cloud CISO Perspectives: Sticking to security fundamentals in the AI era: Google Cloud CISO Chris Betz outlines why upholding core security fundamentals, strict identity hygiene, and least-privilege governance remains indispensable as generative AI transforms enterprise workloads.
  8. Enterprise Identity Meets Cloud-Native: Securing Firebase & Firestore with Keycloak OIDC: An implementation walkthrough showing how to integrate enterprise Single Sign-On (SSO), Keycloak role mappings, and Cloud Firestore Security Rules using Firebase Auth v2 Blocking Functions.
  9. Open-Source GCP Auditing Tools: 8 Scanners for Security, IAM, Cost, and Reliability (2026): A comprehensive comparative roundup of eight open-source GCP auditing scanners, categorised by whether they perform live API evaluations or offline static analysis.
  10. New to Google SecOps: Drilling Down the House: A technical guide on configuring interactive drilldowns, match and outcome variables, and dynamic dashboard filters in Google Security Operations to accelerate incident triage.

📊 High-Performance Databases, Lakehouse & Big Data Analytics

Data platforms are unifying structured knowledge graphs, deploying vector search at multi-billion scales, and accelerating lakehouse migrations with zero-data-copy architectures.

  1. How AlloyDB ScaNN scales vector search to 10 billion vectors: AlloyDB's four-level tree indexing structure in ScaNN delivers high recall and sub-second query latency across datasets scaling up to 10 billion high-dimensional vectors.
  2. BigQuery Is More Than a Warehouse Now. It’s an AI Runtime: An examination of how BigQuery has evolved into a complete AI runtime, supporting vector search, semantic embeddings, multimodal reasoning, and time-series forecasting directly within native SQL queries.
  3. Using BigQuery Graphs with measures for trusted agentic workloads: Grounding autonomous AI agents in unified enterprise truth by combining property graph relationships with quantitative measures for precise contextual reasoning.
  4. A Practical Blueprint for Google Cloud’s Lakehouse with Iceberg: An end-to-end architectural guide covering catalogue topologies, namespace IAM boundaries, FinOps cost allocation, and multi-tenant data mesh deployments with Apache Iceberg on Google Cloud.
  5. How to Cut GCP Data Pipeline Costs by 60% Without Slowing Them Down: Actionable FinOps strategies and engineering practices to trim BigQuery, Dataflow, Cloud Storage, and Composer infrastructure costs by up to 60% without degrading pipeline throughput.
  6. How to modernise Apache Hive using Google Cloud’s Lakehouse runtime catalogue: Transitioning legacy Apache Hive metastore deployments to modern Iceberg-compatible lakehouse architectures with a runnable, zero-data-copy migration path.
  7. Your BigQuery Bill Is Doing Cardio: A Zero-Data-Loss BigQuery Partitioning Runbook: A production-tested runbook detailing partition pruning, clustering strategies, CDC consistency verification, and safe rollback mechanisms to control analytical compute costs.
  8. When to consolidate scheduled queries into Dataform: Identifying operational inflexion points when unmanaged BigQuery scheduled queries introduce fragility, and transitioning them to version-controlled Dataform pipelines with dependency graphs.
  9. Future-Proofing Your Vector Search: Swapping Open Source Models in BigQuery with Zero Friction: Integrating open-source Hugging Face embedding models directly into BigQuery SQL, creating modular, vendor-neutral semantic search pipelines.
  10. Governance on autopilot, minus the turbulence: Automating enterprise data governance and compliance audits by leveraging column-level lineage to propagate metadata and maintain real-time data contracts.
  11. SCD Type 2 on BigQuery: Stop Rewriting the Partition That Never Changes: Optimising Slowly Changing Dimension (SCD) Type 2 pipelines in BigQuery by restructuring partition schemes and delta merges to eliminate redundant, expensive full-table rewrites.
  12. Stop Writing Self-Joins: 14 BigQuery Window Functions Every Data Engineer Should Know: Eliminating computationally expensive self-joins by leveraging 14 essential SQL window functions for comparative analytics and running aggregations.
  13. Apache Beam to BigQuery CDC in Python: Implementing real-time Change Data Capture (CDC) from AlloyDB into BigQuery using Debezium Server, Cloud Pub/Sub, and Python-based Apache Beam pipelines on Dataflow.

⚡ Cloud-Native Infrastructure, GKE & Serverless Workloads

Infrastructure teams are expanding subsea fibre connectivity, pushing high-density packet processing with AF_XDP, and decoupling storage performance on GKE.

  1. Expanding connectivity in the Americas: Introducing Alisios, Canoa, and OlaLuz subsea cables: Google announces three major subsea cable systems—Alisios, Canoa, and OlaLuz—significantly boosting network capacity, redundancy, and low-latency backbone connectivity across North and South America.
  2. One core, nearly 6 Mpps: testing AF_XDP on Google Cloud C4N: Benchmarking Linux AF_XDP network sockets on network-optimised C4N compute instances, achieving nearly 6 million packets per second on a single vCPU core for high-density virtual appliances.
  3. ClusterNetworkPolicy in GKE: Balancing control and autonomy for your microservices: Enforcing centralised, non-bypassable network security controls across multi-tenant GKE clusters with ClusterNetworkPolicy (CNP) while preserving developer autonomy.
  4. Decoupling File Storage Performance from Capacity & Ensuring Node-Level Resiliency on GKE: Leveraging the Kubernetes VolumeAttributesClass API with Cloud Filestore on GKE to dynamically scale IOPS and throughput independently of provisioned disk volume capacity.
  5. Inside GKE Agent Sandbox: gVisor, Warm Pools, and Snapshots: An architectural exploration of GKE Agent Sandbox, combining gVisor kernel-level isolation, pre-warmed pod pools, and memory snapshotting for safe, low-latency execution of untrusted AI code.
  6. Cloud Run Sandboxes: Building Secure Execution Plane for AI Agents: Designing ephemeral, isolated execution environments on Google Cloud Run to safely evaluate untrusted scripts and execute dynamic agent tool invocations in serverless architectures.
  7. Securing Kubernetes: How to Build a Private GKE Cluster on Google Cloud: A step-by-step security blueprint for provisioning private GKE clusters, isolating worker nodes with private IP addresses, locking down control plane endpoints with Master Authorised Networks, and configuring custom VPC subnets.
  8. I Thought Cloud Run Was the Perfect Fit for My GPU Workload… Until I Needed More Control: Evaluating the architectural trade-offs between Cloud Run GPU serverless abstractions and Compute Engine Managed Instance Groups (MIGs) when low-level CUDA driver tuning is required.
  9. How I Connected Prefect Cloud to GCP Cloud Run Jobs Without a Paid Subscription: Integrating Cloud Scheduler, Cloud Run Jobs, and Secret Manager to orchestrate and observe data ingestion pipelines with Prefect Cloud at zero additional licensing cost.
  10. Codifying FreshCart: Building a Reproducible Two-Tier GCP Architecture with Terraform: Replacing manual cloud infrastructure deployment with modular Terraform scripts covering VPC networking, backend compute services, and Application Load Balancers.

🛠️ AI Agents, Runtimes & Platform Modernisation

The Google Cloud ecosystem is operationalising multi-agent systems, integrating Model Context Protocol (MCP) into standard tooling, and deploying high-efficiency AI accelerators.

  1. Expanding Google Antigravity for enterprise customers: Google expands access to Antigravity, equipping organisations with enterprise-grade autonomous coding agents, customisation skills, and security guardrails to accelerate software delivery.
  2. Introducing the Developer Device Platform for agentic mobile app development: A fully managed cloud platform providing instant, on-demand access to real physical devices and high-concurrency virtual emulators for automated mobile app testing and agentic workflows.
  3. Deploying Secure MCP Servers on Cloud Run: Transitioning Model Context Protocol (MCP) servers from local machines to scalable Cloud Run endpoints using Python and FastMCP, secured with Google Cloud IAM authentication.
  4. How agents can delegate better: Google researchers unveil four foundational principles for multi-agent delegation, focusing on adaptive contract negotiation, clear division of responsibilities, and robust execution guardrails.
  5. X-Ray Your Agent Fleet: Analysing OpenTelemetry traces across thousands of multi-agent interactions as a unified graph within Cloud Spanner to identify cost leaks, latency bottlenecks, and security policy violations.
  6. I built the same agent three ways: Interactions API, ADK, and the Antigravity SDK: A comparative implementation benchmark comparing Google's Interactions API, Agent Development Kit (ADK), and Antigravity SDK by deploying an identical analysis agent on Cloud Run.
  7. Demystifying AI Agent Authentication & Authorisation: OAuth 2.0, PKCE, and DCR: A comprehensive guide to implementing robust identity and access controls for AI agents, covering OAuth 2.0, Proof Key for Code Exchange (PKCE), and Dynamic Client Registration (DCR) on Gemini Enterprise.
  8. HeyGen x Google Cloud: Bringing Avatar IV to TPUs: Porting HeyGen's 18B+ parameter Avatar IV video generation model to Trillium (v6e) TPUs via torchax and XLA, achieving a 1.86x real-time streaming speedup with sequence parallelism.
  9. Why Go is an Ideal Language for AI-Assisted Software Engineering: How Go's strict compiler, fast toolchain, and strict backward compatibility provide deterministic guardrails that help AI coding models self-correct and generate maintainable code.
  10. Five things I found in Google's Agent Registry and Agent Gateway that aren't in the docs: Practical architectural observations, configuration nuances, and operational lessons uncovered when registering and managing production AI agents.
  11. Looker’s Native MCP Server with Claude Code: Connecting coding assistants directly to Looker's native MCP server and CLI, establishing a workflow where AI handles data discovery while the CLI manages query execution.
  12. Mastering Edge AI on Raspberry Pi with LiteRT and Gemma: Deploying lightweight Gemma models onto Raspberry Pi hardware using LiteRT for optimised CPU/GPU execution in local robotics and edge AI applications.

📋 Essential Release Notes

A summary of critical platform updates, feature deprecations, and runtime enhancements rolling out across Google Cloud.

  1. Compute Engine: General Availability of the network- and memory-optimised M4N machine series (powered by 5th Gen Intel Xeon Emerald Rapids, up to 400 Gbps network bandwidth, 25 GiB/s Hyperdisk Extreme, and 5,952 GB DDR5 RAM). Declarative Image Builder is also available in Preview.
  2. BigQuery: Preview support for time-series table-valued functions (ML.TREND, ML.SEASONALITY, ML.DETECT_CHANGE_POINTS). AI agents can execute advanced BigQuery operations via the new run_bq_command tool in the Cloud CLI remote MCP server (Preview), and default user reservation assignments increased from 10 to 100 per project. Support for GA models gemini-3.1-flash-lite and gemini-3.5-flash is also live.
  3. Chronicle Security Operations: Public Preview of Event Simulation for detection coverage evaluation and the Detection Engineering Agent (DEA), which leverages SecOps MCP tools and Gemini to automate threat intel translation and YARA-L 2.0 rule drafting. Ingestion and feed debugging via Cloud Logging is also in Preview.
  4. Cloud SQL for MySQL: MySQL 9.7 is Generally Available in Cloud SQL Enterprise Plus, introducing native vector search with ANN indexing, the hypergraph join optimiser, JSON Duality Views, and major version in-place upgrade support.
  5. AlloyDB: Preview support for Model Context Protocol (MCP) Toolbox for Databases, enabling direct IDE database observability. Enhanced memory estimation and OOM prevention for ScaNN four-level tree index builds have also rolled out.
  6. Cloud Spanner: Dynamic channel pooling (DCP) for gRPC channels is Generally Available in Spanner Go and Java client libraries, preventing channel starvation and reducing configuration overhead.
  7. Cloud Run: NVIDIA L4 GPU driver version 580.x.x is available for services, jobs, and worker pools. Support for the Go 1.27 runtime enters Preview, and App Engine push queue migration to Cloud Tasks / Cloud Run is now GA.
  8. Dataform: The Dataform remote MCP server is now Generally Available to manage data transformation workflows via AI agents. Automated metadata enrichment for BigQuery tables into the Knowledge Catalogue via SQLX is also available in Preview.
  9. Apigee API Hub: Deploy and configure Model Context Protocol (MCP) servers to attached Apigee runtimes using the gcloud apihub locations configure-and-deploy-server CLI command.
  10. Cloud CDN & Networking: Cloud CDN adds support for the targeted CDN-Cache-Control HTTP header (RFC 9213) to control edge cache rules independently of browser caches. Global Front End is in Preview, combining Application Load Balancers, Cloud Armor, Cloud CDN, and Service Extensions into unified Enterprise billing.
  11. Cloud Trace: API limits increased to align with OpenTelemetry OTLP specifications (up to 1,024 attributes per span, 65,532 byte attribute values, 1,024 byte span names). Remote MCP servers now automatically generate trace spans for tool invocations.
  12. Virtual Private Cloud: Private Service Connect endpoints and backends can now access multi-regional service endpoints (e.g. storage.us.rep.googleapis.com) in General Availability.
  13. Cloud Storage: Projects deleted with soft delete enabled now retain their storage buckets throughout the restoration window, allowing seamless bucket recovery if the project is restored.
  14. IAM & Security Command Centre: Custom constraints with Organisation Policy for Agent Identity resources are now GA (agentidentity.googleapis.com/AuthProvider). Security Command Centre integration with Application Design Centre is also GA.
0

From the Community

No community links this week.

Enjoyed this brief?

Don't miss the next drop.