Back to AI News
MarkTechPost

Google adds dual-chip TPU 8i Max and confidential TPU 8tx to eighth-gen lineup

Google announced TPU 8i Max and TPU 8tx as new system configurations within its eighth-generation TPU lineup. TPU 8i Max packages two TPU 8i chips to double compute, SRAM and HBM bandwidth in the same rack footprint for large-context workloads, while TPU 8tx uses TPU 8t silicon with 5th Gen AMD EPYC hosts and Boardfly networking for confidential inference. Google also detailed associated software updates including TorchTPU, vLLM and SGLang TPU backends, TPU Sync and a preview TPU agent suite. Google did not publish absolute specs, benchmarks, prices or regions for the two new systems.

AI Brief

Readers get a concise look at Google's latest TPU packaging and confidential-computing push, plus the software stack changes that accompany it.

Google has added two new systems to its eighth-generation TPU lineup. TPU 8i Max targets massive context windows and rack density. TPU 8tx targets secure, confidential inference. Google TPU 8i Max is a dual-chip package built from 2 TPU 8i chips. Both arrive alongside TPU 8t and TPU 8i, announced in April.

TL;DR

  • Size: TPU 8i Max = 2 TPU 8i chips in 1 package. TPU 8tx = TPU 8t silicon plus 5th Gen AMD EPYC hosts.
  • Runs on: Google Cloud TPU systems.
  • Performance: 8i Max doubles TPU 8i compute, SRAM and HBM bandwidth. 8tx cuts latency up to 2x versus TPU 8t.
  • Best: 2x the silicon in the existing rack footprint (TPU 8i Max).
  • Worst: No absolute specs, benchmarks, prices or regions published for either system.

What did Google announce?

Google announced both systems today. These are new system configurations, not new chips. Google reuses its existing eighth-generation silicon and changes packaging, hosts, memory and networking around it.

How does TPU 8i Max work?

TPU 8i Max attacks the memory wall. Google team combines 2 low-latency TPU 8i chips onto 1 package. The result doubles compute, SRAM and HBM bandwidth compared with TPU 8i.

Each TPU 8i chip is rated at 10.1 PFLOPS of FP4, 288 GB of HBM and 8,601 GB/s. It also carries 384 MB of on-chip SRAM. Doubling those figures implies about 20.2 PFLOPS FP4, 768 MB SRAM and 17.2 TB/s per package. Google did not publish these absolute figures. It also did not state HBM capacity for TPU 8i Max.

TPU 8i Max fits twice the silicon in the existing rack footprint. Google positions it for agents working across whole codebases or hours of video.

What makes TPU 8tx different?

TPU 8tx is built for regulated enterprises and governments. It keeps data and model weights protected even while in active use. Normally, data must be decrypted in memory during processing.

TPU 8tx uses the same silicon as TPU 8t. It pairs that silicon with 5th Gen AMD EPYC CPU hosts. It also adopts the Boardfly network from TPU 8i. Google claims up to 2x lower latency than TPU 8t, with a near-zero security penalty.

Teams can fine-tune, distill and run reinforcement learning on 1 system. That avoids moving sensitive data between separate clusters.

What changed in the TPU software stack?

  • TorchTPU: Open-sourced last month, it runs PyTorch and Hugging Face models natively. vLLM and SGLang get TPU backends.
  • TPU agent suite (preview): Plugs into Claude Code, Cursor and Antigravity for onboarding and kernel tuning.
  • TPU Sync: An open-source C++ library that tiers KV cache across HBM, host DRAM and storage.
  • Agent Compute Engine: Suspends idle agent sessions and moves working memory off-chip. Preview is targeted for the coming months.
  • Cloud Pathways and GKE dynamic slicing: Both are now GA. Dynamic slicing cuts job startup up to 5x and speeds fault recovery up to 4.5x.

On Qwen3 235B, TPU Sync dropped median KV transfer latency from several seconds to about 230 ms. TTFT fell 60% on average for 235B and 90% for 480B under low concurrency. These tests ran on Ironwood (TPU v7x), not the new systems.

How do the numbers compare?

SpecGoogle TPU 8i MaxGoogle TPU 8txNVIDIA Rubin GPUMicrosoft Maia 200AWS Trainium3
RoleLong-context inferenceConfidential inference, small-scale trainingTraining and inferenceInferenceTraining and inference
Silicon2x TPU 8i chipsTPU 8t siliconDual-die GPUTSMC 3nmTSMC 3nm
Peak FP4~20.2 PFLOPS (derived)Not disclosed (TPU 8t: 12.6)50 PFLOPS NVFP4>10 PFLOPSNot disclosed (2.52 PFLOPS FP8)
HBM capacityNot disclosedNot disclosed (TPU 8t: 216 GB)288 GB HBM4216 GB HBM3e144 GB HBM3e
HBM bandwidth~17.2 TB/s (derived)Not disclosed (TPU 8t: 6.5 TB/s)22 TB/s7 TB/s4.9 TB/s
On-chip SRAM~768 MB (derived)Not disclosed (TPU 8t: 128 MB)Not disclosed272 MBNot disclosed
Host CPUNot disclosed5th Gen AMD EPYCNVIDIA VeraNot disclosedNot disclosed
Availability2027 (Bloomberg via Quartz)2027 (Bloomberg via Quartz)H2 2026 volume productionAnnounced Jan 2026Trn3 announced Dec 2025

Derived = 2x Google’s published TPU 8i per-chip figures. TPU 8t values come from Google’s technical deep dive.

 Google TPU explainer

TPU 8i Max and TPU 8tx: how Google's 4-system TPU lineup fits together

Click through the lineup, build the dual-chip package, and see where KV cache moves.

TPU 8tTraining
April 2026
TPU 8iLow-latency reasoning
April 2026
TPU 8txConfidential inference
New · Nov 9
TPU 8i MaxMassive context
New · Nov 9
TPU 8i
TPU 8i
TPU 8i Max package

TPU 8i figures are Google's published per-chip specs. TPU 8i Max values are derived as 2x, per Google's "double the compute, SRAM and HBM bandwidth" claim. Google has not published absolute TPU 8i Max figures or its HBM capacity.

Is the data protected?

StageAt restIn transitIn use
Normal???
TPU 8tx???

What sits in the system

ChipTPU 8t silicon
Host5th Gen AMD EPYC CPUs
NetworkBoardfly (from TPU 8i)
Latency vs TPU 8tup to 2x lower

Built for regulated enterprises and governments. Supports fine-tuning, distillation and RL on 1 system. Google Cloud's repost describes the hosts as "custom AMD CPU hosts". The attestation design is not published.

KV cache tiers (click Play)

Tier 1TPU HBM
Tier 2Pinned host DRAM
Tier 3Shared storage (experimental)
PeerDecode node via DCN

Google-reported results (Ironwood, TPU v7x)

TPU Sync is an open-source C++ library. Results come from Google's internal tests in July 2026 on TPU v7x under low concurrency, not on TPU 8tx or TPU 8i Max.

Rubin, Maia 200 and Trainium3 figures come from vendor announcements. TPU 8i Max values are derived (2x TPU 8i). Trainium3 FP4 is not disclosed, so it is left out of that view. Peak specs are not benchmarks.

Sources: blog.google, Google Cloud Blog, NVIDIA, Microsoft, AWS© Marktechpost

Key Takeaways

  • TPU 8i Max puts 2 TPU 8i chips in 1 package.
  • It doubles TPU 8i compute, SRAM and HBM bandwidth.
  • TPU 8tx brings confidential inference to TPU 8t silicon.
  • TPU Sync cut KV transfer latency over 90% on Ironwood.


Check out the official announcement, the TPU 8t and 8i deep dive, and the TPU Sync repo. Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter. Wait! are you on telegram? now you can join us on telegram as well.

Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.? Connect with us

The post Google Unveils TPU 8i Max and TPU 8tx: A Dual-Chip TPU and a Confidential TPU appeared first on MarkTechPost.

Be the first to rate this article.

Comments & Questions (0)

Captcha
Please be respectful — let's keep the conversation friendly.

No comments yet

Be the first to comment!