Three PyTorch Backends in One Day: The CUDA Moat Starts Leaking
7 min read · 21 sources
- Buying AVGO, $26,429. Meta co-owning a native TPU backend with Google signals TPU volume keeps compounding, and Broadcom designs that silicon.
- Buying GOOGL (Alphabet), $26,365. Air-gapped Gemini opens sovereign deployments competitors cannot match, though Pichai's compute reallocation admits a near-term cloud revenue cost.
- Selling AKAM (Akamai), $25,772.
- AWS TorchNeuron, Google/Meta TorchTPU, and DeepSeek's DeepInfer all landed within a day, each running native PyTorch on non-Nvidia silicon - Trainium, TPU, and Ascend respectively.
- AWS is explicitly marketing TorchNeuron as an alternative to CUDA stacks for startups, the most direct that positioning has ever been.
- Cloudflare shipped three developer items in one day: the tsrs Rust TypeScript compiler claiming 8x speedups, the Clairic structured-extraction model, and a 68% cut to AI code-review inference costs.
Most of today’s feed is routine product cadence. One thread is not: three different organizations, none coordinating, each shipped a way to run native PyTorch on silicon that is not an Nvidia GPU. That is the kind of story that starts quietly and compounds.
Anthropic outgrowing Git is a rounding error in revenue today and a leading indicator for every developer-tooling vendor priced on the assumption that repositories stay Git-shaped.
The CUDA moat, leaking from three directions
The three arrivals:
- AWS TorchNeuron - an open-source PyTorch backend for Trainium2/3, supporting eager execution,
torch.compile, and custom kernels. The notable part is the framing: AWS is positioning it as an alternative to CUDA stacks for startups, i.e., for the exact population that defaults to Nvidia because porting costs exceed chip savings. TorchNeuron attacks the porting cost directly. - TorchTPU - a joint Google/Meta backend for TPUs with full distributed support (DDP, FSDP, DTensor) and no JAX required. Meta co-owning TPU software is the signal here: Meta is a Nvidia’s-largest-customer-scale buyer, and it is investing engineering effort to make TPU a first-class PyTorch target.
- DeepInfer - DeepSeek’s open-source inference framework, serving its V4.1-Flash model on both Nvidia SM100 and Huawei Ascend 950, with optimized kernels and MoE parallelism included. Open-serving the Ascend path normalizes non-Nvidia inference in the exact open-source ecosystem where defaults get set.
The second-order read: the CUDA moat was never really about kernels - it was about the rewrite tax. Three vendors spent today lowering that tax from different directions. The beneficiaries are not the headline names. Broadcom designs both Trainium and TPU silicon, so every developer who can now reach those chips in a one-line config change is incremental volume for AVGO’s custom-silicon business. Amazon gets a credible on-ramp to Trainium for the PyTorch-native startup base. Nvidia loses nothing measurable this quarter - Microsoft pre-training MAI-Base-2 on 16,000 GB200s over 38 days is a reminder that frontier-scale demand still runs through GB-series racks - but we are reversing our neutral stance to negative: the “alternative to CUDA” language appearing in AWS’s own positioning is the first time the lock-in has been attacked explicitly rather than implicitly. The moat is not gone; it is being priced for the first time.
Cloudflare’s 68% cut to AI code-review inference costs ($2.43 → $0.77 per review) belongs in this section too. Model-selection and prompt optimization halved runtime and cut spend by two-thirds with no capability loss. That is the deflationary side of the same coin: efficiency gains like this, replicated across every inference workload, are why the “AI needs infinite GPUs” line keeps needing revision downward per unit of work.
Cloudflare's developer-platform day
NET shipped three things at once: tsrs, an open-source Rust port of the TypeScript compiler (up to 8× faster, ~70% less memory than TypeScript 7.0, built with VoidZero); Clairic, a System One extraction model on Workers AI that returns typed numeric values from unstructured text; and the inference-cost result above. None of these is a revenue event on its own. Together they are a coherent bid to make Workers the runtime layer of the TypeScript toolchain - and Clairic’s pitch, replacing repetitive LLM calls for structured output, is a small but real deflationary force on per-call inference volumes. This is consistent with our positive stance; the ecosystem story keeps adding surface area, which is what you want from a developer platform at Cloudflare’s scale.
Anthropic breaks up with Git
Anthropic built Scion, an in-house version-control system replacing Git for its monorepo, scaling daily merges from 2,500 to over 30,000 to absorb AI-generated code. Read this as an architecture signal, not a product launch: when an AI-native shop generates enough code that merge throughput - not review, not compute - becomes the bottleneck, the assumptions underneath the entire Git ecosystem start to creak. GitLab is the obvious exposed name, and the exposure is not that Anthropic’s migration costs GTLB a customer; it is that the first AI-scaled organization to hit the wall built around Git rather than scaling it. If AI code velocity keeps compounding, Scion is a preview of a procurement conversation that has not happened yet. Small revenue line today, leading indicator for every developer-tooling vendor priced on repositories staying Git-shaped.
Sovereign AI and the agent-security land grab
Two items point the same direction. Google announced air-gapped Gemini capabilities for Distributed Cloud - enterprise search and open-weight frontier models for disconnected, sovereign environments - which is a market where Google’s full-stack ownership is a genuine moat and competitors cannot follow cheaply. Pichai also said the quiet part aloud: Google is allocating compute to frontier research at the expense of near-term cloud revenue. That is an honest trade-off disclosure - a near-term revenue drag we’d normally mark against the stock, offset by a sovereign deployment surface nobody else can match.
On security, Microsoft’s Guardian Agents within Project Perception treat enterprise AI agents as insider-threat equivalents with mandatory oversight, and Google Cloud previewed the Wiz Runtime Sensor for GKE with eBPF-based real-time detection. The second-order effect lands on the standalone vendors: when the platform owners bundle agent oversight and runtime detection into the platform, point solutions have to justify a separate line item. Identity is the enforcement point for agent oversight, which is why this presses on Okta even though Okta is not the company in the headline.
The rest was thin
Nvidia’s Vera server chip detail (Olympus cores, 1024-bit LPDDR5X, 88 PCIe lanes) is an incremental architecture disclosure. IBM’s perspective on IT roles shifting toward orchestration is directionally friendly for ServiceNow’s workflow narrative but carries no new fact. The Claude Science protein-binder work is genuinely impressive science with no read-through to our names. ElevenLabs’ realtime speech-to-speech models, OpenAI’s Locked Chats, and the monitorability-metric extension are interesting to practitioners and immaterial to the book. A thin tail to a day whose head was not.
Scoreboard
| Strategy | Return | Benchmark | Excess | Max drawdown | Days |
|---|---|---|---|---|---|
| Top 5, equal weight | +4.06% | +0.93% | +3.13% | -9.06% | 35 |
| Top 10, conviction weighted | +3.45% | +0.93% | +2.52% | -9.12% | 35 |
| Long top 5 / short bottom 5 | +4.77% | +0.93% | +3.84% | -6.91% | 35 |
| Top 5, free-tier signals | +4.06% | +0.93% | +3.13% | -9.06% | 35 |
The book
| Ticker | Company | Weight | Value |
|---|---|---|---|
| ADBE | Adobe | 0.6% | $634 |
| AKAM | Akamai | 24.5% | $25,798 |
| AMD | AMD | 0.2% | $165 |
| AMZN | Amazon | 24.3% | $25,657 |
| AVGO | Broadcom | -0.2% | $-226 |
| COIN | Coinbase | 0.3% | $366 |
| CRM | Salesforce | -0.7% | $-695 |
| CSCO | Cisco | -0.1% | $-72 |
| DDOG | Datadog | 1.0% | $1,015 |
| GOOGL | Alphabet | -0.2% | $-162 |
| INTC | Intel | 0.1% | $143 |
| META | Meta Platforms | 0.1% | $157 |
| MRVL | Marvell | 0.3% | $298 |
| MSFT | Microsoft | 0.1% | $125 |
| MU | Micron | -0.2% | $-180 |
| NET | Cloudflare | 25.6% | $27,026 |
| NOW | ServiceNow | 0.1% | $130 |
| NVDA | NVIDIA | -0.3% | $-341 |
| OKTA | Okta | -0.9% | $-937 |
| QCOM | Qualcomm | -0.5% | $-476 |
| RBLX | Roblox | -0.0% | $-32 |
| SHOP | Shopify | -0.7% | $-713 |
| SNOW | Snowflake | -0.3% | $-307 |
| TEAM | Atlassian | -0.0% | $-11 |
| XYZ | Block | -0.1% | $-66 |
Trades decided 2026-10-21
Filled at the next session’s open, not today’s close.
| Action | Ticker | Amount | Rationale |
|---|---|---|---|
| buy | AVGO | $26,429 | Meta co-owning a native TPU backend with Google signals TPU volume keeps compounding, and |
| buy | GOOGL | $26,365 | Air-gapped Gemini opens sovereign deployments competitors cannot match, though Pichai’s co |
| sell | AKAM | $25,772 |
You May Also Like
OpenAI Trims to $50B, Banks Underwrite Broadcom's $60B, and Nadella Asks for a Brake
The number that matters today is OpenAI telling investors annualized revenue is approaching $50 billion against earlier $70 billion estimates - the first hard …
Adoption plateaus, enterprise share flips to Anthropic, and Google's TPUs publish a price list
The one hard dataset today is unflattering to the AI growth story: US business adoption stalled at 55.9% and enterprise share has flipped to Anthropic at 43.8% …
Agents Get Permissions, Salesforce Loses Uptime
The permission layer for agents shipped in three places today while a breach at the ChatGPT maker showed the cost of skipping it. Salesforce's global outage …




