MATRIX / FOLLOWING

Following

Follow a question, a tool, or what you are building. Major developments remain visible.

Preferences stay in this browser, do not sync automatically, and do not send notifications. To be told about new changes, subscribe by RSS to the whole site, a scenario or a project.

Scenarios & follows

Building agents

Reliable execution, tools, state and evaluation

RSS

Choosing models

Capabilities, availability, cost and licensing

RSS

Local deployment

Open weights, quantization, inference and hardware

RSS

Frontier research

Public papers, experiments and open questions

RSS
UpdateADOPT

vLLM 0.33 moves to CUDA 13 and adds EFA serving and new inference paths

Original story: vLLM 0.33 moves stable builds to CUDA 13 and adds EFA serving

Next stepStage 0.33 and regress CUDA/ROCm images, EFA transfer, paused requests and workload-shaped throughput.

Why read: CUDA baselines and serving behavior change together, directly affecting self-hosted upgrades and rollback.

vLLM 0.32 tightens security defaults and expands low-precision inference

Why read: Security defaults, Python support and streaming contracts change together, requiring a planned production upgrade.

vLLM 0.31 extends fast restart and tightens multimodal request boundaries by default.

Why read: vLLM 0.31 advances both fast recovery and safer multimodal request boundaries.

vLLM 0.33 moves its stable CUDA artifacts to CUDA 13, adds a dedicated AWS EFA image for multi-node KV transfer, and makes ROCm 10 the default while retaining ROCm 7.2 builds. It expands speculative decoding, low-precision KV paths, watchdog diagnostics and large-scale serving. The release also removes CUDA 12.9 artifacts and several legacy executors, so deployment compatibility must be tested before rollout.

Details & evidence →
NewWATCH

Anthropic discloses $17 billion quarterly revenue and $895 billion of compute commitments

Next stepWait for final pricing documents and audited follow-up statements on cash flow, commitment terms and growth durability before changing vendor-concentration decisions.

Anthropic filed its first S-1 amendment with unaudited results through September 2026. It reports $17.0 billion of revenue for the third quarter and approximately $895.4 billion of compute and infrastructure commitments, including $447.5 billion expected before 2031. These are company financial statements and contractual commitments, not cash already paid or independently audited operating results.

Why read: The regulatory filing puts Anthropic quarterly revenue and long-duration compute obligations on one basis, changing vendor and infrastructure risk judgments.

Details & evidence →
UpdateTRIAL

NVIDIA documents Workload Map architecture and three reuse paths

Original story: NVIDIA extends Run:ai with GPU controls and Workload Map reuse

Next stepWithin one day, register one built-in and one custom CRD in an isolated cluster; compare replicas, resources, status and gang scheduling.

Why read: A common workload map can reduce platform adapters, but adoption and interoperability remain mainly vendor-supported.

NVIDIA has combined memory-enforced GPU fractioning in Run:ai with a reusable Workload Map layer for heterogeneous Kubernetes AI workloads. Workload Map converts supported CRDs into a common tree used by Run:ai, KAI Scheduler and, according to NVIDIA, Elotl Nova. The library is Apache-2.0 and released, but production-use and interoperability evidence remains vendor-reported.

Why read: The complete Run:ai GPU orchestration stack is now Apache-2.0 and inspectable, while the community build carries no enterprise support.

Details & evidence →
NewWATCH

OpenAI launches Grid Protectors with an approved Georgia pilot

Next stepReassess after the Georgia campus operates and discloses curtailment duration, notice time, emissions and realized savings.

OpenAI launched Grid Protectors, a national program intended to make future compute campuses reduce demand during grid stress and sometimes supply on-site power or storage. The only finalized example is the approved 25-year Effingham County agreement: about 3.2 GW of planned demand, OpenAI-funded infrastructure and up to 1 GW of flexible demand response. The campus is still in development, so no operational curtailment result exists.

Why read: Load flexibility now has one approved contract, while operational curtailment and rate effects remain unobserved.

Details & evidence →
NewIGNORE

Community audit finds the claimed Anthropic Numbat weights are seeded noise

Next stepDo not mirror or run this repository; for similar leak claims, reproduce a range-read weight check and wait for publisher authentication.

A Hugging Face repository claimed to contain a multi-terabyte checkpoint from an unreleased Anthropic model. A reproducible community audit regenerated 43 complete tensors exactly from a pseudorandom generator seeded by tensor names, and an independent check reproduced nine sampled tensors. Anthropic has not authenticated the repository, so the upload is not evidence of a model leak or release.

Why read: A reproducible audit rejects a viral model-leak claim, helping teams avoid terabytes of fake weights and untrusted code.

Details & evidence →
You have reached the end of this page.
Saved reading

Saved items will appear here.

Manage reading data

Import merges follows, bookmarks and read history. Export to move them manually to another device.