Everything posted this week — 2 links.


The shelf life of LLM findings

Almost half (44%) of our tested claims are now expired in today’s models. Another 34% have weakened significantly, 16% persist, and 6% have strengthened relative to the original claim. Persistence varies by topic. Five of nine reasoning claims and six of eleven sycophancy-and-deception claims are classified as expired. Three of ten claims about models as judges, reviewers, and raters persist or strengthen.

Stanford researchers retest 50 widely cited LLM findings - most fade within 15 months via x.com


What Millions of Data Points Reveal About US Inflation

Each month, the BPP tracks millions of prices, with sources spanning e-commerce sites, credit- and debit-card transactions, retail food surveys, regulatory filings, pharmacy transactions and corporate datasets. The goal is to measure prices in a way that is as close as possible to the approach used by BLS, but adapted to alternative sources.

We construct price indexes at a deeper level of granularity than the CPI, breaking them down by criteria like product, geography and brand.

The Bloomberg Price Project rebuilds the US CPI from millions of prices at almost 700 line items via x.com