Topic
Benchmarks
2 stories on this topic, newest first.
ModelsExplainer
How to read a model card without getting fooled
Model cards are part specification, part marketing. Here is a field-by-field guide to the numbers that matter, the ones that are routinely gamed, and the questions a card should answer before you ship on it.
IndustryEditorial
Benchmarks became a marketing channel. Treat them like one
Benchmark tables were meant to be measurements. They are now launch collateral, optimised for by every lab and reported under whatever settings look best. That does not make them useless, but it changes how they should be read.
