We have released BGA! And wow, It provides 256x (and 512x at the end of 1M) yes 256x LESS attention compute at 1M context window. That means you can train a 1M context window at the compute of a ~4K context window.
Robotics is now the second most downloaded dataset category on the Hub, after text generation.
Robotics datasets got 13.7M downloads in September, ahead of text classification and question answering. Two years ago the category ranked 23rd. One in 7 new datasets is now robotics, mostly LeRobot recordings: typically a few dozen demos, about half of them on low-cost SO-100/SO-101 arms.
I found this after adding datasets and Spaces to Model Pulse, which rebuilds daily history from @cfahlgren1's hub-stats snapshots. Two more findings:
- In 2022, 36% of authors who list training data cited classic NLP sets like IMDb, SQuAD and GLUE. In 2026 it's 2.4%. Reasoning traces distilled from models like DeepSeek-R1 and Claude are now the most cited kind. - In October 2025, 122K Spaces were created, 71K of them websites built with DeepSite. That's about 6x the monthly pace of late 2024, while likes given per month fell from about 35K to about 20K.
New in the app: a page for every dataset, with daily downloads and the models trained on it (636 list FineWeb), a page for every Space, and rankings for both.
Thank you to everyone who liked Model Pulse this week: it made Spaces of the Week and is #7 on trending. Thanks also to @dipankarsarkar, whose comments on the last post fixed three data issues. If a number looks wrong, tell me.
I'm working on a local model that can be run on stuff like an an RTX 3080 at 60 t/s. I'm focused on making it good at Rust and Nix. It's... not done yet, but doing great already. Had a 28/100 on livebench v6 earlier, which obviously isn't amazing.
But for my first real model, very exciting. Can't wait to share more as I get closer to the finish line in the coming weeks.