Multi-Head Latent Attention and Other KV Cache Tricks
How a Key-Value (KV) cache reduces Transformer inference time by trading memory for computation
Saved
Beyond Human Intervention: Algorithmic Collusion through Multi-Agent Learning Strategies
Our paper, Beyond Human Intervention: Algorithmic Collusion through Multi-Agent Learning Strategies, with Suzie Grondin and Philipp Ratz is now available online Collusion in market pricing is a concept associated with human actions to raise market prices through artificially…
TikTok and the Sorting Hat — Remains of the Day
NEXT POST: Part II of my thoughts on TikTok, on how the app design is informed by its algorithm and vice versa in a virtuous circle.
Qwen AI Introduces Qwen2.5-Max: A large MoE LLM Pretrained on Massive Data and Post-Trained with Curated SFT and RLHF Recipes
The field of artificial intelligence is evolving rapidly, with increasing efforts to develop more capable and efficient language models. However, scaling these models comes with challenges, particularly regarding computational resources and the complexity of training. The…
Alibaba releases AI model it says surpasses DeepSeek
The unusual timing of the Qwen 2.5-Max's release points to the pressure DeepSeek's meteoric rise in the past three weeks has placed on overseas rivals and domestic competition.
The Grammy nominee you need to hear: Esperanza Spalding : It's Been a Minute
How do you bring the African Diaspora to the Grammys?Esperanza Spalding and Milton Nascimento's contrasting tones make a perfect team on Milton + esperanza, a collection of covers, duets, and original songs that have earned the pair a Grammy nomination for Best Jazz Vocal Album…
Improving Uniformity And Linearity For All Masks
Pixel-level dose correction improves the quality of masks written by multi-beam.
Jump, Jive and Fail: The ’90s Swing Craze
How did retro sounds, dance moves, and vintage suits come to dominate before suddenly disappearing?
Aphantasia: Inside The Brains Of People Who Have No Mind’s Eye
Did you know some people can’t see images in their minds? It’s a real issue—and it has a name: aphantasia.
Double Exposure - The American Scholar
On our first memories
From code to production: A guide to continuous deployment with GitLab
Learn how to get started building a robust continuous deployment pipeline in GitLab. Follow these step-by-step instructions, practical examples, and best practices.
7 Proportional Odds Logistic Regression for Ordered Category Outcomes | Handbook of Regression Modeling in People Analytics: With Examples…
Often our outcomes will be categorical in nature, but they will also have an order to them. These are sometimes known as ordinal outcomes. Some very common examples of this include ratings of some...
On MLA
Demystifying GPU Compute Architectures
Getting 'low level' with Nvidia and AMD GPUs
David Leheny (@davidleheny.bsky.social)
Jazz OTD: Two masterpieces for today's Jazz OTD. First, Joe Henderson recorded his landmark septet album "Mode For Joe" on January 27, 1966 with Lee Morgan, Curtis Fuller, Bobby Hutcherson, Cedar Walton, Ron Carter, and Joe Chambers. Perfect hard bop leaning ever so slightly…
Practical Steps to Reduce Heroku Costs
Heroku can quickly get expensive. Dig into this article to learn some concrete strategies to reduce your Heroku bill!
Supercharge SQLite with Ruby Functions
An interesting twist in my recent usage of SQLite was the fact that I noticed my research scripts and the database intertwine more. SQLite is unique in that it really lives in-process, unlike standalone database servers. There is a feature to that which does not get used very…
The Illustrated DeepSeek-R1
A recipe for reasoning LLMs
It’s Time To Retire ‘Millennial Grey’ – Why The Neutral Interior Color Desperately Needs To Go - Yanko Design
For a hot minute, gray was everywhere. Not just a little bit here and there—gray dominated. Gray walls, gray furniture, gray kitchen cabinets, gray exteriors. It was the unofficial uniform of home design in the 2010s, with its cold yet "modern" vibe signaling minimalism…
DeepSeek-R1 vs. OpenAI’s o1: A New Step in Open Source and Proprietary Models
AI has entered an era of the rise of competitive and groundbreaking large language models and multimodal models. The development has two sides, one with open source and the other being propriety models. DeepSeek-R1, an open-source AI model developed by DeepSeek-AI, a Chinese…
How an Obscure Rule Sparked an International Incident in Go
The board game has seen a surge in popularity in recent years. Now a championship-deciding referee’s decision threatens its growth.
ChatGPT Operator system prompt
Johann Rehberger snagged a copy of the [ChatGPT Operator](https://simonwillison.net/2025/Jan/23/introducing-operator/) system prompt. As usual, the system prompt doubles as better written documentation than any of the official sources. It asks users …
Mastering Note-Processing, Lesson 1: Setting Up Your Notebooks
Includes Pictures!!
AI hallucinations can’t be stopped — but these techniques can limit their damage
Developers have tricks to stop artificial intelligence from making things up, but large language models are still struggling to tell the truth, the whole truth and nothing but the truth.
How One Austinite Is Bringing Central Texas–Style BBQ to Thailand
It hasn’t been easy sourcing smokers, big cuts of meat, and properly seasoned wood in Chiang Mai, but Davis Campbell, and his fiancée, Rotjana, do just that for their Dinky’s BBQ.
A simplified analysis of the Chernobyl accident | EPJ N - Nuclear Sciences & Technologies
EPJ N - Nuclear Sciences & Technologies
The neglected ‘laws’ of chemistry – and why they matter | Aeon Essays
Often dismissed as the poor cousin of the sciences, chemistry has revealed natural laws that illuminate our Universe
50+ AI & ML Projects with Python | Aman Kharwal
In this article, I'll take you through a list of 50+ AI & ML projects solved & explained with Python that you should try.
Chinese Fusion Reactor Maintains Steady State For Almost 18 Minutes - Slashdot
Longtime Slashdot readers smooth wombat and AmiMoJo shares a fusion energy breakthrough from China. Charming Science reports: China's "artificial sun," officially known as the Experimental Advanced Superconducting Tokamak (EAST), has achieved a groundbreaking milestone in fusion…
Noteworthy LLM Research Papers of 2024
This article covers 12 influential AI research papers of 2024, ranging from mixture-of-experts models to new LLM scaling laws for precision..
LLM 0.20
New release of my [LLM](https://llm.datasette.io/) CLI tool and Python library. A bunch of accumulated fixes and features since the start of December, most notably: - Support for OpenAI's [o1 model](https://platform.openai.com/docs/models#o1) …
Improving GaN Device Architectures
Novel combinations show promise for different applications.
How Chinese A.I. Start-Up DeepSeek Is Competing With OpenAI and Google
The company built a cheaper, competitive chatbot with fewer high-end computer chips than U.S. behemoths like Google and OpenAI, showing the limits of chip export control.
An Interview with Daniel Gross and Nat Friedman About Models, Margins, and Moats
An interview with Daniel Gross and Nat Friedman about Stargate, DeepSeek, and where the margins and moats will come with models.
The pandemic could have helped Barnes & Noble beat Amazon. That's not what happened
Barnes & Noble had invested significantly in revitalizing its physical stores, and it wasn't ready to make the e-commerce jump.
Inbox | Substack
The Harpies: Beasts of Vengeance in Greek Mythology
The Harpies appear throughout Greek mythology as part-human and part-bird mythological beasts that conjure feelings of dread and disgust in their victims.
The ultra-fast cancer treatments which could replace conventional radiotherapy
A pioneering new treatment promises to tackle a wider range of cancers, with fewer side-effects than conventional radiotherapy. It also takes less than a second.
Rafael Araujo's 20+ Mesmerizing Geometrical Masterpieces - Abakcus
To celebrate Rafael Araujo's talent and vision, I have curated a selection of his most stunning illustrations, showcasing the elegance and intricacy of his work.
A Spy Satellite You’ve Never Heard of Helped Win the Cold War
Engineers at the Naval Research Lab launched a spy satellite program called Parcae and revolutionized signals intelligence at the height of the Cold War. The program relied on computers to sift through intelligence data, providing a technological edge at a pivotal moment in the…
Song Hunter: The Life of Alan Lomax
Alan Lomax was a legendary collector of folk music, author, broadcaster, oral historian, musicologist, and filmmaker who raised the profile of folk music worldwide.
One-Bowl Lemon and Olive Oil Cake Recipe
This standalone lemon cake needs no adornment; no glaze or drizzle, no syrupy soak (just a light dusting of powdered sugar if you want it to be beauty contest-ready) – yet it practically oozes with glowing citrus flavor, thanks to the fruity olive oil, tangy yogurt and a dash of…
Why it’s so hard to use AI to diagnose cancer
The latest effort, from the Mayo Clinic, holds some clues.
The Strange Power of Laughter
An anthropologist explores laughter as a far more complex phenomenon than simple delight—reflecting on its surprising power to disturb and disrupt.
Frustration Tolerance: An Essential for Surviving Large Orgs
In leadership and life, ambitions often outpace our ability to consistently execute on them. A hidden hurdle that trips up many is their level of “frustration tolerance.” This is particularly true in large organizations that are literally designed to frustrate ambitions and…
DeepSeek-R1 and exploring DeepSeek-R1-Distill-Llama-8B
DeepSeek are the Chinese AI lab who dropped the best currently available open weights LLM on Christmas day, DeepSeek v3. That model was trained in part using their unreleased R1 …
kitty.conf
kitty is highly customizable, everything from keyboard shortcuts, to rendering frames-per-second. See below for an overview of all customization possibilities. You can open the config file within k...
Spotify, TikTok and 50 More Great Articles about Music
The best new and classic writing about the world of music
The Derelict • Damn Interesting
A series of accidents and errors amass into disaster at sea. But that's not the end of the story.
Top 10 Game Theory Books to Enhance Strategic Thinking
Explore the best books on game theory to sharpen your strategic thinking. From foundational texts to advanced strategies, these books offer valuable insights for professionals, students, and enthusiasts