System-Technology Co-Evaluation of A7 CFET and A10 NSFET...

Complementary FETs (CFETs) extend nanosheet FET (NSFET) scaling by vertically stacking n- and p-type gate-all-around (GAA) devices, thereby shrinking standard-cell area. The performance gain, however, cannot be assessed from device metrics alone, as CFET layouts also introduce…

Note: Summary: This arXiv paper compares two next-generation chip technologies — A7 CFET and A10 NSFET — using a physics-based evaluation flow spanning from cell parasitics up to full-chip reliability. Approach: CFETs stack n- and p-type devices vertically to shrink cell area, but add extra cell-level resistance and capacitance. The authors built a flow linking calibrated device models, standard-cell…

Why Large Language Models Fail at Tabular Prediction

Large language models (LLMs) have become the default tool for a remarkable range of tasks, yet they have had conspicuously little success at one of the most common machine learning workloads: predictive analytics over tabular data. This gap is the founding premise of the…

Demystifying DRAM Read Disturbance: Bridging the Gap Between...

DRAM read disturbance, like RowHammer and RowPress, is a critical robustness issue where accessing DRAM can cause unintended bitflips in other unaccessed DRAM locations. DRAM read disturbance bitflips significantly impact the safe, secure, and reliable operation of DRAM-based…

The Reversal Curse: LLMs trained on "A is B" fail to learn...

We expose a surprising failure of generalization in auto-regressive large language models (LLMs). If a model is trained on a sentence of the form "A is B", it will not automatically generalize to the reverse direction "B is A". This is the Reversal Curse. For instance, if a…

LLM Research Papers: The 2026 List (January to May)

A January-May 2026 list of notable LLM research papers, covering new models, training methods, agents, reasoning, and efficiency improvements.

ELI

Paste any research paper and understand it at your level. From picture-book simple to college-level analysis, every section adapts to you.

The lora assumption that breaks in production

LLM Research Papers: The 2025 List (July to December)

In June, I shared a bonus article with my curated and bookmarked research paper lists to the paid subscribers who make this Substack possible.

LLM Research Papers: The 2025 List (July to December)

A curated list of LLM research papers from July–December 2025, organized by reasoning models, inference-time scaling, architectures, training efficiency, and...

Reasoning

Reinforcement Learning

An Introduction to Multisets

Multisets are sets that allow repetition of elements. As such, multisets pave the way to a number of interesting possibilities of theoretical and applied nature. In the present work, after revising the main aspects of traditional sets, we introduce some of the main concepts and…

Multisets are sets that allow repetition of elements.

generalization to take into account vectors and matrices

Characterizing and Optimizing Realistic Workloads on a Commercial...

Compute-in-SRAM architectures offer a promising approach to achieving higher performance and energy efficiency across a range of data-intensive applications. However, prior evaluations have largely relied on simulators or small prototypes, limiting the understanding of their…

Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges

The last decade has witnessed an experimental revolution in data science and machine learning, epitomised by deep learning methods. Indeed, many high-dimensional learning tasks previously thought to be beyond reach -- such as computer vision, playing Go, or protein folding…

The Future of Memory: Limits and Opportunities

Memory latency, bandwidth, capacity, and energy increasingly limit performance. In this paper, we reconsider proposed system architectures that consist of huge (many-terabyte to petabyte scale) memories shared among large numbers of CPUs. We argue two practical engineering…

Understanding the Landscape of Ampere GPU Memory Errors

A100

67.77 million GPU device-hours across 10,693 GPUs.

Hierarchical Reasoning Model

Reasoning, the process of devising and executing complex goal-oriented action sequences, remains a critical challenge in AI. Current large language models (LLMs) primarily employ Chain-of-Thought (CoT) techniques, which suffer from brittle task decomposition, extensive data…

LLM Research Papers: The 2025 List (January to June)

The latest in LLM research with a hand-curated, topic-organized list of over 200 research papers from 2025.

LLM Post-Training: A Deep Dive into Reasoning Large Language Models

Beyond Human Intervention: Algorithmic Collusion through Multi-Agent Learning Strategies

Our paper, Beyond Human Intervention: Algorithmic Collusion through Multi-Agent Learning Strategies, with Suzie Grondin and Philipp Ratz is now available online Collusion in market pricing is a concept associated with human actions to raise market prices through artificially…

Noteworthy LLM Research Papers of 2024

This article covers 12 influential AI research papers of 2024, ranging from mixture-of-experts models to new LLM scaling laws for precision..

The 2025 AI Engineering Reading List

We picked 50 paper/models/blogs across 10 fields in AI Eng: LLMs, Benchmarks, Prompting, RAG, Agents, CodeGen, Vision, Voice, Diffusion, Finetuning. If you're starting from scratch, start here.

Note: gist: https://gist.github.com/bjpcjp/117ecf144c062c3c933f2690e7ece5c2

100 Must-Read Generative AI Papers from 2024

A comprehensive list of some of the most impactful generative papers from last year

An Opinionated Evals Reading List — Apollo Research

A long reading list of evals papers with recommendations and comments by the evals team.

LLM Research Papers: The 2024 List

A curated list of interesting LLM-related research papers from 2024, shared for those looking for something to read over the holidays.

eugeneyan/llm-paper-notes: Notes from the Latent Space paper club. Follow along or start your own!

Notes from the Latent Space paper club. Follow along or start your own! - eugeneyan/llm-paper-notes

How to Run a Paper Club (also: LIVE at NeurIPS 2024!)

Your ultimate Paper Club Starter Kit, from your friends at the Latent Space Paper Club, where we have now read 100 papers. Also: Announcing Latent Space Paper Club LIVE! at Neurips 2024! Join us!

Analyzing the homerun year for LLMs: the top-100 most cited AI papers in 2023, with all medals for open models.

9 October 2024, Mathias Parisot, Jakub Zavrel.Even in the red hot global race for AI dominance, you publish and you perish, unless your peers pick up your work, build further on it, and you manage to drive real progress in the field. And of course, we are all very curious who is…

Aman's AI Journal • Primers • Ilya Sutskever's Top 30

Aman's AI Journal | Course notes and learning material for Artificial Intelligence and Deep Learning Stanford classes.

Summary of Ilya Sutskevers AI Reading List · Tensor Labbet

Note: CNNs (5 items) RNNs (10 items) Transformers (3 items) Info theory (5 items) Other (4 items)

[2406.01506] The Geometry of Categorical and Hierarchical Concepts in Large

The linear representation hypothesis is the informal idea that semantic concepts are encoded as linear directions in the representation spaces of large language models (LLMs). Previous work has...

Title:You Only Cache Once: Decoder-Decoder Architectures for Language Model

We introduce a decoder-decoder architecture, YOCO, for large language models, which only caches key-value pairs once. It consists of two components, i.e., a cross-decoder stacked upon a...

[2404.19737] Better & Faster Large Language Models via Multi-token Predicti

Large language models such as GPT and Llama are trained with a next-token prediction loss. In this work, we suggest that training language models to predict multiple future tokens at once results...

Collusive Outcomes Without Collusion

Auctions with Dynamic Scoring

Algorithmic Information Disclosure in Optimal Auctions

Equitable Pricing in Auctions

Algorithmic Collusion and Price Discrimination: The Over-Usage of Data

[2404.09818] Error Detection and Correction Codes for Safe In-Memory Comput

In-Memory Computing (IMC) introduces a new paradigm of computation that offers high efficiency in terms of latency and power consumption for AI accelerators. However, the non-idealities and...

Tips for LLM Pretraining and Evaluating Reward Models

Discussing AI Research Papers in March 2024

10 Noteworthy AI Research Papers of 2023

This year has felt distinctly different. I've been working in, on, and with machine learning and AI for over a decade, yet I can't recall a time when these fields were as popular and rapidly evolving as they have been this year. To conclude an eventful 2023 in machine learning…

[2302.07730] Transformer models: an introduction and catalog

In the past few years we have seen the meteoric appearance of dozens of foundation models of the Transformer family, all of which have memorable and sometimes funny, but not self-explanatory,...

A Prompt Pattern Catalog

Coordinated Dynamic Bidding in Repeated Second-Price Auctions with Budgets

Distilling Step-by-Step! Outperforming Larger Language Models with...

Deploying large language models (LLMs) is challenging because they are memory inefficient and compute-intensive for practical applications. In reaction, researchers train smaller task-specific...

SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot

We show for the first time that large-scale generative pretrained transformer (GPT) family models can be pruned to at least 50% sparsity in one-shot, without any retraining, at minimal loss of...

A Cookbook of Self-Supervised Learning

Self-supervised learning, dubbed the dark matter of intelligence, is a promising path to advance machine learning. Yet, much like cooking, training SSL methods is a delicate art with a high...

Eight Things to Know about Large Language Models

The widespread public deployment of large language models (LLMs) in recent months has prompted a wave of new attention and engagement from advocates, policymakers, and scholars from many fields....

When do you need Chain-of-Thought Prompting for ChatGPT?

Chain-of-Thought (CoT) prompting can effectively elicit complex multi-step reasoning from Large Language Models~(LLMs). For example, by simply adding CoT instruction ``Let's think step-by-step''...

A Survey of Large Language Models

Language is essentially a complex, intricate system of human expressions governed by grammatical rules. It poses a significant challenge to develop capable AI algorithms for comprehending and...

Top Machine Learning Papers to Read in 2023 - KDnuggets

These curated papers would step up your machine-learning knowledge.

Must read: the 100 most cited AI papers in 2022

Who Is publishing the most Impactful AI research right now? With the breakneck pace of innovation in AI, it is crucial to pick up some signal as soon as possible. No one has the time to read everything, but these 100 papers are sure to bend the road as to where our AI technology…