llms

903 bookmarks · page 6 of 19
2026-01-03 · openai.com

Proximal Policy Optimization

We’re releasing a new class of reinforcement learning algorithms, Proximal Policy Optimization (PPO), which perform comparably or better than state-of-the-art approaches while being much simpler to implement and tune. PPO has become the default reinforcement learning algorithm…

★ 2026-01-01 · simonwillison.net

2025: The year in LLMs

This is the third in my annual series reviewing everything that happened in the LLM space over the past 12 months. For previous years see Stuff we figured out about …

It turned out that the real unlock of reasoning was in driving tools.
notable result is that AI assisted search actually works now.
★ 2025-12-31 · sebastianraschka.com

The State Of LLMs 2025: Progress, Problems, and Predictions

A 2025 review of large language models, from DeepSeek R1 and RLVR to inference-time scaling, benchmarks, architectures, and predictions for 2026.

DeepSeek released their R1 paper in January 2025, which showed that reasoning-like behavior can be developed with reinforcement learning, it was a really big deal
DeepSeek R1 was released as an open-weight model
2025-12-26 · catalinionescu.dev

Building an AI agent inside a 7-year old Rails application

We run a multi-tenant Rails application with sensitive data and layered authorization. In this post, I walk through how I added the first AI agent tool using RubyLLM, Pundit policies, and our existing Algolia search, without introducing a parallel system or loosening constraints.

2025-12-23 · amanxai.com

LangGraph Explained from Scratch | Aman Kharwal

In this article, I’ll walk you through a complete guide to LangGraph from the ground up. LangGraph Explained from Scratch.

In LangChain, this usually means moving from user input to a prompt, then to the LLM, and finally to the output
ollama pull llama3
2025-12-19 · karpathy.bearblog.dev

2025 LLM Year in Review

2025 Year in Review of LLM paradigm changes

Reinforce
Reinforcement Learning from Verifiable Rewards (RLVR)
2025-12-05 · gemini.google.com

rbenv and CLI executables

Meet Gemini, Google’s AI assistant. Get help with writing, planning, brainstorming, and more. Experience the power of generative AI.

2025-11-04 · marktechpost.com

Comparing the Top 7 Large Language Models LLMs/Systems for Coding in 2025

Compare the top 7 large language models and systems for coding in 2025. Discover which ones excel for software engineering tasks.

OpenAI GPT-5 / GPT-5-Codex Anthropic Claude 3.5 Sonnet / Claude 4.x Sonnet with Claude Code Google Gemini 2.5 Pro Meta Llama 3.1 405B Instruct DeepSeek-V2.5-1210 (with DeepSeek-V3 as the successor) Alibaba Qwen2.5-Coder-32B-Instruct Mistral Codestral 25.01
Core coding quality: HumanEval, MBPP / MBPP EvalPlus, code generation and repair quality on standard Python tasks. Repo and bug-fix performance: SWE-bench Verified (real GitHub issues), Aider Polyglot (whole-file edits), RepoBench, LiveCodeBench. Context and long-context behavior: Documented…
2025-10-28 · open.substack.com

The Big LLM Architecture Comparison

From DeepSeek-V3 to Kimi K2: A Look At Modern LLM Architecture Design

this section, I’ll focus on two key architectural techniques introduced in DeepSeek V3 that improved its computational efficiency and distinguish it from many other LLMs:
Multi-Head Latent Attention (MLA)
2025-10-26 · marktechpost.com

5 Common LLM Parameters Explained with Examples

Learn the 5 common LLM parameters explained with examples to optimize your model's performance and generate desired results.

max_completion_tokens, temperature, top_p, presence_penalty, and frequency_penalty
Max Tokens is the maximum number of tokens the model can generate during a run
2025-10-22 · simonwillison.net

Living dangerously with Claude

I gave a talk last night at Claude Code Anonymous in San Francisco, the unofficial meetup for coding agent enthusiasts. I decided to talk about a dichotomy I’ve been struggling …

2025-10-05 · mng.bz

Build a Reasoning Model (From Scratch) - Sebastian Raschka

Understand LLM reasoning by creating your own reasoning model–from scratch! LLM reasoning models have the power to tackle truly challenging problems that require finding the right path through multiple steps. In Build A Reasoning Model (From Scratch) you’ll learn how to build a…

2025-10-03 · thinkingmachines.ai

LoRA Without Regret

How LoRA matches full training performance more broadly than expected

2025-09-24 · simonwillison.net

GPT-5-Codex

OpenAI half-relased this model earlier this month, adding it to their Codex CLI tool but not their API. Today they've fixed that - the new model can now be accessed …

2025-09-22 · simonwillison.net

Four new releases from Qwen

It's been an extremely busy day for team Qwen. Within the last 24 hours (all links to Twitter, which seems to be their preferred platform for these announcements): Qwen3-Next-80B-A3B-Instruct-FP8 and …