llms
![Brian Piercy](data:image/svg+xml;utf8,<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 24 24" fill="%230A66C2"><path d="M20.447 20.452H16.89v-5.569c0-1.328-.027-3.037-1.852-3.037-1.853 0-2.136 1.445-2.136 2.939v5.667H9.351V9h3.414v1.561h.046c.477-.9 1.637-1.85 3.37-1.85 3.601 0 4.267 2.37 4.267 5.455v6.286zM5.337 7.433a1.982 1.982 0 1 1 0-3.964 1.982 1.982 0 0 1 0 3.964zm1.782 13.019H3.555V9h3.564v11.452zM22.225 0H1.771C.792 0 0 .774 0 1.729v20.542C0 23.227.792 24 1.771 24h20.451C23.2 24 24 23.227 24 22.271V1.729C24 .774 23.2 0 22.222 0h.003z"/></svg>)
Ollama makes open models effortless to run locally on a laptop or in the cloud with the same experience. 8.9m developers, 67,000 integrations, & partnerships with every major model lab & hardware vendor. Theory led the Series B.
PS. It works in Claude Cowork too. Here’s the 3-step build.
Compare open-source document extraction models for structured PDF-to-JSON in 2026, covering schema-driven extraction, document parsing
One of the most interesting tips I got from the Fireside Chat I hosted with Cat Wu and Thariq Shihipar from the Claude Code team at AIE on Wednesday was …
Our most agentic Sonnet yet, with top-tier intelligence for coding and everyday professional work.
Freed from intelligibility and aesthetics, AI designs faster
A University of Chicago study changed how I think about AI and information edges. Then a second paper on AI made it worse.
We expose a surprising failure of generalization in auto-regressive large language models (LLMs). If a model is trained on a sentence of the form "A is B", it will not automatically generalize to the reverse direction "B is A". This is the Reversal Curse. For instance, if a model is trained on "Valentina Tereshkova was the first woman to travel to space", it will not automatically be able to answer the question, "Who was the first woman to travel to space?". Moreover, the likelihood of the correct answer ("Valentina Tershkova") will not be higher than for a random name. Thus, models do not generalize a prevalent pattern in their training set: if "A is B" occurs, "B is A" is more likely to occur. It is worth noting, however, that if "A is B" appears in-context, models can deduce the reverse relationship. We provide evidence for the Reversal Curse by finetuning GPT-3 and Llama-1 on fictitious statements such as "Uriah Hawthorne is the composer of Abyssal Melodies" and showing that they fail to correctly answer "Who composed Abyssal Melodies?". The Reversal Curse is robust across model sizes and model families and is not alleviated by data augmentation. We also evaluate ChatGPT (GPT-3.5 and GPT-4) on questions about real-world celebrities, such as "Who is Tom Cruise's mother? [A: Mary Lee Pfeiffer]" and the reverse "Who is Mary Lee Pfeiffer's son?". GPT-4 correctly answers questions like the former 79% of the time, compared to 33% for the latter. Code available at: https://github.com/lukasberglund/reversal_curse.
Weibo AI's VibeThinker-3B is a 3B open-source reasoning model scoring 94.3 on AIME26 and 80.2 on LiveCodeBench v6
Anthropic’s belief in its own commitment to safety gives the company license to aggressively favor its business and even challenge the U.S. government.
Install Ollama on Ubuntu, run large language models locally, manage downloaded models, use GPU acceleration, and send prompts through the local API.
ChatGPT helps you get answers, find inspiration, and be more productive.
Compare TurboQuant, OSCAR, and EpiCache: three 2026 methods compressing the LLM KV cache to cut long-context memory cost
Chinese AI lab Z.ai released GLM-5.2 to their coding plan subscribers on June 13th, and then yesterday (June 16th) released the full open weights under an MIT license. Similar in …
Claude Code explained: 25 features and strategies, including subagents, hooks, MCP, and Auto Mode, with examples and demo.
In this article, I’ll walk you through the key reasoning models you need to know and when to use each one.
Sapient researchers trained a 1B reasoning model on just 40B tokens — scoring competitively with 2B-7B models at a fraction of typical pretraining cost.
Today we’re launching Claude Fable 5: a Mythos-class model that we’ve made safe for general use.
This guide covers the complete picture: what skills are technically, how to plan and design them, the exact file structure and naming rules, how to write instructions that Claude follows reliably, a complete working skill built from scratch, how to test and distribute, and what to do when things go wrong.
A January-May 2026 list of notable LLM research papers, covering new models, training methods, agents, reasoning, and efficiency improvements.
In this article, I’ll go over the open-source LLMs you should know and when to use them. All Open-Source LLMs to know.
Conversations, turns, rounds, tools, agents and more!
According to benchmark platform Artificial Analysis, Nvidia's new Nemotron 3 Ultra is the most capable open AI model from the US to date.
DeepSeek V4 runs a million-token context at a quarter of V3.2's compute and a tenth of its KV cache. The trick is two new attention kernels it shipped, CSA and HCA. Here's how they work: At a million tokens, two things explode: the KV cache grows linearly with the sequence, and attention compute grows quadratically. DeepSeek's MLA (from V2) attacked this by compressing the head dimension, shrinking each token's KV footprint. DSA (V3.2) added a sparse indexer that reads only the top-k tokens per query. But both left a wall. MLA still stores every token. DSA's indexer still scans every token just to score it. At a million tokens the sequence length itself is the enemy. V4's move is to compress along the sequence dimension instead of the head dimension. CSA, Compressed Sparse Attention, does it in two steps. First it pools every 4 tokens into one KV entry with a learned, data-dependent weighting and overlapping windows, so block boundaries blur. That alone cuts the cache 4x. Then it runs DSA's lightning indexer over the compressed entries, keeps the top 1024, and adds a 128-token sliding window for local detail. The clever part is the compounding. CSA reuses DSA's indexer unchanged, but now runs it over a sequence that's already 4x shorter. The indexer's quadratic scan, the exact thing that bottlenecked V3.2 at long context, shrinks with the compression. Compress, then sparsify, and the two wins multiply. HCA, Heavily Compressed Attention, is the same operator with the knobs cranked: pool 128 tokens into one entry, no overlap, then attend densely over all of them. At a million tokens that's only about 8000 entries, so dense attention is cheap and you can drop the indexer entirely. The detail I love: HCA is literally CSA with the top-k budget set to keep everything. vLLM ships it as a sparse kernel with k=8192, which just means every entry. CSA finds the specific clause in the contract. HCA senses the topic shifted three pages ago. So V4 interleaves them through its 61 layers and lets the model learn which view each layer needs. Top-k selection isn't differentiable, so DeepSeek never backpropagates through it. The indexer is trained by a separate loss, detached from the main graph, that distills the full dense attention distribution into the indexer's scores. The model learns from the language loss, the indexer learns from the distillation loss, and they never share a gradient. And the indexer scores with a ReLU, not a softmax, because you only need a ranking, not a distribution. You never exponentiate, which is exactly what lets the whole indexer run in 4-bit. At a million tokens V4-Pro activates more parameters than V3.2 (49B vs 37B) and still runs attention at 27% of the cost. CSA's working set stays near 1100 entries no matter how long the context gets. MLA compressed the width of a token. DSA sparsified the reads. And V4 is the first to attack both axes at once!
"How a personal AI agent built on markdown skills lets a frontier model teach smaller, local models to do real work, without retraining."
If Claude keeps writing beige, the problem is probably the brand rules you never gave it. Train AI on your voice, tone, visuals, and style.
A lot of people seem convinced that the point of AI coding is to write low-quality code as fast as possible. Spew out barely-passable slop, open massive PRs, and merge them unvetted. Ship it! But t…
A curated list of 100+ libraries and frameworks for AI engineers building with LLMs - Sumanth077/ai-engineering-toolkit
A single CLAUDE.md file to improve Claude Code behavior, derived from Andrej Karpathy's observations on LLM coding pitfalls. - multica-ai/andrej-karpathy-skills
The Practical Guide to LLM Inference on Consumer Hardware A practical walk through quantization, KV caches, Flash Attention, Mamba, MoE, and the runtimes that tie it all together — without the …
The AI coding agent field in 2026 is more capable, more fragmented, and harder to benchmark than it looks. Claude Code leads on code quality at 87.6% SWE-bench Verified. GPT-5.5 tops Terminal-Bench at 82.7%. But the benchmark OpenAI itself declared contaminated in February 2026 is still being used to rank these tools — including by the labs publishing their own scores.
Alibaba's Qwen3.7-Max is a reasoning agent model with a 1M-token context window, scoring 56.6 on the Artificial Analysis Intelligence Index.
llm-wiki. GitHub Gist: instantly share code, notes, and snippets.
Vitalik Buterin said mathematically verified software may help protect cryptographic infrastructures as AI improves both code generation and vulnerability discovery.
From Gemma 4 to DeepSeek V4, How New Open-Weight LLMs Are Reducing Long-Context Costs
In recent weeks, we pointed Mythos and other security-focused LLMs at live code across critical parts of our infrastructure. We share what we observed, the models’ strengths and weaknesses, and what the work around them needs to look like before any of it can scale.
6 Open-Source Libraries to FineTune LLMs 1. Unsloth GitHub: https://lnkd.in/gQvPWVFb → Fastest way to fine-tune LLMs locally → Optimized for low VRAM (even laptops) → Plug-and-play with Hugging Face models 2. Axolotl GitHub: https://lnkd.in/g34kuExT → Flexible LLM fine-tuning configs → Supports LoRA, QLoRA, multi-GPU → Great for custom training pipelines 3. TRL (Transformer Reinforcement Learning) GitHub: https://lnkd.in/gnxQBVAc → RLHF, DPO, PPO for LLM alignment → Built on Hugging Face ecosystem → Essential for post-training optimization 4. DeepSpeed GitHub: https://lnkd.in/gEdkFWdB → Train massive models efficiently → Memory + speed optimization → Industry standard for scaling 5. LLaMA-Factory GitHub: https://lnkd.in/gbdWBDsD → All-in-one fine-tuning UI + CLI → Supports multiple models (LLaMA, Qwen, etc.) → Beginner-friendly + powerful 6. PEFT GitHub: https://lnkd.in/g7fBjh2E → Fine-tune with minimal compute → LoRA, adapters, prefix tuning → Best for cost-efficient training Save this for future use. | 46 comments on LinkedIn
From Gemma 4 to DeepSeek V4, How New Open-Weight LLMs Are Reducing Long-Context Costs
From $1,389/mo to $200/mo on the same workflow. Anthropic fixed 3 bugs. The 4 root causes still on your side — with copy-paste templates.
Learn how to put Large Language Model-based applications into production safely and efficiently.
By default, general purpose LLMs are not optimized for specific domains and business goals. Using techniques like specialized fine-tuning, pruning unnecessary neural components, and knowledge distillation, you can rearchitect your models to cost less, run faster, and deliver more accurate results. Rearchitecting LLMs: Structural techniques for efficient models turns research from the latest AI papers into production-ready practices for domain-specific model optimization. As you work through this practical book, you’ll perform hands-on surgery on popular open-source models like Llama-3, Gemma, and Qwen to create cost-effective local small language models (SLMs). Along the way, you’ll learn how to combine behavioral analysis with structural modifications, identifying and removing parts that don’t contribute to your model’s goals, and even use “fair pruning” to reduce model bias at the neuron level.
AI IQ ranks frontier AI models like ChatGPT, Claude and Gemini on the human IQ scale, sparking debate over how artificial intelligence should be measured.
Mira Murati's Thinking Machines Lab Introduces Interaction Models: A Native Multimodal Architecture for Real-Time Human-AI Collaboration
Learn how understanding LLM distillation techniques improves model training through innovative teacher-student approaches.
Explore this post and more from the ClaudeAI community
Subquadratic has launched a new AI architecture featuring a 12-million-token context window that outperforms GPT-5.5 on retrieval benchmarks.
In this article, I’ll show you how to turn any CSV file into an AI chatbot using Python. Turn Any CSV into an AI Chatbot with Python.
Anthropic has launched “dreaming” for AI agents, giving Claude new self-improving tools designed to boost enterprise automation, reliability, and scale.
Miami startup Subquadratic says its SubQ model could make AI 1,000 times more efficient and handle 12 million tokens, but researchers remain divided over whether the breakthrough is real.
Learning to use LlamaIndex for RAG apps isn’t just about memorizing APIs. It’s about understanding how data moves through the system.
Analyzing Tokenization Drift: Using Token Overlap Metrics to Identify Out-of-Distribution Risks and Optimizing Prompts
why did NVIDIA cancel the Rubin CPX and replace it with a Groq LPU? LLM inference has two phases. prefill processes the whole prompt at once and is compute-bound. decode generates one token at a time and is memory-bound, reading the full model weights and KV cache for every token. since 2024 the standard approach has been splitting these onto separate GPU pools so prefill and decode stop interfering with each other. NVIDIA's first hardware answer was the Rubin CPX, announced September 2025. a dedicated prefill chip with 128 GB of GDDR7 memory, over 50% cheaper per GB than HBM, under 800W, more chips per rack. prefill is compute-bound, so save the expensive HBM for decode. the savings were real, but regular Rubin GPUs also handle prefill well enough. six months later at GTC 2026, NVIDIA shelved the CPX and partnered with Groq on a completely different split. Groq's split happens inside each layer. every transformer layer has an attention block that reads the KV cache and a feed-forward block that reads only its own weights. the KV cache is tens of gigabytes and is stored in HBM on the GPU. the feed-forward weights are smaller and read the same way every token. that second property is the reason SRAM works here. the Groq LP30 has 500 MB of on-chip SRAM at 150 TB/s, about 20x the memory bandwidth of a B200's HBM3e. run feed-forward on the LP30, keep attention on the GPU, and pass intermediate results between them at every layer. NVIDIA calls it Attention-FFN Disaggregation. the LPX rack packs 256 LP30 chips for 128 GB of SRAM and 40 PB/s aggregate bandwidth, with 640 TB/s of chip-to-chip interconnect for the per-layer transfer. NVIDIA claims 35x more inference throughput per megawatt than GB200 NVL72. so the short answer: the CPX saved cost on prefill, where regular GPUs were already fine. AFD delivers 20x bandwidth on decode by splitting inside the layer, where the real bottleneck sits. different axis, bigger win. wrote up the full details on the blog with diagrams for each approach, plus the AWS + Cerebras split where Trainium handles prefill and a wafer-scale CS-3.
LlamaIndex CEO Jerry Liu argues the framework era is over: agent loops are now capable enough that context quality is the real competitive edge.
Two Open-Weight Models. Eight Chip Families. One Frontier Co-Engineered for Non-Nvidia Silicon. The Stack Was the Moat. Now It Has a Fork.
Disaggregated inference started as a software technique for splitting prefill and decode onto separate GPU pools. NVIDIA, Groq, Cerebras, and AWS are now taking it further with chips purpose-built for each phase.
Learn the top Python frameworks for LLM apps covering fine-tuning, model loading, serving, RAG pipelines, multi-agent systems, and evaluation.
🚀 DeepSeek-V4 Preview is officially live & open-sourced! Welcome to the era of cost-effective 1M context length.
The promotional discount runs until 5 May 2026. Even at full price, V4-Pro already undercuts GPT-5.5, Claude Opus 4.7, and Gemini 3.1 Pro on per-token costs. The move is a direct challenge to the pricing strategy of US AI providers at a moment when the Trump administration has accused Chinese firms of distilling American AI […]
An important primitive for the new "AI agent era"
Startup Verkor.io’s agentic AI orchestrated the entire design process from a 219-word prompt
A fast, helpful, and open-source document parser
AI only needs 150 words to identify me. What does that mean for you?
KV caches are one of the most critical techniques for efficient inference in LLMs in production.
Hands On With GPT 5.5, Opus 4.7, DeepSeek V4, Why Benchmarks Are Bad, and Who’s Going To Win
Now that GPT-5.5 is available in the API, OpenAI have released a wealth of useful tips on how best to prompt the new model. Here's a neat trick they recommend …
The company says its cost-efficient new V4 model is competitive with top closed-source models from OpenAI and Google DeepMind.
Chinese AI lab DeepSeek’s last model release was V3.2 (and V3.2 Speciale) last December. They just dropped the first of their hotly anticipated V4 series in the shape of two …
Ruby's most capable AI runtime
ChatGPT Images 2.0 introduces a state-of-the-art image generation model with improved text rendering, multilingual support, and advanced visual reasoning.
Learn faster, build smarter, and unlock the full power of Claude Code through real examples, reusable templates, prompts, workflows, subagents, and system design.
LLMs are evolving. The next generation of the world’s hottest technology will be cheaper, more efficient, and able to solve bigger problems without going off the rails.
Qwen Studio offers comprehensive functionality spanning chatbot, image and video understanding, image generation, document processing, web search integration, tool utilization, and artifacts.
AMD's 3D V-Cache CPUs deliver a huge boost versus the Non-X3D part in AI benchmarks, showcasing why they are best suited for RAG pipelines.
Learn to build with Claude through Anthropic's comprehensive courses and training programs.
Claude is a family of state-of-the-art large language models developed by Anthropic. This guide introduces the available models and compares their performance.
The .claude folder is created by tools that integrate with Claude to store local state. It keeps track of how the model behaves inside your project and that includes configuration, cached data, task definitions, and sometimes context that helps the system stay consistent across runs.
Tested, ranked, and ready to use
How coding agents use tools, memory, and repo context to make LLMs work better in practice
Anthropic's interpretability team published research revealing that its Claude Sonnet 4.5 model contains 171 internal representations that function analogously to
Qwen Chat offers comprehensive functionality spanning chatbot, image and video understanding, image generation, document processing, web search integration, tool utilization, and artifacts.
Our most intelligent open models, built from Gemini 3 research.
What actually happens when you type a message into Claude Code? The agent loop, 50+ tools, multi-agent orchestration, and unreleased features, mapped from source.
This technique can be used out-of-the-box, requiring no model training or special packaging. It is code-execution free, which means you do not need to add additional tools to your LLM environment.
Skimming the leaked Claude Code TypeScript snapshots suggests that much of its coding performance comes from the surrounding software harness, including repo context, tooling, caching, memory, and subagents.
Universal CLAUDE.md - cut Claude output tokens by 63%. Drop-in. No code changes. - drona23/claude-token-efficient
How to Build Advanced Cybersecurity AI Agents with CAI Using Tools, Guardrails, Handoffs, and Multi-Agent Workflows
Build an AI weather agent in 40 lines of Python using Hugging Face's smolagents library. Learn to create tools, connect LLMs, and run autonomous tasks.
A complete guide to CLAUDE.md, custom commands, skills, agents, and permissions, and how to set them up properly.
Your brain on "not X but Y"
Researchers at Tsinghua University and Z.ai built IndexCache to eliminate redundant computation in sparse attention models like DeepSeek and GLM. The training-free technique cuts 75% of indexer operations, delivering up to 1.82x faster time-to-first-token at 200K context lengths and at least a 20% reduction in deployment costs for long-context workloads.
Google published a research blog post on Tuesday about a new compression algorithm for AI models. Within hours, memory stocks were falling. Micron dropped 3 per cent, Western Digital ...
Learn how to set up Nanobot, connect it to WhatsApp, and power it with OpenAI GPT-5.3-Codex for a practical, always-on AI agent.
When you type a query into a search engine, something has to decide which documents are actually relevant — and how to rank them. BM25 (Best Matching 25), the algorithm powering search engines like Elasticsearch and Lucene, has been the dominant answer to that question for decades. It scores documents by looking at three things: […]
Access large language models from the command-line
From MHA and GQA to MLA, sparse attention, and hybrid architectures
Safely Deploying Machine Learning Models to Production: Four Controlled Strategies (A/B, Canary, Interleaved, Shadow Testing)
A gallery that collects architecture figures from The Big LLM Architecture Comparison and related articles, with fact sheets and links back to the original sections.
Mistral's Small 4 combines reasoning, multimodal analysis and agentic coding in a single open-source model with configurable inference effort, offering enterprises a lower-cost alternative to running separate models for each task.
LLM calls are black boxes in production. Learn how to add structured observability to your RubyLLM-powered app with OpenTelemetry.
Nvidia's KV Cache Transform Coding (KVTC) compresses LLM key-value cache by 20x without model changes, cutting GPU memory costs and time-to-first-token by up to 8x for multi-turn AI applications.
Train your own model with Unsloth, an open-source framework for LLM fine-tuning and reinforcement learning.
Here's the handout I prepared for my NICAR 2026 workshop "Coding agents for data analysis" - a three hour session aimed at data journalists demonstrating ways that tools like Claude …
I put together a new LLM Architecture Gallery that collects the architecture figures from my recent comparison articles in one place, together with compact fact sheets and links.
Detect your hardware and find out which AI models you can run locally. GPU, CPU, and RAM analysis in your browser.
We assumed good theories are small. But the minimum viable compression of a complex system might be billions of parameters large.
"GitHub Copilot had 20 million users. First to market. Then Claude Code arrived and installs peaked within six months. If the sword can cut the leader, no one is safe."
My Claude was craving for better tooling.
Learn these five Python decorators based on diverse libraries, that take particular significance when used in the context of LLM-based applications.
OpenAI has indicated that a new version of its large language model, GPT-5.4, is in development following a post on
AI writes the code now. The skill that matters is controlling what it builds.
Cambridge Researchers Introduce SymTorch: A PyTorch Library that Translates Deep Learning Models into Human-Readable Equations
Use Claude Code to speed up data science. Master data cleaning, visualization, and model prototyping with Python, pandas, and scikit-learn. Get actionable power tips.
Learn to build with Claude through Anthropic's comprehensive courses and training programs.
Whether it is a 0.8B model running on a smartphone or a 9B model powering a coding terminal, the Qwen3.5 series is effectively democratizing the "agentic era."
Musings of a Computer Scientist.
Transfer your preferences, projects, and context from other AI providers into Claude. Switch without losing what makes your AI useful.
This leap is made possible by near-lossless accuracy under 4-bit weight and KV cache quantization, allowing developers to process massive datasets without server-grade infrastructure.
New Claude Code feature dropped yesterday: you can now run a "remote control" session on your computer and then use the Claude Code for web interfaces (on web, iOS and …
Unofficial solutions, while functional, were often brittle and prone to timeout issues. Remote Control replaces these workarounds with a native streaming connection
Investors wiped $40 billion from IBM's market cap after Anthropic released COBOL translation tools. Analysts say the market got the news right and the conclusion wrong.
Start building AI apps in Ruby in 5 minutes. Chat, generate images, create embeddings - all with one gem.
A pragmatic, code-first argument for Ruby as the best language to ship AI products in 2026.
𝗖𝗹𝗮𝘂𝗱𝗲 𝗦𝗸𝗶𝗹𝗹𝘀 𝗶𝘀 𝗽𝗿𝗼𝗯𝗮𝗯𝗹𝘆 𝘁𝗵𝗲 𝗺𝗼𝘀𝘁 𝘂𝗻𝗱𝗲𝗿𝗿𝗮𝘁𝗲𝗱 𝗳𝗲𝗮𝘁𝘂𝗿𝗲 𝗖𝗹𝗮𝘂𝗱𝗲 𝗵𝗮𝘀 𝗯𝘂𝗶𝗹𝘁. If you’re still writing the same prompts in Claude every day, you’re doing extra work. Skills fix that. They package your best instructions once, then you reuse them on demand. Result: less repetition, more consistency, and higher quality outputs because the rules stay stable. 𝗕𝗨𝗧 I can only warn you to install Skills you have not vetted. Read the markdown files carefully - or, if it’s outside your expertise, have someone you trust review them. Yes, there are security risks. But the bigger risk is that the Skill is simply bad. And you end up with worse, more generic outputs than if you had just used the model without it. I wrote a comprehensive full guide on Claude Skills. Subscribe here to get it: https://lnkd.in/dbf74Y9E 𝗔𝗻𝗱 𝗵𝗲𝗿𝗲 𝗮𝗿𝗲 𝗮𝗹𝗹 𝗿𝗲𝘀𝗼𝘂𝗿𝗰𝗲𝘀 𝘁𝗼 𝗵𝗲𝗹𝗽 𝘆𝗼𝘂 𝗴𝗼 𝗱𝗲𝗲𝗽𝗲𝗿 (𝗮𝗹𝗹 𝗳𝗿𝗲𝗲) 𝘁𝗼 𝗲𝗻𝘀𝘂𝗿𝗲 𝘁𝗵𝗲 𝗵𝗶𝗴𝗵𝗲𝘀𝘁 𝗾𝘂𝗮𝗹𝗶𝘁𝘆 𝗼𝘂𝘁𝗽𝘂𝘁: ⬇️ 𝘖𝘍𝘍𝘐𝘊𝘐𝘈𝘓 𝘋𝘖𝘊𝘚 The Unofficial Guide: https://lnkd.in/eNC5QsJp Best Practices Guide: https://lnkd.in/emxu8Vsr Skills Documentation: https://lnkd.in/eSzfnUNc API Reference: https://lnkd.in/erjGW9q5 MCP Documentation: https://lnkd.in/ejKJuNEX 𝘉𝘓𝘖𝘎 𝘗𝘖𝘚𝘛𝘚 Introducing Agent Skills: https://lnkd.in/enrM2tWr Engineering Blog: https://lnkd.in/eRn5aYyQ Skills Explained: https://lnkd.in/e8zEX2Fe How to Create Skills: https://lnkd.in/eDaug-WJ Skills for Claude Code: https://lnkd.in/eQpjSyBW Frontend Design Skills: https://lnkd.in/efPCkgWb 𝘌𝘟𝘈𝘔𝘗𝘓𝘌 𝘚𝘒𝘐𝘓𝘓𝘚 Anthropic's Official Library: https://lnkd.in/er2tG4ZB Partner Skills Directory: https://lnkd.in/ejUcTPjT 𝘊𝘖𝘔𝘔𝘜𝘕𝘐𝘛𝘠 𝘓𝘐𝘉𝘙𝘈𝘙𝘐𝘌𝘚 Skills.sh: skills.sh SkillsMP: skillsmp.com Smithery: smithery.ai/skills SkillHub: skillhub.club | 13 comments on LinkedIn
On February 5th Anthropic's Nicholas Carlini wrote about a project to use parallel Claudes to build a C compiler on top of the brand new Opus 4.6 Chris Lattner (Swift, …
Taalas is replacing programmable GPUs with hardwired AI chips to achieve 17,000 tokens per second for ubiquitous inference
BinaryAudit benchmarks AI agents using Ghidra to find backdoors in compiled binaries of real open-source servers, proxies, and network infrastructure.
Quick note before you jump in:
You've heard the pitch. "We're going to add AI to the platform.
Alibaba on Monday unveiled a new artificial intelligence model Qwen 3.5 designed to execute complex tasks independently, with big improvements in performance and cost that the Chinese tech giant claims beat major U.S. rival models on several benchmarks.
Boris Cherny created Claude Code at Anthropic. Over three Twitter threads (early January, late January, and February 2026), he shared how he and the Claude Code team use it every day. His setup is, in his own words, "surprisingly vanilla." I've pulled together every tip from all three threads into one place. As Boris keeps saying: there's no single correct way to use Claude Code. Run Multiple Sessions in Parallel Boris runs 5 Claude Code instances in his terminal simultaneously, each in its
Nvidia researchers developed dynamic memory sparsification (DMS), a technique that compresses the KV cache in large language models by up to 8x while maintaining reasoning accuracy — and it can be retrofitted onto existing models in hours.
Peter Steinberger is the creator of OpenClaw, an open-source AI agent framework that's the fastest-growing project in GitHub history.Thank you for listening ...
As AI agents move into production, teams are rethinking memory. Mastra’s open-source observational memory shows how stable context can outperform RAG while cutting token costs.
How CLAUDE.md files give Claude the context it needs to be effective, automatically, every session
Google just open-sourced their MCP server for databases. Connect any database to any AI agent in 10 lines of code. It's called MCP Toolbox. What it handles: → Connection pooling → Authentication → Query execution → Tool generation → OpenTelemetry tracing Supported databases: → PostgreSQL → MySQL → BigQuery → Firestore → Spanner → MongoDB → Redis → Elasticsearch → Snowflake → Oracle Works by defining a tool in YAML + Load it in Python Works with: → LangChain / LangGraph → LlamaIndex → Gemini CLI → Any MCP-compatible client 12.6k GitHub stars. Production-ready. → 💾 Save for when you're building agents that need database access ♻️ Repost if you've been writing custom database tools from scratch | 13 comments on LinkedIn
I just woke up Claude Code Agent Swarm on local Qwen3 Coder Next.
A curated list of awesome Claude Skills, resources, and tools for customizing Claude AI workflows - ComposioHQ/awesome-claude-skills
One of my favourite features of ChatGPT is its ability to write and execute code in a container. This feature launched as ChatGPT Code Interpreter nearly three years ago, was …
While standard models suffer from context rot as data grows, MIT’s new Recursive Language Model (RLM) framework treats prompts like code variables, unlocking infinite context without the retraining costs.
Argos improves multimodal RL by evaluating whether an agent’s reasoning aligns with what it observes over time. The approach reduces visual hallucinations and produces more reliable, data-efficient agents for real-world applications:
Zhipu AI Releases GLM-4.7-Flash: A 30B-A3B MoE (Mixture of Experts) Model for Efficient Local Coding and Agents
Goose, Block’s open-source AI coding agent, is emerging as a free alternative to Anthropic’s Claude Code, as developers weigh offline control, rate limits, and the rising cost of AI coding tools.
In this article, I’ll walk you through a guided project to add reasoning skills to your LLM apps. Add Reasoning Skills to Your LLM Apps.
Anthropic’s Cowork brings Claude Code–style AI agents to the desktop, letting Claude access and manage local files and browse the web—boosting productivity while raising new security and trust risks.
New from Anthropic today is Claude Cowork, a “research preview” that they describe as “Claude Code for the rest of your work”. It’s currently available only to Max subscribers ($100 …
The core of tools like Claude Code, Cursor, and Warp isn't magic. It's about 200 lines of straightforward Python. Let's build one from scratch.
AI that builds with you
It’s a general-purpose AI agent. And it’s already a pretty good knowledge worker
In the last few weeks, I've been playing around with the newest version of Claude Code, which wrote me a read-it-later service including RSS, email n…
Training GPT-2 on a budget from Vishwanath Sangale
From DeepSeek-V3 to Kimi K2: A Look At Modern LLM Architecture Design
The problem with Nano Banana Pro is that it’s too good.
Nano Banana allows 32,768 input tokens and I’m going to try to use them all dammit.
We’re releasing a new class of reinforcement learning algorithms, Proximal Policy Optimization (PPO), which perform comparably or better than state-of-the-art approaches while being much simpler to implement and tune. PPO has become the default reinforcement learning algorithm at OpenAI because of its ease of use and good performance.
In June, I shared a bonus article with my curated and bookmarked research paper lists to the paid subscribers who make this Substack possible.
This is the third in my annual series reviewing everything that happened in the LLM space over the past 12 months. For previous years see Stuff we figured out about …
A curated list of LLM research papers from July–December 2025, organized by reasoning models, inference-time scaling, architectures, training efficiency, and...
Understanding GRPO and New Insights from Reasoning Model Papers
A 2025 review of large language models, from DeepSeek R1 and RLVR to inference-time scaling, benchmarks, architectures, and predictions for 2026.
Claude API Documentation
We run a multi-tenant Rails application with sensitive data and layered authorization. In this post, I walk through how I added the first AI agent tool using RubyLLM, Pundit policies, and our existing Algolia search, without introducing a parallel system or loosening constraints.
In this article, I’ll walk you through a complete guide to LangGraph from the ground up. LangGraph Explained from Scratch.
2025 Year in Review of LLM paradigm changes
The AI industry has a trust problem that mirrors a paradox Daniel Kahneman identified decades ago in human decision-making: people
Frontier AI by hand ✍️
A step-by-step practical guide on building AI agents using Gemini 3 Pro, covering tool integration, context management, and best practices for creating effective and reliable agents.
Amazon sued Perplexity this month over its Comet browser, which uses AI agents to do online shopping on your behalf. This is the first major front in the war over who gets to browse the web.
Learn how different memory systems affect multi-agent planning. Comparing Memory Systems for LLM Agents highlights key performance metrics.
Compare the top 7 large language models and systems for coding in 2025. Discover which ones excel for software engineering tasks.
If language is what makes us human, what does it mean now that large language models have gained “metalinguistic” abilities?
A brain dump of all the ways I've been using Claude Code.
From DeepSeek-V3 to Kimi K2: A Look At Modern LLM Architecture Design
Codes/Notebooks for AI Projects. Contribute to Marktechpost/AI-Tutorial-Codes-Included development by creating an account on GitHub.
Learn the 5 common LLM parameters explained with examples to optimize your model's performance and generate desired results.
A blog about making culture. Since 1999.
I gave a talk last night at Claude Code Anonymous in San Francisco, the unofficial meetup for coding agent enthusiasts. I decided to talk about a dichotomy I’ve been struggling …
Ollama now supports Alibaba's Qwen3-VL.
A practical guide to working with AI coding agents without the hype.
Making developers awesome at machine learning.
In this article, I'll take you through a step-by-step guide to fine-tuning LLMs with LoRA. A Guide to Fine-Tuning LLMs using LoRA.
Seven LLM generation parameters: max tokens, temperature, top-p, top-k, penalties, stop sequences, tuning guidance, defaults
Plus prompt injection attacks against Sora 2 cameos and notes on DSPy and Litestream 0.5.0
Understand LLM reasoning by creating your own reasoning model–from scratch! LLM reasoning models have the power to tackle truly challenging problems that require finding the right path through multiple steps. In Build A Reasoning Model (From Scratch) you’ll learn how to build a working reasoning model from the ground up. You will start with an existing pre-trained LLM and then implement reasoning-focused improvements from scratch. Sebastian Raschka, the bestselling author of Build a Large Language Model (From Scratch), is your guide on this exciting journey. Sebastian mentors you every step of the way with clear explanations, practical code, and a keen focus on what really matters. In Build A Reasoning Model (From Scratch) you’ll learn how to: Implement core reasoning improvements for LLMs Evaluate models using judgment-based and benchmark-based methods Improve reasoning without updating model weights Use reinforcement learning to integrate external tools like calculators Apply distillation techniques to learn from larger reasoning models Understand the full reasoning model development pipeline Reasoning models break problems into steps, producing more reliable answers in math, logic, and code. These improvements aren’t just a curiosity–they’re already integrated into top models like Grok 4 and GPT-5. Build A Reasoning Model (From Scratch) demystifies these complex models with a simple philosophy: the best way to learn how something works is to build it yourself! You’ll begin with a pre-trained LLM, adding and improving its reasoning capabilities in ways you can see, test, and understand.
Multiple-Choice Benchmarks, Verifiers, Leaderboards, and LLM Judges with Code Examples
A Coding Guide to Build an Autonomous Agentic AI for Time Series Forecasting with Darts and Hugging Face. A Step by step guide
How LoRA matches full training performance more broadly than expected
The new A.I. app generated videos of store robberies and home intrusions — even bomb explosions on city streets — that never happened.
How we spent under half a million dollars to build a 30 petabyte data storage cluster in downtown San Francisco
Compare top local LLMs for 2025: context windows, VRAM tiers, licenses, quantization, runtimes, dense vs MoE tradeoffs clearly
In this article, we discuss five cutting-edge NLP trends that will shape 2026.
OpenAI half-relased this model earlier this month, adding it to their Codex CLI tool but not their API. Today they've fixed that - the new model can now be accessed …
It's been an extremely busy day for team Qwen. Within the last 24 hours (all links to Twitter, which seems to be their preferred platform for these announcements): Qwen3-Next-80B-A3B-Instruct-FP8 and …
Enter text and choose a voice and language to generate speech. The app will output the generated audio.
Discover the top 15 MCP servers frontend developers need in 2025 for design-to-code, deployment, testing, and observability
AI agents are putting headless browsing back in the spotlight. That raises questions for publishers: How much traffic is real vs. automated?
A Detailed Look at One of the Leading Open-Source LLMs
Study shows how patterns in LLM training data can lead to “parahuman” responses.
[WIP] Resources for AI engineers. Also contains supporting materials for the book AI Engineering (Chip Huyen, 2025) - chiphuyen/aie-book
Best viewed on desktops. On a phone screen, some columns are hidden. When a new repo is indexed, changes in stars in the last day/week are default to 0. Full analysis: What I learned from...
Learn about the OAuth 2.1 for MCP servers with secure authorization, PKCE, scopes, and client registration
TLDR: Method Iteration is a prompting technique that gives better responses to hard problems. …
The Evolution of AI Protocols: Why Model Context Protocol (MCP) Could Become the New HTTP for Artificial Intelligence AI
In January 2025, DeepSeek, a Chinese AI startup, launched R1, an AI model that rivaled top-tier LLMs from OpenAI and Anthropic. Built at a fraction of the
What is Artificial Intelligence AI Inference? A Technical Deep Dive and Top 9 AI Inference Providers (2025 Edition)
Transcribe PDFs with local LLMs
Discover top AI red teaming tools for robust AI security. Learn how adversarial testing protects machine learning models
New research reveals open-source AI models use up to 10 times more computing resources than closed alternatives, potentially negating cost advantages for enterprise deployments.
Comparison and analysis of AI models and API hosting providers. Independent benchmarks across key performance metrics including quality, price, output speed & latency.
A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization. - google/langextract
Google’s active learning method fine-tunes LLMs with 10,000x less data using high-fidelity expert-labeled examples
I’ve had preview access to the new GPT-5 model family for the past two weeks, and have been using GPT-5 as my daily-driver. It’s my new favorite model. It’s still …
A new study from Anthropic introduces "persona vectors," a technique for developers to monitor, predict and control unwanted LLM behaviors.
Context engineering for large language models—frameworks, architectures, and strategies to optimize AI reasoning, and scalability
AI’s most outspoken leader found direction in a personal tragedy.
Reasoning, the process of devising and executing complex goal-oriented action sequences, remains a critical challenge in AI. Current large language models (LLMs) primarily employ Chain-of-Thought (CoT) techniques, which suffer from brittle task decomposition, extensive data requirements, and high latency. Inspired by the hierarchical and multi-timescale processing in the human brain, we propose the Hierarchical Reasoning Model (HRM), a novel recurrent architecture that attains significant computational depth while maintaining both training stability and efficiency. HRM executes sequential reasoning tasks in a single forward pass without explicit supervision of the intermediate process, through two interdependent recurrent modules: a high-level module responsible for slow, abstract planning, and a low-level module handling rapid, detailed computations. With only 27 million parameters, HRM achieves exceptional performance on complex reasoning tasks using only 1000 training samples. The model operates without pre-training or CoT data, yet achieves nearly perfect performance on challenging tasks including complex Sudoku puzzles and optimal path finding in large mazes. Furthermore, HRM outperforms much larger models with significantly longer context windows on the Abstraction and Reasoning Corpus (ARC), a key benchmark for measuring artificial general intelligence capabilities. These results underscore HRM's potential as a transformative advancement toward universal computation and general-purpose reasoning systems.
How Language Models Turn Text into Meaning, From Traditional
In this article, I'll take you through the complete LLM tech stack you should know to develop & deploy real-world LLM applications.
The latest in LLM research with a hand-curated, topic-organized list of over 200 research papers from 2025.
We tested OpenAI’s ChatGPT Agent, currently only available via its $200-per-month Pro subscription.
Discover OpenAI's red team blueprint: How 110 coordinated attacks and 7 exploit fixes created ChatGPT Agent's revolutionary 95% security defense system.
ChatGPT agent System Card: OpenAI’s agentic model unites research, browser automation, and code tools with safeguards under the Preparedness Framework.
An inquiry into emergent collusion in Large Language Models. Agent S2 to Agent S3: “Let's set all asks at 63 next cycle… No undercutting ensur…
A practical handbook for engineers building, optimizing, scaling and operating LLM inference systems in production.
I taught myself how to build RAG + AI Agents in production. Been running them live for over a year now. Here are 4 steps + the only resources you really need to do the same. … Ugly truth: most “AI Engineers” shouting on social media haven’t built a single real production AI Agent or RAG system. If you want to be different - actually build and ship these systems: here’s a laser-focused roadmap from my own journey. .. 🚀 𝗦𝘁𝗮𝗿𝘁 𝘄𝗶𝘁𝗵 𝗳𝘂𝗻𝗱𝗮𝗺𝗲𝗻𝘁𝗮𝗹𝘀 Because no matter how fast LLM/GenAI evolves, your ML & software foundations keep you relevant. ✅ Hands-On ML with TensorFlow & Keras: https://lnkd.in/dWrf5pbS ✅ ISLR: https://lnkd.in/djGPVVwJ ✅ Machine Learning for Beginners by Microsoft (free curriculum): https://lnkd.in/d8kZA3es … 1️⃣ 𝗠𝗮𝘀𝘁𝗲𝗿 𝗟𝗟𝗠𝘀 & 𝗚𝗲𝗻𝗔𝗜 𝗦𝘆𝘀𝘁𝗲𝗺𝘀 → Learn to build & deploy LLMs, understand system design tradeoffs, and handle real constraints. 📚 Must-reads: ✅ Designing ML Systems – Chip Huyen: https://lnkd.in/guN-UhXA ✅ The LLM Engineering Handbook – Iusztin & Labonne: https://lnkd.in/gyA4vFXz ✅ Build a LLM (From Scratch) – Raschka: https://lnkd.in/gXNa-SPb ✅ Hands-On LLMs GitHub: https://lnkd.in/eV4qrgNW … 2️⃣ 𝗚𝗼 𝗯𝗲𝘆𝗼𝗻𝗱 𝘁𝗵𝗲 𝗵𝘆𝗽𝗲 𝗼𝗻 𝗔𝗜 𝗔𝗴𝗲𝗻𝘁𝘀 → Most demos = “if user says hello, return hello.” Actual agents? Handle memory, tools, workflows, costs. ✅ AI Agents for Beginners (GitHub): https://lnkd.in/eik2btmq ✅ GenAI Agents – build step by step: https://lnkd.in/dnhwk75V ✅ OpenAI’s guide to agents: https://lnkd.in/guRfXsFK ✅ Anthropic’s Building Effective Agents: https://lnkd.in/gRWKANS4 … 3️⃣ 𝗥𝗔𝗚 𝗶𝘀 𝗻𝗼𝘁 𝗷𝘂𝘀𝘁 𝗮 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕 Real Retrieval-Augmented Generation requires: → Chunking, hybrid BM25 + vectors, reranking → Query routing & fallback → Evaluating retrieval quality, not just LLM output ✅ RAG Techniques repo: https://lnkd.in/dD4S8Cq2 ✅ Advanced RAG: https://lnkd.in/g2ZHwZ3w ✅ Cost-efficient retrieval with Postgres/OpenSearch/Qdrant ✅ Monitoring with Langfuse / Comet … 4️⃣ 𝗚𝗲𝘁 𝘀𝗲𝗿𝗶𝗼𝘂𝘀 𝗼𝗻 𝗦𝗼𝗳𝘁𝘄𝗮𝗿𝗲 & 𝗜𝗻𝗳𝗿𝗮 → FastAPI, async Python, Pydantic → Docker, CI/CD, blue-green deploys → ETL orchestration (Airflow, Step Functions) → Logs + metrics (CloudWatch, Prometheus) ✅ Move to production: https://lnkd.in/dnnkrJbE ✅ Made with ML (full ML+infra): https://lnkd.in/e-XQwXqS ✅ AWS GenAI path: https://lnkd.in/dmhR3uPc … 5️⃣ 𝗪𝗵𝗲𝗿𝗲 𝗱𝗼 𝗜 𝗹𝗲𝗮𝗿𝗻 𝗳𝗿𝗼𝗺? → Stanford CS336 / CS236 / CS229 (Google it) → MIT 6.S191, Karpathy’s Zero to Hero: https://lnkd.in/dT7vqqQ5 → Google Kaggle GenAI sprint: https://lnkd.in/ga5X7tVJ → NVIDIA’s end-to-end LLM stack: https://lnkd.in/gCtDnhni → DeepLearning.AI’s short courses: https://lnkd.in/gAYmJqS6 … 💥 𝗞𝗲𝗲𝗽 𝗶𝘁 𝗿𝗲𝗮𝗹: Don’t fall for “built in 5 min, dead in 10 min” demos. In prod, it’s about latency, cost, maintainability, guardrails. ♻️ Let's repost to help more people on this journey 💚
Your complete playbook for transforming how you research with AI's most powerful search engine
Structural challenges and the nation’s many languages have made it tough to develop foundational AI models. But the government is keen not to be left behind.
Coders' Colaboratory mini-hackathon on `llm` by simonw - llm-hackathon.md
Christopher Smith ran a mini hackathon in Albany New York at the weekend around uses of my LLM - the first in-person event I'm aware of dedicated to that project! …
Learn how to build your own agentic AI application with free tutorials, guides, courses, projects, example code, research papers, and more.
SemiAnalysis is hiring an analyst in New York City for Core Research, our world class research product for the finance industry. Please apply here It’s been a bit over 150 days since the launc…
Ready to become a certified watsonx AI Assistant Engineer? Register now and use code IBMTechYT20 for 20% off of your exam → https://ibm.biz/Bdnd3dLearn more ...
I presented a three hour workshop at PyCon US yesterday titled Building software on top of Large Language Models. The goal of the workshop was to give participants everything they …
Get a quick overview of GPT, BERT, LLaMA, and more!
Or: The Day My Toaster Started Taking Phone Calls
a study by ohio state university investigates whether large language models can represent human concepts without physically experiencing them.
There's still room for improvement, but don't underestimate this technology.
First there was Claude Code in February, then OpenAI Codex (CLI) in April, and now Gemini CLI in June. All three of the largest AI labs now have their own …
TL;DR: I developed a simple, open-source benchmark to test if LLM agents follow high-level safety principles when they conflict with a given task acc…
Discover how Anthropic approaches the development of reliable AI agents. Learn about our research on agent capabilities, safety considerations, and technical framework for building trustworthy AI.
Explore the 50+ Model Context Protocol (MCP) servers that facilitate seamless AI tool integration using standardized interfaces.
I [added tool-support](https://github.com/simonw/llm-mistral/issues/31) to my plugin for accessing the Mistral API from LLM today, plus support for Mistral's new [Codestral Embed](https://simonwillison.net/2025/May/28/codestral-embed/) embedding model. An interesting challenge here is that I'm …
When I [shipped LLM 0.26](https://simonwillison.net/2025/May/27/llm-tools/) yesterday one of the things I was most excited about was seeing what new tool plugins people would build for it. Dan Turkel's [llm-tools-exa](https://github.com/daturkel/llm-tools-exa) is …
Anthony Shaw's [llm-github-models](https://github.com/tonybaloney/llm-github-models) plugin just got an upgrade: it now supports [LLM 0.26 tool use](https://simonwillison.net/2025/May/27/llm-tools/) for a subset of the models hosted on the [GitHub Models API](https://docs.github.com/en/github-models), contributed by [Caleb …
Explore list of top MCP servers that enable seamless integration of LLMs with tools like databases, APIs, communication platforms, and more, helping you automate workflows and enhance AI applications.
Here's a quick demo of the kind of casual things I use LLMs for on a daily basis. I just found out that Perplexity offer their Deep Research feature via …
LLM 0.26 is out with the biggest new feature since I started the project: support for tools. You can now use the LLM CLI tool—and Python library—to grant LLMs from …
Anthropic publish most of the system prompts for their chat models as part of their release notes. They recently shared the new prompts for both Claude Opus 4 and Claude …
Direct link to a PDF on Anthropic's CDN because they don't appear to have a landing page anywhere for this document. Anthropic's system cards are always worth a look, and …
Really neat CLI tool for bulk renaming of files and directories by Ayooluwa Isaiah, written in Go and designed to work cross-platform. There's a _lot_ of great design in this. …
Design, test, and deploy multi-agent systems in hours using the powerful agentic frameworks.
Learn about turning your notes and sources into a personalized, AI-powered tutor with NotebookLM.
New release of my LLM plugin for Anthropic adding the new Claude 4 Opus and Sonnet models. You can see pelicans on bicycles generated using the new plugin at the …
View recent discussion. Abstract: The rapid scaling of large language models (LLMs) has unveiled critical limitations in current hardware architectures, including constraints in memory capacity, computational efficiency, and interconnection bandwidth. DeepSeek-V3, trained on 2,048 NVIDIA H800 GPUs, demonstrates how hardware-aware model co-design can effectively address these challenges, enabling cost-efficient training and inference at scale. This paper presents an in-depth analysis of the DeepSeek-V3/R1 model architecture and its AI infrastructure, highlighting key innovations such as Multi-head Latent Attention (MLA) for enhanced memory efficiency, Mixture of Experts (MoE) architectures for optimized computation-communication trade-offs, FP8 mixed-precision training to unlock the full potential of hardware capabilities, and a Multi-Plane Network Topology to minimize cluster-level network overhead. Building on the hardware bottlenecks encountered during DeepSeek-V3's development, we engage in a broader discussion with academic and industry peers on potential future hardware directions, including precise low-precision computation units, scale-up and scale-out convergence, and innovations in low-latency communication fabrics. These insights underscore the critical role of hardware and model co-design in meeting the escalating demands of AI workloads, offering a practical blueprint for innovation in next-generation AI systems.
Inspired by my previous [llm-video-frames](https://github.com/simonw/llm-video-frames) plugin, I thought it would be neat to have a plugin for LLM that can take a PDF and turn that into an image-per-page so …
Confused by AI agent frameworks? This article makes sense of A2A and MCP.
“It’s not that hard to build a fully functioning, code-editing agent.” Thorsten Ball
Can't find a human to practice a language with? I've been there. Here's why most of my interaction with ChatGPT is in other languages.
🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API. - mendableai/firecrawl
Kaggle is the world’s largest data science community with powerful tools and resources to help you achieve your data science goals.
Qwen3 surpassed R1 in LiveBench tests that gauge open-source AI models’ capabilities including coding, maths and data analysis.
Understanding architectural differences between large language models (LLMs) remains challenging, particularly at academic-scale pretraining (e.g., 1.3B
This is an extremely useful, detailed set of explanations by [@AlpinDale](https://x.com/AlpinDale) covering the various different sampling strategies used by modern LLMs. LLMs return a set of next-token probabilities for every …
In November 2024, Anthropic published a blog post announcing what may be its most significant contribution to the AI ecosystem so far: the Model Context Protocol.
In this article, I'll take you through a list of 10 hands-on LLM projects with Python you should try to master LLMs. LLM Projects with Python.
MiMo: Unlocking the Reasoning Potential of Language Model – From Pretraining to Posttraining - XiaomiMiMo/MiMo
Measuring progress is fundamental to the advancement of any scientific field. As benchmarks play an increasingly central role, they also grow more susceptible to distortion. Chatbot Arena has emerged as the go-to leaderboard for ranking the most capable AI systems. Yet, in this work we identify systematic issues that have resulted in a distorted playing field. We find that undisclosed private testing practices benefit a handful of providers who are able to test multiple variants before public release and retract scores if desired. We establish that the ability of these providers to choose the best score leads to biased Arena scores due to selective disclosure of performance results. At an extreme, we identify 27 private LLM variants tested by Meta in the lead-up to the Llama-4 release. We also establish that proprietary closed models are sampled at higher rates (number of battles) and have fewer models removed from the arena than open-weight and open-source alternatives. Both these policies lead to large data access asymmetries over time. Providers like Google and OpenAI have received an estimated 19.2% and 20.4% of all data on the arena, respectively. In contrast, a combined 83 open-weight models have only received an estimated 29.7% of the total data. We show that access to Chatbot Arena data yields substantial benefits; even limited additional data can result in relative performance gains of up to 112% on the arena distribution, based on our conservative estimates. Together, these dynamics result in overfitting to Arena-specific dynamics rather than general model quality. The Arena builds on the substantial efforts of both the organizers and an open community that maintains this valuable evaluation platform. We offer actionable recommendations to reform the Chatbot Arena's evaluation framework and promote fairer, more transparent benchmarking for the field
Here are my top 12 MCP Servers I used and tested so far: - Python Code Interpreter: Runs Python code in a sandbox using Pyodide and Deno for isolation. https://lnkd.in/eYmexFA2 - Web fetcher: Fetches web page content using Playwright headless browser with JavaScript support. https://lnkd.in/eKQ4EXEX - Github MCP server: Provides seamless integration with GitHub APIs for automation and interaction. https://lnkd.in/eEKE83c3 - Filesystem: Implements filesystem operations like reading/writing files, creating/listing/deleting directories, moving, searching, and getting metadata within specified directories. https://lnkd.in/eqi4vUdJ - Google Drive: Integrates with Google Drive to allow listing, reading, and searching over files, with automatic export for Google Workspace file types. https://lnkd.in/eTGUHXgr - Fetch: Fetching websites converts HTML to markdown and allowing chunked reading. https://lnkd.in/ebuk59ZR - Markitdown: Converts various file types (PDF, Office docs, HTML, etc.) to Markdown, preserving structure for LLM consumption and text analysis. https://lnkd.in/eHuK-wj6 - Brave search: Integrates with Brave Search API to enable web searches and local business lookups via natural language queries. https://lnkd.in/e22vEUME - Slack: Enables interaction with Slack workspaces, including listing channels, posting messages, replying to threads, adding reactions, and getting history/users. https://lnkd.in/eWf4pZY6 - Notion API: Implements an MCP server for the Notion API, allowing interaction with Notion pages and databases. https://lnkd.in/edCuP443 - Airbnb: Allows searching Airbnb listings and retrieving detailed listing information. https://lnkd.in/etgemCvH - Arxiv: Provides access to arXiv papers through their API, allowing search and retrieval of paper metadata and links. https://lnkd.in/eUpPnhXX | 34 comments on LinkedIn
DeepSeek is set to drop another model pretty soon, as details about their next DeepSeek R2 model have surfaced on the internet
Enhance language models with real-time document retrieval and dynamic knowledge integration using retrieval-augmented generation and LlamaIndex.
A blog post covering tips and tricks that have proven effective for using Claude Code across various codebases, languages, and environments.
We insist that large language models repeatedly translate their mathematical processes into words. There may be a better way.
A lot has happened this month, especially with the releases of new flagship models like GPT-4.5 and Llama 4. But you might have noticed that reactions to these releases were relatively muted. Why? One reason could be that GPT-4.5 and Llama 4 remain conventional models, which means they were trained without explicit reinforcement learning for reasoning. However, OpenAI's recent release of the o3 reasoning model demonstrates there is still considerable room for improvement when investing compute strategically, specifically via reinforcement learning methods tailored for reasoning tasks. While reasoning alone isn't a silver bullet, it reliably improves model accuracy and problem-solving capabilities on challenging tasks (so far). And I expect reasoning-focused post-training to become standard practice in future LLM pipelines. So, in this article, let's explore the latest developments in reasoning via reinforcement learning.
Try these MCP servers with Claude Desktop today for free.
Building a fully functional, code-editing agent in less than 400 lines.
What are the principles we can use to build LLM-powered software that is actually good enough to put in the hands of production customers? - humanlayer/12-factor-agents
Slopsquatting is a new supply chain threat where AI-assisted code generators recommend hallucinated packages that attackers register and weaponize.
Doug Turnbull recently wrote about how [all search is structured now](https://softwaredoug.com/blog/2025/04/02/all-search-structured-now): Many times, even a small open source LLM will be able to turn a search query into reasonable …
/media/img/mt/2025/04/THE_ATLANTIC_ANIMATION_V2/original.gif){kind=icon}
François Chollet has constructed the ultimate test for the bots.
MCP, short for Model Context Protocol, is the hot new standard behind how Large Language Models (LLMs) like Claude, GPT, or Cursor integrate with tools and data. It’s been described as the “USB-C for…
we explore how combining LightThinker and Multi-Head Latent Attention cuts memory and boosts performance
A Blog post by Ksenia Se on Hugging Face
By Matteo Wong / The Atlantic. View the full context on Techmeme.
We’re introducing Llama 4 Scout and Llama 4 Maverick, the first open-weight natively multimodal models with unprecedented context support and our first built using a mixture-of-experts (MoE) architecture.
Overview of the Model Context Protocol (MCP) how it works, what are MCP servers and clients, and how to use it.
Agent Framework / shim to use Pydantic with LLMs
Learn how to configure and use Model Context Protocol (MCP) servers with GitHub Copilot in Visual Studio Code.
Explore this post and more from the Jupyter community
The brother goes on vision quests. The sister is a former English major. Together, they defected from OpenAI, started Anthropic, and built (they say) AI’s most upstanding citizen, Claude.
Posted by mehul_gupta1997 - 8 votes and 0 comments
The past few years have witnessed the rise in popularity of generative AI and large language models (LLMs), as part of a broad AI revolution.
Deploying LLMs presents challenges, particularly in optimizing efficiency, managing computational costs, and ensuring high-quality performance. LLM routing has emerged as a strategic solution to these challenges, enabling intelligent task allocation to the most suitable models or tools. Let’s delve into the intricacies of LLM routing, explore various tools and frameworks designed for its implementation, and […]
A collection of MCP servers
As you know, I've been writing a lot lately about the latest research on reasoning in LLMs. Before my next research-focused blog post, I wanted to offer something special to my paid subscribers as a thank-you for your ongoing support. So, I've started writing a new book on how reasoning works in LLMs, and here I'm sharing the first Chapter 1 with you. This ~15-page chapter is an introduction reasoning in the context of LLMs and provides an overview of methods like inference-time scaling and reinforcement learning. Thanks for your support! I hope you enjoy the chapter, and stay tuned for my next blog post on reasoning research!
Thanks to KiwiCo for sponsoring today’s video! Go to https://www.kiwico.com/welchlabs and use code WELCHLABS for 50% off your first monthly club crate or for...
Q-learning is a model-free reinforcement learning algorithm that enables agents to learn optimal actions through interaction with their environment.
In a follow-up to the research that brought us the [delightful Golden Gate Claude](https://simonwillison.net/2024/May/24/golden-gate-claude/) last year, Anthropic have published two new papers about LLM interpretability: - [Circuit Tracing: Revealing Computational …
What they found challenges some basic assumptions about how this technology really works.
In this article, we explore 10 of the Python libraries every developer should know in 2025.
Google's Gemma 3 model (the 27B variant is particularly capable, I've been trying it out [via Ollama](https://ollama.com/library/gemma3)) supports function calling exclusively through prompt engineering. The official documentation describes two recommended …
There’s a new release from Google Gemini this morning: the first in the Gemini 2.5 series. Google call it “a thinking model, designed to tackle increasingly complex problems”. It’s already …
At OpenAI, we have long believed image generation should be a primary capability of our language models. That’s why we’ve built our most advanced image generator yet into GPT‑4o. The result—image generation that is not only beautiful, but useful.
The Hallucination Index is a benchmark that measures the frequency of inaccuracies in large language models, indicating their reliability and contextual understanding.
[platform_url]//console.mistral.ai/
Model architectures, data generation, training paradigms, and unified frameworks inspired by LLMs.
Anthropic launches real-time web search for Claude AI, challenging ChatGPT's dominance while securing $3.5 billion in funding at a $61.5 billion valuation.
Paris-based artificial intelligence startup Mistral AI has announced the open-source release of its lightweight AI model, Mistral Small 3.1, which the company
Spectacular new open geospatial project by [Dan Snow](https://sno.ws/): > OpenTimes is a database of pre-computed, point-to-point travel times between United States Census geographies. It lets you download bulk travel time …
Mistral Small 3 [came out in January](https://simonwillison.net/2025/Jan/30/mistral-small-3/) and was a notable, genuinely excellent local model that used an Apache 2.0 license. Mistral Small 3.1 offers a significant improvement: it's multi-modal …
The ellmer package for using LLMs with R is a game changer for scientists Why is ellmer a game changer for scientists? In this tutorial we’ll look at how we can access LLM agents through API calls. We’ll use this skill for created structued data fro...
Catastrophic Forgetting is a phenomenon where neural networks lose previously learned information when trained on new data, similar to human memory loss.
These models are free to use, can be fine-tuned, and offer enhanced privacy and security since they can run directly on your machine, and match the performance of proprietary solutions like o3-min and Gemini 2.0.
Model cards are documentation tools in machine learning that provide essential information about models, promoting transparency, trust, and ethical considerations in AI systems.
Plus CSS view transitions and a major update to llm-openrouter
Here's the handout for a workshop I presented this morning at [NICAR 2025](https://www.ire.org/training/conferences/nicar-2025/) on web scraping, focusing on lesser know tips and tricks that became possible only with recent developments …
It’s happening.
Part 1: Inference-Time Compute Scaling Methods
New closed-source specialist OCR model by Mistral - you can feed it images or a PDF and it produces Markdown with optional embedded images. It's available [via their API](https://docs.mistral.ai/api/#tag/ocr), or …
Introducing the world’s best document understanding API.
I added [schema support](https://simonwillison.net/2025/Feb/28/llm-schemas/) to this plugin which adds support for the [Mistral API](https://docs.mistral.ai/api/) to LLM. Release notes: - Support for LLM [schemas](https://llm.datasette.io/en/stable/schemas.html). [#19](https://github.com/simonw/llm-mistral/issues/19) - `-o prefix '{'` …
This release of the `llm-ollama` plugin adds support for [schemas](https://simonwillison.net/2025/Feb/28/llm-schemas/), thanks to a [PR by Adam Compton](https://github.com/taketwo/llm-ollama/pull/36). Ollama provides very robust support for this pattern thanks to their [structured outputs](https://ollama.com/blog/structured-outputs) …
Today, we’re announcing Claude 3.7 Sonnet, our most intelligent model to date and the first hybrid reasoning model generally available on the market.
OpenAI’s Deep Research is built for me, and I can’t use it. It’s another amazing demo, until it breaks. But it breaks in really interesting ways.
Solid techniques to get really good results from any LLM
OpenAI's president Greg Brockman recently shared this cool template for prompting their reasoning models o1/o3. Turns out, this is great for ANY reasoning… | 32 comments on LinkedIn
Comparison and ranking the performance of over 30 AI models (LLMs) across key metrics including quality, price, performance and speed (output speed - tokens per second & latency - TTFT), context window & others.
BERT is an open source machine learning framework for natural language processing (NLP) that helps computers understand ambiguous language by using context
I share my preferences for LLMs, image models, AI video, AI music, AI-powered research, and more. These are the AI tools I regularly use or recommend to others.
A Step-by-Step Guide to Setting Up a Custom BPE Tokenizer with Tiktoken for Advanced NLP Applications in Python
Do my tears surprise you? Strong CEOs also cry.
Neat open source project on the GitHub organisation for the UK government's Department for Business and Trade: a "Python virtual filesystem for SQLite to read from and write to S3." …
I just released llm-smollm2, a new plugin for LLM that bundles a quantized copy of the SmolLM2-135M-Instruct LLM inside of the Python package. This means you can now pip install …
In this article, I will describe the four main approaches to building reasoning models, or how we can enhance LLMs with reasoning capabilities. I hope this p...
I started running a basic link blog on this domain back in November 2003—publishing links (which I called “blogmarks”) with a title, URL, short snippet of commentary and a “via” …
Check out this comparison of 5 AI frameworks to determine which you should choose.
The Reinforcement Learning from Human Feedback Book
In our previous tutorial, we built an AI agent capable of answering queries by surfing the web. However, when building agents for longer-running tasks, two critical concepts come into play: persistence and streaming. Persistence allows you to save the state of an agent at any given point, enabling you to resume from that state in future interactions. This is crucial for long-running applications. On the other hand, streaming lets you emit real-time signals about what the agent is doing at any moment, providing transparency and control over its actions. In this tutorial, we’ll enhance our agent by adding these powerful
Aidan Bench attempts to measure in LLMs. - aidanmclaughlin/AidanBench
o3-mini is out today. As with other o-series models it’s a slightly difficult one to evaluate—we now need to decide if a prompt is best run using GPT-4o, o1, o3-mini …
How a Key-Value (KV) cache reduces Transformer inference time by trading memory for computation
The field of artificial intelligence is evolving rapidly, with increasing efforts to develop more capable and efficient language models. However, scaling these models comes with challenges, particularly regarding computational resources and the complexity of training. The research community is still exploring best practices for scaling extremely large models, whether they use a dense or Mixture-of-Experts (MoE) architecture. Until recently, many details about this process were not widely shared, making it difficult to refine and improve large-scale AI systems. Qwen AI aims to address these challenges with Qwen2.5-Max, a large MoE model pretrained on over 20 trillion tokens and further refined
The unusual timing of the Qwen 2.5-Max's release points to the pressure DeepSeek's meteoric rise in the past three weeks has placed on overseas rivals and domestic competition.
A recipe for reasoning LLMs
AI has entered an era of the rise of competitive and groundbreaking large language models and multimodal models. The development has two sides, one with open source and the other being propriety models. DeepSeek-R1, an open-source AI model developed by DeepSeek-AI, a Chinese research company, exemplifies this trend. Its emergence has challenged the dominance of proprietary models such as OpenAI’s o1, sparking discussions on cost efficiency, open-source innovation, and global technological leadership in AI. Let’s delve into the development, capabilities, and implications of DeepSeek-R1 while comparing it with OpenAI’s o1 system, considering the contributions of both spaces. DeepSeek-R1 DeepSeek-R1 is
Johann Rehberger snagged a copy of the [ChatGPT Operator](https://simonwillison.net/2025/Jan/23/introducing-operator/) system prompt. As usual, the system prompt doubles as better written documentation than any of the official sources. It asks users …
Developers have tricks to stop artificial intelligence from making things up, but large language models are still struggling to tell the truth, the whole truth and nothing but the truth.
This article covers 12 influential AI research papers of 2024, ranging from mixture-of-experts models to new LLM scaling laws for precision..
New release of my [LLM](https://llm.datasette.io/) CLI tool and Python library. A bunch of accumulated fixes and features since the start of December, most notably: - Support for OpenAI's [o1 model](https://platform.openai.com/docs/models#o1) …
The company built a cheaper, competitive chatbot with fewer high-end computer chips than U.S. behemoths like Google and OpenAI, showing the limits of chip export control.
DeepSeek are the Chinese AI lab who dropped the best currently available open weights LLM on Christmas day, DeepSeek v3. That model was trained in part using their unreleased R1 …
The rapid advancement and widespread adoption of generative AI systems across various domains have increased the critical importance of AI red teaming for evaluating technology safety and security. While AI red teaming aims to evaluate end-to-end systems by simulating real-world attacks, current methodologies face significant challenges in effectiveness and implementation. The complexity of modern AI systems, with their expanding capabilities across multiple modalities including vision and audio, has created an unprecedented array of potential vulnerabilities and attack vectors. Moreover, integrating agentic systems that grant AI models higher privileges and access to external tools has substantially increased the attack surface and
New paper from Microsoft describing their top eight lessons learned red teaming (deliberately seeking security vulnerabilities in) 100 different generative AI models and products over the past few years. …
This is a standalone notebook implementing the popular byte pair encoding (BPE) tokenization algorithm, which is used in models like GPT-2 to GPT-4, Llama 3,...
Let’s start the year on an exciting note
We picked 50 paper/models/blogs across 10 fields in AI Eng: LLMs, Benchmarks, Prompting, RAG, Agents, CodeGen, Vision, Voice, Diffusion, Finetuning. If you're starting from scratch, start here.
Intelligent agents are considered by many to be the ultimate goal of AI. The classic book by Stuart Russell and Peter Norvig, Artificial Intelligence: A Modern Approach (Prentice Hall, 1995), defines the field of AI research as “the study and design of rational agents.”
A comprehensive list of some of the most impactful generative papers from last year
Two powerful workflows that unlock everything else. Intro: Golden Age of AI Tools and AI agent frameworks begins in 2025.
A long reading list of evals papers with recommendations and comments by the evals team.
A lot has happened in the world of Large Language Models over the course of 2024. Here’s a review of things we figured out about the field in the past …
Using knowledge graphs and AI to retrieve, filter, and summarize medical journal articles
A detailed analysis of ChatGPT search and Google's performance across 62 queries, with scoring metrics and practical examples.
Plus building Python tools with a one-shot prompt using uv run and Claude Projects
A curated list of interesting LLM-related research papers from 2024, shared for those looking for something to read over the holidays.
Compute costs scale with the square of the input size. That’s not great.
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step - rasbt/LLMs-from-scratch
Large Language Models (LLMs) have become a cornerstone of artificial intelligence, driving advancements in natural language processing and decision-making tasks. However, their extensive power demands, resulting from high computational overhead and frequent external memory access, significantly hinder their scalability and deployment, especially in energy-constrained environments such as edge devices. This escalates the cost of operation while also limiting accessibility to these LLMs, which therefore calls for energy-efficient approaches designed to handle billion-parameter models. Current approaches to reduce the computational and memory needs of LLMs are based either on general-purpose processors or on GPUs, with a combination of weight quantization and
The artificial intelligence start-up said the new system, OpenAI o3, outperformed leading A.I. technologies on tests that rate skills in math, science, coding and logic.
A post for developers with advice and workflows for building effective AI agents
Large Language Models (LLMs) have achieved remarkable advancements in natural language processing (NLP), enabling applications in text generation, summarization, and question-answering. However, their reliance on token-level processing—predicting one word at a time—presents challenges. This approach contrasts with human communication, which often operates at higher levels of abstraction, such as sentences or ideas. Token-level modeling also struggles with tasks requiring long-context understanding and may produce outputs with inconsistencies. Moreover, extending these models to multilingual and multimodal applications is computationally expensive and data-intensive. To address these issues, researchers at Meta AI have proposed a new approach: Large Concept Models (LCMs). Large Concept
Large language models (LLMs) can understand and generate human-like text by encoding vast knowledge repositories within their parameters. This capacity enables them to perform complex reasoning tasks, adapt to various applications, and interact effectively with humans. However, despite their remarkable achievements, researchers continue to investigate the mechanisms underlying the storage and utilization of knowledge in these systems, aiming to enhance their efficiency and reliability further. A key challenge in using large language models is their propensity to generate inaccurate, biased, or hallucinatory outputs. These problems arise from a limited understanding of how such models organize and access knowledge. Without clear
This blog explores a detailed comparison between the OpenAI API and LangChain, highlighting key differences in performance and developer experience and the low level code for why these differences exist.
A.I. insiders are falling for Claude, a chatbot from Anthropic. Is it a passing fad, or a preview of artificial relationships to come?
Speed up your LLM inference
There has been an increasing amount of fear, uncertainty and doubt (FUD) regarding AI Scaling laws. A cavalcade of part-time AI industry prognosticators have latched on to any bearish narrative the…
It’s largely up to companies to test whether their AI is capable of superhuman harm. At Anthropic, the Frontier Red Team assesses the risk of catastrophe.
In large language models (LLMs), “hallucination” refers to instances where models generate semantically or syntactically plausible outputs but are factually incorrect or nonsensical. For example, a hallucination occurs when a model provides erroneous information, such as stating that Addison's disease causes “bright yellow skin” when, in fact, it causes fatigue and low blood pressure. This phenomenon is a significant concern in AI, as it can lead to the spread of false or misleading information. The issue of AI hallucinations has been explored in various research studies. A survey in “ACM Computing Surveys” describes hallucinations as “unreal perceptions that feel real.”
Compare AI models easily! All providers in one place.
LLMs are driving major advances in research and development today. A significant shift has been observed in research objectives and methodologies toward an LLM-centric approach. However, they are associated with high expenses, making LLMs for large-scale utilization inaccessible to many. It is, therefore, a significant challenge to reduce the latency of operations, especially in dynamic applications that demand responsiveness. KV cache is used for autoregressive decoding in LLMs. It stores key-value pairs in multi-headed attention during the pre-filling phase of inference. During the decoding stage, new KV pairs get appended to the memory. KV cache stores the intermediate key and
A Step-by-Step Guide
Navigate Tomorrow's Intelligence Today
Kapa.ai turns your knowledge base into a reliable and production-ready LLM-powered AI assistant that answers technical questions instantly. Trusted by 100+ startups and enterprises incl. OpenAI, Docker, Mapbox, Mixpanel and NextJS.
Psst, kid, want some cheap and small LLMs?
The advent of LLMs has propelled advancements in AI for decades. One such advanced application of LLMs is Agents, which replicate human reasoning remarkably. An agent is a system that can perform complicated tasks by following a reasoning process similar to humans: think (solution to the problem), collect (context from past information), analyze(the situations and data), and adapt (based on the style and feedback). Agents encourage the system through dynamic and intelligent activities, including planning, data analysis, data retrieval, and utilizing the model's past experiences. A typical agent has four components: Brain: An LLM with advanced processing capabilities, such as
Notes from the Latent Space paper club. Follow along or start your own! - eugeneyan/llm-paper-notes
An introduction to the main techniques and latest models
Are they good or bad?
9 October 2024, Mathias Parisot, Jakub Zavrel.Even in the red hot global race for AI dominance, you publish and you perish, unless your peers pick up your work, build further on it, and you manage to drive real progress in the field. And of course, we are all very curious who is currently having that kind of impact. Are the billions of dollars spent on AI R&D paying off in the long run? So here is, in continuation of our popular publication impact analysis of last year, Zeta Alpha's ranking of t
The power of a robust honor code—and abundant institutional resources
LLM Chunking, Indexing, Scoring and Agents, in a Nutshell. The new PageRank of RAG/LLM. With details on building relevancy scores.
The popular online chatbot can now access and deliver information from across the internet in real time, including news, stock prices and sports scores.
A discussion of how Anthropic's researchers developed Claude's new computer use skill, along with some relevant safety considerations
In this article, I share the five essential LLM tools that I currently find indispensable, and which have the potential to help revolutionize the way you work.
Anthropic, the AI vendor second in size only to OpenAI, has a powerful family of generative AI models called Claude. These models can perform a range of
Nvidia quietly launched a groundbreaking AI model that surpasses OpenAI’s GPT-4 and Anthropic’s Claude 3.5, signaling a major shift in the competitive landscape of artificial intelligence.
Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step - rasbt/LLMs-from-scratch
Meta's recent release of Llama 3.1 has stirred excitement in the AI community, offering an array of remarkable applications. This groundbreaking model, particularly the 405B variant, stands out for its superior performance and open-source accessibility, outpacing even top-tier closed models. Here are ten wild examples showcasing the versatile use cases of Llama 3.1, from enhancing personal gadgets to innovative AI deployments. Efficient Task Automation: Llama 3.1 405B can be harnessed to teach the smaller 8B model how to execute tasks perfectly, reducing costs and latency. This setup allows users to train the 8B model to handle various operations, providing a
Understanding the mechanistic interpretability research problem and reverse-engineering these large language models
Discover and create custom versions of ChatGPT that combine instructions, extra knowledge, and any combination of skills.
Llama 3.1 is the latest version of Meta's large language models, with a new model weight, 405 billion parameters, the biggest model it's trained.
The newly unveiled Llama 3.1 collection of 8B, 70B, and 405B large language models (LLMs) is narrowing the gap between proprietary and open-source models. Their open nature is attracting more…
Meta announced the release of Llama 3.1, the most capable model in the LLama Series. This latest iteration of the Llama series, particularly the 405B model, represents a substantial advancement in open-source AI capabilities, positioning Meta at the forefront of AI innovation. Meta has long advocated for open-source AI, a stance underscored by Mark Zuckerberg’s assertion that open-source benefits developers, Meta, and society. Llama 3.1 embodies this philosophy by offering state-of-the-art capabilities in an openly accessible model. The release aims to democratize AI, making cutting-edge technology available to various users and applications. The Llama 3.1 405B model stands out for
Meta llama 3.1 405b kicks off a fresh chapter for open-source language models. This breakthrough brings unmatched skills to AI
A deep dive into absolute, relative, and rotary positional embeddings with code examples
Introducing Claude 3.5 Sonnet—our most intelligent model yet. Sonnet now outperforms competitor models and Claude 3 Opus on key evaluations, at twice the speed.
Attention, as a core layer of the ubiquitous Transformer architecture, is a bottleneck for large language models and long-context applications. FlashAttention (and FlashAttention-2) pioneered an approach to speed up attention on GPUs by minimizing memory reads/writes, and is now used by most libraries to accelerate Transformer training and inference. This has contributed to a massive increase in LLM context length in the last two years, from 2-4K (GPT-3, OPT) to 128K (GPT-4), or even 1M (Llama 3). However, despite its success, FlashAttention has yet to take advantage of new capabilities in modern hardware, with FlashAttention-2 achieving only 35% utilization of theoretical max FLOPs on the H100 GPU. In this blogpost, we describe three main techniques to speed up attention on Hopper GPUs: exploiting asynchrony of the Tensor Cores and TMA to (1) overlap overall computation and data movement via warp-specialization and (2) interleave block-wise matmul and softmax operations, and (3) incoherent processing that leverages hardware support for FP8 low-precision.
In addition to its practical implications, recent work on “meaning representations” could shed light on some old philosophical questions.
Introduction In this post, I want to introduce Mark, a simple CLI tool that uses Markdown and its syntax to interact naturally with the GPT4-vision/GPT4o models.
Anyscale is the leading AI application platform. With Anyscale, developers can build, run and scale AI applications instantly.
We would like to thank Voltage Park, Dell, H5, and NVIDIA for their invaluable partnership and help with setting up our cluster. A special…
Experience the leading models to build enterprise generative AI apps now.
Prompt engineering is crucial to leveraging ChatGPT's capabilities, enabling users to elicit relevant, accurate, high-quality responses from the model. As language models like ChatGPT become more sophisticated, mastering the art of crafting effective prompts has become essential. This comprehensive overview delves into prompt engineering principles, techniques, and best practices, providing a detailed understanding drawn from multiple authoritative sources. Understanding Prompt Engineering Prompt engineering involves the deliberate design and refinement of input prompts to influence the output of a language model like ChatGPT. The efficacy of a prompt directly impacts the relevance and coherence of the AI's responses. Effective prompt engineering
Amazon trained me to write evidence-based narratives. I love the format. It’s a clear and compelling way to present information to drive…
AI startup Gradient and cloud platform Crusoe teamed up to extend the context window of Meta's Llama 3 models to 1 million tokens.
In the developing field of Artificial Intelligence (AI), the ability to think quickly has become increasingly significant. The necessity of communicating with AI models efficiently becomes critical as these models get more complex. In this article we will explain a number of sophisticated prompt engineering strategies, simplifying these difficult ideas through straightforward human metaphors. The techniques and their examples have been discussed to see how they resemble human approaches to problem-solving. Chaining Methods Analogy: Solving a problem step-by-step. Chaining techniques are similar to solving an issue one step at a time. Chaining techniques include directing the AI via a systematic
Evaluating Large Language Models (LLMs) is a challenging problem in language modeling, as real-world problems are complex and variable. Conventional benchmarks frequently fail to fully represent LLMs' all-encompassing performance. A recent LinkedIn post has emphasized a number of important measures that are essential to comprehend how well new models function, which are as follows. MixEval Achieving a balance between thorough user inquiries and effective grading systems is necessary for evaluating LLMs. Conventional standards based on ground truth and LLM-as-judge benchmarks encounter difficulties such as biases in grading and possible contamination over time. MixEval solves these problems by combining real-world user
In the rapidly advancing field of Artificial Intelligence (AI), effective use of web data can lead to unique applications and insights. A recent tweet has brought attention to Firecrawl, a potent tool in this field created by the Mendable AI team. Firecrawl is a state-of-the-art web scraping program made to tackle the complex problems involved in getting data off the internet. Web scraping is useful, but it frequently requires overcoming various challenges like proxies, caching, rate limitations, and material generated with JavaScript. Firecrawl is a vital tool for data scientists because it addresses these issues head-on. Even without a sitemap,
We reproduce the GPT-2 (124M) from scratch. This video covers the whole process: First we build the GPT-2 network, then we optimize its training to be really fast, then we set up the training run following the GPT-2 and GPT-3 paper and their hyperparameters, then we hit run, and come back the next morning to see our results, and enjoy some amusing model generations. Keep in mind that in some places this video builds on the knowledge from earlier videos in the Zero to Hero Playlist (see my channel). You could also see this video as building my nanoGPT repo, which by the end is about 90% similar. Links: - build-nanogpt GitHub repo, with all the changes in this video as individual commits: https://github.com/karpathy/build-nanogpt - nanoGPT repo: https://github.com/karpathy/nanoGPT - llm.c repo: https://github.com/karpathy/llm.c - my website: https://karpathy.ai - my twitter: https://twitter.com/karpathy - our Discord channel: https://discord.gg/3zy8kqD9Cp Supplementary links: - Attention is All You Need paper: https://arxiv.org/abs/1706.03762 - OpenAI GPT-3 paper: https://arxiv.org/abs/2005.14165 - OpenAI GPT-2 paper: https://d4mucfpksywv.cloudfront.net/better-language-models/language_models_are_unsupervised_multitask_learners.pdf- The GPU I'm training the model on is from Lambda GPU Cloud, I think the best and easiest way to spin up an on-demand GPU instance in the cloud that you can ssh to: https://lambdalabs.com Chapters: 00:00:00 intro: Let’s reproduce GPT-2 (124M) 00:03:39 exploring the GPT-2 (124M) OpenAI checkpoint 00:13:47 SECTION 1: implementing the GPT-2 nn.Module 00:28:08 loading the huggingface/GPT-2 parameters 00:31:00 implementing the forward pass to get logits 00:33:31 sampling init, prefix tokens, tokenization 00:37:02 sampling loop 00:41:47 sample, auto-detect the device 00:45:50 let’s train: data batches (B,T) → logits (B,T,C) 00:52:53 cross entropy loss 00:56:42 optimization loop: overfit a single batch 01:02:00 data loader lite 01:06:14 parameter sharing wte and lm_head 01:13:47 model initialization: std 0.02, residual init 01:22:18 SECTION 2: Let’s make it fast. GPUs, mixed precision, 1000ms 01:28:14 Tensor Cores, timing the code, TF32 precision, 333ms 01:39:38 float16, gradient scalers, bfloat16, 300ms 01:48:15 torch.compile, Python overhead, kernel fusion, 130ms 02:00:18 flash attention, 96ms 02:06:54 nice/ugly numbers. vocab size 50257 → 50304, 93ms 02:14:55 SECTION 3: hyperpamaters, AdamW, gradient clipping 02:21:06 learning rate scheduler: warmup + cosine decay 02:26:21 batch size schedule, weight decay, FusedAdamW, 90ms 02:34:09 gradient accumulation 02:46:52 distributed data parallel (DDP) 03:10:21 datasets used in GPT-2, GPT-3, FineWeb (EDU) 03:23:10 validation data split, validation loss, sampling revive 03:28:23 evaluation: HellaSwag, starting the run 03:43:05 SECTION 4: results in the morning! GPT-2, GPT-3 repro 03:56:21 shoutout to llm.c, equivalent but faster code in raw C/CUDA 03:59:39 summary, phew, build-nanogpt github repo Corrections: I will post all errata and followups to the build-nanogpt GitHub repo (link above) SuperThanks: I experimentally enabled them on my channel yesterday. Totally optional and only use if rich. All revenue goes to to supporting my work in AI + Education.
Run an open source language model in your local machine and remotely.
Midjourney model personalization is now live, offering you a more tailored image generation experience by teaching the AI your preferences.
27 examples (with actual prompts) of how product managers are using Perplexity today
The linear representation hypothesis is the informal idea that semantic concepts are encoded as linear directions in the representation spaces of large language models (LLMs). Previous work has...
The ability to discern relevant and essential information from noise is paramount in AI, particularly within large language models (LLMs). With the surge of information and the complexity of tasks, there's a need for efficient mechanisms to enhance the performance and reliability of these models. Let’s explore the essential tools & techniques for refining LLMs and delivering precise, actionable insights. The focus will be on Retrieval-Augmented Generation (RAG), agentic functions, Chain of Thought (CoT) prompting, few-shot learning, prompt engineering, and prompt optimization. Retrieval-Augmented Generation (RAG): Providing Relevant Context RAG combines the power of retrieval mechanisms with generative models, ensuring that
Choosing large language models (LLMs) tailored for specific tasks is crucial for maximizing efficiency and accuracy. With natural language processing (NLP) advancements, different models have emerged, each excelling in unique domains. Here is a comprehensive guide to the most suitable LLMs for various activities in the AI world. Hard Document Understanding: Claude Opus Claude Opus excels at tasks requiring deep understanding and interpretation of complex documents. This model excels in parsing dense legal texts, scientific papers, and intricate technical manuals. Claude Opus is designed to handle extensive context windows, ensuring it captures nuanced details and complicated relationships within the text.
Apply these techniques when crafting prompts for large language models to elicit more relevant responses.
In most cases, Perplexity produced the desired Pages, but what we found missing was the option to edit the content manually.
We tested OpenAI’s ChatGPT against Microsoft’s Copilot and Google’s Gemini, along with Perplexity and Anthropic’s Claude. Here’s how they ranked.
if the centralizing forces of data and compute hold, open and closed-source AI cannot both dominate long-term
Vision-language models (VLMs), capable of processing both images and text, have gained immense popularity due to their versatility in solving a wide range of tasks, from information retrieval in scanned documents to code generation from screenshots. However, the development of these powerful models has been hindered by a lack of understanding regarding the critical design choices that truly impact their performance. This knowledge gap makes it challenging for researchers to make meaningful progress in this field. To address this issue, a team of researchers from Hugging Face and Sorbonne Université conducted extensive experiments to unravel the factors that matter the
What goes on in artificial neural networks work is largely a mystery, even to their creators. But researchers from Anthropic have caught a glimpse.
llama3 implementation one matrix multiplication at a time - naklecha/llama3-from-scratch
Artificial intelligence (AI) has revolutionized various fields by introducing advanced models for natural language processing (NLP). NLP enables computers to understand, interpret, and respond to human language in a valuable way. This field encompasses text generation, translation, and sentiment analysis applications, significantly impacting industries like healthcare, finance, and customer service. The evolution of NLP models has driven these advancements, continually pushing the boundaries of what AI can achieve in understanding and generating human language. Despite these advancements, developing models that can effectively handle complex multi-turn conversations remains a persistent challenge. Existing models often fail to maintain context and coherence over
While RAG will remain a staple of production applications, Gemini 1.5 Pro and similar models will help enterprise data science teams.
Now that LLMs can retrieve 1 million tokens at once, how long will it be until we don’t need retrieval augmented generation for accurate AI responses?
What a month! We had four major open LLM releases: Mixtral, Meta AI's Llama 3, Microsoft's Phi-3, and Apple's OpenELM. In my new article, I review and discus...
The capacity of large language models (LLMs) to produce adequate text in various application domains has caused a revolution in natural language creation. These models are essentially two types: 1) Most model weights and data sources are open source. 2) All model-related information is publicly available, including training data, data sampling ratios, training logs, intermediate checkpoints, and assessment methods (Tiny-Llama, OLMo, and StableLM 1.6B). Full access to open language models for the research community is vital for thoroughly investigating these models' capabilities and limitations and understanding their inherent biases and potential risks. This is necessary despite the continued breakthroughs in
We introduce a decoder-decoder architecture, YOCO, for large language models, which only caches key-value pairs once. It consists of two components, i.e., a cross-decoder stacked upon a...
Generative AI (GenAI) tools have come a long way. Believe it or not, the first generative AI tools were introduced in the 1960s in a Chatbot. Still, it was only in 2014 that generative adversarial networks (GANs) were introduced, a type of Machine Learning (ML) algorithm that allowed generative AI to finally create authentic images, videos, and audio of real people. In 2024, we can create anything imaginable using generative AI tools like ChatGPT, DALL-E, and others. However, there is a problem. We can use those AI tools but can not get the most out of them or use them
The search engine war is heating up. ChatGPT may introduce its search engine, which will rival Google, on Monday. Although
As part of data preparation for an NLP model, it’s common to need to clean up your data prior to passing it into the model. If there’s unwanted content in your output, for example, it could impact the quality of your NLP model. To help with this, the `unstructured` library includes cleaning functions to help users sanitize output before sending it to downstream applications.
Large language models such as GPT and Llama are trained with a next-token prediction loss. In this work, we suggest that training language models to predict multiple future tokens at once results...
The rapid evolution in AI demands models that can handle large-scale data and deliver accurate, actionable insights. Researchers in this field aim to create systems capable of continuous learning and adaptation, ensuring they remain relevant in dynamic environments. A significant challenge in developing AI models lies in overcoming the issue of catastrophic forgetting, where models fail to retain previously acquired knowledge when learning new tasks. This challenge becomes more pressing as applications increasingly demand continuous learning capabilities. For instance, models must update their understanding of healthcare, financial analysis, and autonomous systems while retaining prior knowledge to make informed decisions. The
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Are you curious about the intricate world of large language models (LLMs) and the technical jargon that surrounds them? Understanding the terminology, from the foundational aspects of training and fine-tuning to the cutting-edge concepts of transformers and reinforcement learning, is the first step towards demystifying the powerful algorithms that drive modern AI language systems. In this article, we delve into 25 essential terms to enhance your technical vocabulary and provide insights into the mechanisms that make LLMs so transformative. Heatmap representing the relative importance of terms in the context of LLMs Source: marktechpost.com 1. LLM (Large Language Model) Large Language
Prompt Fuzzer: The Prompt Fuzzer is an interactive tool designed to evaluate the security of GenAI application system prompts by simulating various dynamic LLM-based attacks. It assesses security by analyzing the results of these simulations, helping users fortify their system prompts accordingly. This tool specifically customizes its tests to fit the unique configuration and domain of the user's application. The Fuzzer also features a Playground chat interface, allowing users to refine their system prompts iteratively, enhancing their resilience against a broad range of generative AI attacks. Users should be aware that using the Prompt Fuzzer will consume tokens. Garak: Garak
/cdn.vox-cdn.com/uploads/chorus_asset/file/23951355/STK043_VRG_Illo_N_Barclay_1_Meta.jpg)
The models have some pretty good general knowledge.
Making your custom GPTs is just one of the ways to leverage your content strategy and use ChatGPT...
A collection of notebooks/recipes showcasing some fun and effective ways of using Claude. - anthropics/anthropic-cookbook
Deep learning architectures have revolutionized the field of artificial intelligence, offering innovative solutions for complex problems across various domains, including computer vision, natural language processing, speech recognition, and generative models. This article explores some of the most influential deep learning architectures: Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), Generative Adversarial Networks (GANs), Transformers, and Encoder-Decoder architectures, highlighting their unique features, applications, and how they compare against each other. Convolutional Neural Networks (CNNs) CNNs are specialized deep neural networks for processing data with a grid-like topology, such as images. A CNN automatically detects the important features without any human supervision.
Discussing AI Research Papers in March 2024
My startup Truss (gettruss.io) released a few LLM-heavy features in the last six months, and the narrative around LLMs that I read on Hacker News is now starting to diverge from my reality, so I thought I’d share some of the more “surprising” lessons after churning through just north of 500 million tokens, by my […]
Run large language models on your local PC for customized AI capabilities with more control, privacy, and personalization.
Gemini 1.5 Pro launch, new version of GPT-4 Turbo, new Mistral model, and more.
Claude and ChatGPT are two compelling options in AI chatbots, each with unique features and capabilities. To discern their strengths and suitability for various applications, let's compare these two AI chatbots comprehensively. What is Claude? Claude is an AI chatbot developed by an Anthropic AI renowned for its ability to simulate human-like conversations. Built on sophisticated NLP algorithms, Claude excels in engaging users in meaningful dialogues across a spectrum of topics. What sets Claude apart is its emphasis on understanding the user's persona and tailoring responses to match individual preferences and communication styles. This personalised touch enhances user experience, fostering
We are seeing some clear categories emerge in the world of LLMs - 1) affordable (~$1 per million tokens); 2) mid-range ($8/m) and 3) top end ($25-50/m)… | 32 comments on LinkedIn
We build a Generatively Pretrained Transformer (GPT), following the paper "Attention is All You Need" and OpenAI's GPT-2 / GPT-3. We talk about connections to ChatGPT, which has taken the world by storm. We watch GitHub Copilot, itself a GPT, help us write a GPT (meta :D!) . I recommend people watch the earlier makemore videos to get comfortable with the autoregressive language modeling framework and basics of tensors and PyTorch nn, which we take for granted in this video. Links: - Google colab for the video: https://colab.research.google.com/drive/1JMLa53HDuA-i7ZBmqV7ZnA3c_fvtXnx-?usp=sharing - GitHub repo for the video: https://github.com/karpathy/ng-video-lecture - Playlist of the whole Zero to Hero series so far: https://www.youtube.com/watch?v=VMj-3S1tku0&list=PLAqhIrjkxbuWI23v9cThsA9GvCAUhRvKZ - nanoGPT repo: https://github.com/karpathy/nanoGPT - my website: https://karpathy.ai - my twitter: https://twitter.com/karpathy - our Discord channel: https://discord.gg/3zy8kqD9Cp Supplementary links: - Attention is All You Need paper: https://arxiv.org/abs/1706.03762 - OpenAI GPT-3 paper: https://arxiv.org/abs/2005.14165 - OpenAI ChatGPT blog post: https://openai.com/blog/chatgpt/ - The GPU I'm training the model on is from Lambda GPU Cloud, I think the best and easiest way to spin up an on-demand GPU instance in the cloud that you can ssh to: https://lambdalabs.com . If you prefer to work in notebooks, I think the easiest path today is Google Colab. Suggested exercises: - EX1: The n-dimensional tensor mastery challenge: Combine the `Head` and `MultiHeadAttention` into one class that processes all the heads in parallel, treating the heads as another batch dimension (answer is in nanoGPT). - EX2: Train the GPT on your own dataset of choice! What other data could be fun to blabber on about? (A fun advanced suggestion if you like: train a GPT to do addition of two numbers, i.e. a+b=c. You may find it helpful to predict the digits of c in reverse order, as the typical addition algorithm (that you're hoping it learns) would proceed right to left too. You may want to modify the data loader to simply serve random problems and skip the generation of train.bin, val.bin. You may want to mask out the loss at the input positions of a+b that just specify the problem using y=-1 in the targets (see CrossEntropyLoss ignore_index). Does your Transformer learn to add? Once you have this, swole doge project: build a calculator clone in GPT, for all of +-*/. Not an easy problem. You may need Chain of Thought traces.) - EX3: Find a dataset that is very large, so large that you can't see a gap between train and val loss. Pretrain the transformer on this data, then initialize with that model and finetune it on tiny shakespeare with a smaller number of steps and lower learning rate. Can you obtain a lower validation loss by the use of pretraining? - EX4: Read some transformer papers and implement one additional feature or change that people seem to use. Does it improve the performance of your GPT? Chapters: 00:00:00 intro: ChatGPT, Transformers, nanoGPT, Shakespeare baseline language modeling, code setup 00:07:52 reading and exploring the data 00:09:28 tokenization, train/val split 00:14:27 data loader: batches of chunks of data 00:22:11 simplest baseline: bigram language model, loss, generation 00:34:53 training the bigram model 00:38:00 port our code to a script Building the "self-attention" 00:42:13 version 1: averaging past context with for loops, the weakest form of aggregation 00:47:11 the trick in self-attention: matrix multiply as weighted aggregation 00:51:54 version 2: using matrix multiply 00:54:42 version 3: adding softmax 00:58:26 minor code cleanup 01:00:18 positional encoding 01:02:00 THE CRUX OF THE VIDEO: version 4: self-attention 01:11:38 note 1: attention as communication 01:12:46 note 2: attention has no notion of space, operates over sets 01:13:40 note 3: there is no communication across batch dimension 01:14:14 note 4: encoder blocks vs. decoder blocks 01:15:39 note 5: attention vs. self-attention vs. cross-attention 01:16:56 note 6: "scaled" self-attention. why divide by sqrt(head_size) Building the Transformer 01:19:11 inserting a single self-attention block to our network 01:21:59 multi-headed self-attention 01:24:25 feedforward layers of transformer block 01:26:48 residual connections 01:32:51 layernorm (and its relationship to our previous batchnorm) 01:37:49 scaling up the model! creating a few variables. adding dropout Notes on Transformer 01:42:39 encoder vs. decoder vs. both (?) Transformers 01:46:22 super quick walkthrough of nanoGPT, batched multi-headed self-attention 01:48:53 back to ChatGPT, GPT-3, pretraining vs. finetuning, RLHF 01:54:32 conclusions Corrections: 00:57:00 Oops "tokens from the _future_ cannot communicate", not "past". Sorry! :) 01:20:05 Oops I should be using the head_size for the normalization, not C
/cdn.vox-cdn.com/uploads/chorus_asset/file/24936950/potatoking.png)
More AI image generation tools at your fingertips.
In the ever-evolving landscape of artificial intelligence, businesses face the perpetual challenge of harnessing vast amounts of unstructured data. Meet RAGFlow, a groundbreaking open-source AI project that promises to revolutionize how companies extract insights and answer complex queries with an unprecedented level of truthfulness and accuracy. What Sets RAGFlow Apart RAGFlow is an innovative engine that leverages Retrieval-Augmented Generation (RAG) technology to provide a powerful solution for information retrieval. Unlike traditional keyword searches, RAGFlow combines large language models (LLMs) with deep document understanding to extract relevant information from a vast amount of data. Intelligent template-based chunking and visualized text chunking
In a previous post, I demonstrated how to implement RAG using the Load-Transform-Embed-Store...
In the world of LLMs, there is a phenomenon known as "hallucinations." These hallucinations are...
The top open source Large Language Models available for commercial use are as follows. Llama - 2 Meta released Llama 2, a set of pretrained and refined LLMs, along with Llama 2-Chat, a version of Llama 2. These models are scalable up to 70 billion parameters. It was discovered after extensive testing on safety and helpfulness-focused benchmarks that Llama 2-Chat models perform better than current open-source models in most cases. Human evaluations have shown that they align well with several closed-source models. The researchers have even taken a few steps to guarantee the security of these models. This includes annotating
I wrote 84 new matmul kernels to improve llamafile CPU performance.
Researchers find large language models use a simple mechanism to retrieve stored knowledge when they respond to a user prompt. These mechanisms can be leveraged to see what the model knows about different subjects and possibly to correct false information it has stored.
What is ChatGPT? ChatGPT, developed by OpenAI, is an AI platform renowned for its conversational AI capabilities. Leveraging the power of the Generative Pre-trained Transformer models, ChatGPT generates human-like text responses across various topics, from casual conversations to complex, technical discussions. Its ability to engage users with coherent, contextually relevant dialogues stands out, making it highly versatile for various applications, including content creation, education, customer service, and more. Its integration with tools like DALL-E for image generation from textual descriptions and its continual updates for enhanced performance showcase its commitment to providing an engaging and innovative user experience. ChatGPT Key
Is Attention all you need? Mamba, a novel AI model based on State Space Models (SSMs), emerges as a formidable alternative to the widely used Transformer models, addressing their inefficiency in processing long sequences.
We like datacenter compute engines here at The Next Platform, but as the name implies, what we really like are platforms – how compute, storage,
Large language models do better at solving problems when they show their work. Researchers are beginning to understand why.
Language models (LLMs) have revolutionized the field of natural language processing (NLP) over the last few years, achieving…
Reference architecture patterns and mental models for working with Large Language Models (LLM’s)
We’re releasing an open source system, based on FSDP and QLoRA, that can train a 70b model on two 24GB GPUs.
Training a specialized LLM over your own data is easier than you think…
The search giant is unifying its AI-assistant efforts under one name and trying to show it can match rivals.
A complete GPT2 implementation as a single SQL query in PostgreSQL.
Today, we're announcing the Claude 3 model family, which sets new industry benchmarks across a wide range of cognitive tasks. The family includes three… | 429 comments on LinkedIn
The Amazon-backed AI startup said its "most intelligent model" outperformed OpenAI's powerful GPT-4
OpenAI's custom GPTs and GPT Store could proffer a potential new platform for publishers to drive referral traffic.
Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step - rasbt/LLMs-from-scratch
Understanding how well they comprehend and organize information is crucial in advanced language models. A common challenge arises in visualizing the intricate relationships between different document parts, especially when using complex models like the Retriever-Answer Generator (RAG). Existing tools can only sometimes provide a clear picture of how chunks of information relate to each other and specific queries. Several attempts have been made to address this issue, but they often need to deliver the need to provide an intuitive and interactive solution. These tools need help breaking down documents into manageable pieces and visualizing their semantic landscape effectively. As a
Step into the future of video creation with Google Lumiere, the latest breakthrough from Google Research that promises to redefine
Keep up with the latest ML research
Last week Google introduced Gemini Pro 1.5, an enormous upgrade to their Gemini series of AI models. Gemini Pro 1.5 has a 1,000,000 token context size. This is huge—previously that …
This blog post will look at the “Direct Preference Optimization: Your Language Model is Secretly a Reward Model” paper and its findings.
When it comes to context windows, size matters
The Math and the Code Behind Attention Layers in Computer Vision
Recent research, such as BitNet, is paving the way for a new era of 1-bit Large Language Models (LLMs). In this work, we introduce a 1-bit LLM variant, namely BitNet b1.58, in which every single...
How do we communicate effectively with LLMs?
Are you looking for the news everyday for Sora early access like us? Well you are absolutely right because OpenAI's
Mistral Large is our flagship model, with top-tier reasoning capacities. It is also available on Azure.
Sure, anyone can use OpenAI’s chatbot. But with smart engineering, you can get way more interesting results.
Talk with Claude, an AI assistant from Anthropic
A deep dive into the internals of a small transformer model to learn how it turns self-attention calculations into accurate predictions for the next token.
We will deep dive into understanding how transformer model work like BERT(Non-mathematical Explanation of course!). system design to use the transformer to build a Sentiment Analysis
Faster than Nvidia? Dissecting the economics
In artificial intelligence, the capacity of Large Language Models (LLMs) to negotiate mirrors a leap toward achieving human-like interactions in digital negotiations. At the heart of this exploration is the NEGOTIATION ARENA, a pioneering framework devised by researchers from Stanford University and Bauplan. This innovative platform delves into the negotiation prowess of LLMs, offering a dynamic environment where AI can mimic, strategize, and engage in nuanced dialogues across a spectrum of scenarios, from splitting resources to intricate trade and price negotiations. The NEGOTIATION ARENA is a tool and a gateway to understanding how AI can be shaped to think, react,
Sora is an AI model that can create realistic and imaginative scenes from text instructions.
LoRA (Low-Rank Adaptation) is a popular technique to finetune LLMs more efficiently. This Studio explains how LoRA works by coding it from scratch, which is an excellent exercise for looking under …
AI community is once again filled with excitement as Bard is now Gemini and Gemini Advanced offering users an exceptional
New experiments show that very young children are better at solving creative puzzles than ChatGPT and other AI models
When we talk about using different ways to share information, it's like picking the one that fits what you need! Words, pictures, and mixes of both have
The use of NLP in the realm of financial technology is broad and complex, with applications ranging from sentiment analysis and named entity recognition to question answering. Large Language...
Zephyr is a series of Large Language Models released by Hugging Face trained using distilled supervised fine-tuning (dSFT) on larger models with significantly improved task accuracy.
Identify and target personas of keywords, competitors, Reddit discussions, and more.
Best AI Chatbots for Customer Support
LlamaIndex is a simple, flexible data framework for connecting custom data sources to large language models (LLMs).
This article will teach you about self-attention mechanisms used in transformer architectures and large language models (LLMs) such as GPT-4 and Llama.
AI Driven tools for researchers and students. Use AI to summarize and understand scientific articles and research papers.
Implementing a GPT model from scratch in NumPy.
Autoregressive language models have excelled at predicting the subsequent subword in a sentence without the need for any predefined grammar or parsing concepts. This method has been expanded to include continuous data domains like audio and image production, where data is represented as discrete tokens, much like language model vocabularies. Due to their versatility, sequence models have attracted interest for use in increasingly complicated and dynamic contexts, such as behavior. Road users are compared to participants in a continuous conversation when driving since they exchange actions and replies. The question is whether similar sequence models may be used to forecast
As Midjourney rolls out new features, it continues to make some artists furious.
This year has felt distinctly different. I've been working in, on, and with machine learning and AI for over a decade, yet I can't recall a time when these fields were as popular and rapidly evolving as they have been this year. To conclude an eventful 2023 in machine learning and AI research, I'm excited to share 10 noteworthy papers I've read this year. My personal focus has been more on large language models, so you'll find a heavier emphasis on large language model (LLM) papers than computer vision papers this year.
Large Language Models (LLMs) have unlocked a new era in natural language processing. So why not learn more about them? Go from learning what large language models are to building and deploying LLM apps in 7 easy steps with this guide.
The emergence of Large Language Models (LLMs) in natural language processing represents a groundbreaking development. These models, trained on vast amounts of data and leveraging immense computational resources, promise to transform human interactions with the digital world. As they evolve through scaling and rapid deployment, their potential use cases become increasingly intricate and complex. They extend their capabilities to tasks such as analyzing dense, knowledge-rich documents, enhancing chatbot experiences to make them more genuine and engaging, and assisting human users in iterative creative processes like coding and design. One crucial feature that empowers this evolution is the capacity to effectively
In a comparative study, Researchers from Nvidia investigated the impact of retrieval augmentation and context window size on the performance of large language models (LLMs) in downstream tasks. The findings reveal that retrieval augmentation consistently enhances LLM performance, irrespective of context window size. Their research sheds light on the effectiveness of retrieval mechanisms in optimizing LLMs for various applications. Researchers delve into the domain of long-context language models, investigating the efficacy of retrieval augmentation and context window size in enhancing LLM performance across various downstream tasks. It conducts a comparative analysis of different pretrained LLMs, demonstrating that retrieval mechanisms significantly
LoRA is one of the most widely used, parameter-efficient finetuning techniques for training custom LLMs. From saving memory with QLoRA to selecting the optimal LoRA settings, this article provides practical insights for those interested in applying it.
As a machine learning engineer who has witnessed the rise of Large Language Models (LLMs), I find it daunting to comprehend how the ecosystem surrounding LLMs is developing.
Unlock the power of GPT-4 summarization with Chain of Density (CoD), a technique that attempts to balance information density for high-quality summaries.
Our weekly selection of must-read Editors’ Picks and original features
In this guide, we will learn how to develop and productionize a retrieval augmented generation (RAG) based LLM application, with a focus on scale and evaluation.
The definitive guide for choosing the right method for your use case
Discuss the concept of large language models (LLMs) and how they are implemented with a set of data to develop an application. Joas compares a collection of no-code and low-code apps designed to help you get a feel for not only how the concept works but also to get a sense of what types of models are available to train AI on different skill sets.
An End to End Example Of Seeing How Well An LLM Model Can Answer Amazon SageMaker Related Questions
Explore how the Skeleton-of-Thought prompt engineering technique enhances generative AI by reducing latency, offering structured output, and optimizing projects.
In the past few years we have seen the meteoric appearance of dozens of foundation models of the Transformer family, all of which have memorable and sometimes funny, but not self-explanatory,...
OpenAI's ChatGPT Vision is making waves in the world of artificial intelligence, but what exactly is it, and how can
This is a story of my journey learning to build generative ML models from scratch and teaching a computer to create fonts in the process.
Eliciting product feedback elegantly is a competitive advantage for LLM-software. Over the weekend, I queried Google’s Bard, & noticed the elegant feedback loop the product team has incorporated into their product. I asked Bard to compare the 3rd-row leg room of the leading 7-passenger SUVs. At the bottom of the post is a little G button, which double-checks the response using Google searches. I decided to click it. This is what I would be doing in any case ; spot-checking some of the results.
Participants rated Bing Chat as less helpful and trustworthy than ChatGPT or Bard. These results can be attributed to Bing’s richer yet imperfect UI and to its poorer information aggregation.
Bard is now Gemini. Get help with writing, planning, learning, and more from Google AI.
We present the latest updates on ChatGPT, Bard and other competitors in the artificial intelligence arms race.
Tools to go from prototype to production
KDnuggets' latest cheat sheet covers 10 curated hands-on projects to boost data science workflows with ChatGPT across ML, NLP, and full stack dev, including links to full project details.
Data Curation, Transformers, Training at Scale, and Model Evaluation
Learn how to use GPT / LLMs to create complex summaries such as for medical text
Track, rank and evaluate open LLMs and chatbots
I want to provide some tips from my experience implementing a paper. I'm going to cover my tips so far from implementing a dramatically scaled-down versio...
A complete beginner-friendly introduction with example code
Do you use Python, Pandas, and Seaborn to collect, analyze, and plot data? Then you'll be amazed by what ChatGPT can do, when using ChatGPT+, GPT-4 model, and the plugin for Noteable's version of Jupyter notebooks. [UPDATE/NOTE: This was my first summary of Noteable and ChatGPT. I have done more experiments, which you can see here: https://www.youtube.com/watch?v=2WUZ0b-hUDU] In this video, I show you how I got things set up for using Noteable (and world headlines), then put together a query, You'll see how it goes well, where it goes wrong, and what sort of code I can create using just English-language descriptions of my plans. And I show you what's happening behind the scenes, as we see the JSON being written. This is all brand new and exciting, and I hope that you'll post suggestions and ideas in the comments for how we can take this even further! And if you're interested in analyzing data with Pandas, check out Bamboo Weekly at https://www.BambooWeekly.com/, where I look at current events through the eyes of data analysis.
A quick-start guide to using open-source LLMs
Hey guys, welcome back to my R-tips newsletter. In today’s R-tip, I’m sharing a super common data science task (one that saved me 20 hours per week)… You’re getting the cheat code to automating Google Sheets. Plus, I’m sharing exactly how I made this a...
How you can fine-tune OpenAI’s GPT-3.5 Turbo model to perform new tasks using your custom data
Human-readable benchmarks of 60+ open-source and proprietary LLMs.
In a significant technological leap, OpenAI has announced the launch of DALL·E 3, the latest iteration in their groundbreaking text-to-image generation technology. With an unprecedented capacity to understand nuanced and detailed descriptions, DALL·E 3 promises to revolutionize the creative landscape by allowing users to translate their textual ideas into astonishingly accurate images effortlessly. DALL·E 3 is currently in research preview, offering a tantalizing glimpse into its capabilities. However, the broader availability of this cutting-edge technology is set for early October, when it will be accessible to ChatGPT Plus and Enterprise customers through the API and Labs later in the fall.
DALL-E 3, the latest version of OpenAI's ground-breaking generative AI visual art platform, was just announced with groundbreaking features, including
The young company sent shock waves around the world when it released ChatGPT. But that was just the start. The ultimate goal: Change everything. Yes. Everything.
If you're a developer or simply someone passionate about technology, you've likely encountered AI...
Seamlessly integrate LLMs into scikit-learn.
7 prompting tricks, Langchain, and Python example code
How to fine-tune Llama and other LLMs with one tool
A multifaceted challenge has arisen in the expansive realm of natural language processing: the ability to adeptly comprehend and respond to intricate and lengthy instructions. As communication nuances become more complicated, the shortcomings of prevailing models in dealing with extensive contextual intricacies have been laid bare. Within these pages, an extraordinary solution crafted by the dedicated minds at Together AI comes to light—a solution that holds the promise of reshaping the very fabric of language processing. This innovation has profound implications, especially in tasks requiring an acute grasp of extended contextual nuances. Contemporary natural language processing techniques rely heavily on
3 levels of using LLMs in practice
Baking General Understanding into Language Models
Word embedding vector databases have become increasingly popular due to the proliferation of massive language models. Using the power of sophisticated machine learning techniques, data is stored in a vector database. It allows for very fast similarity search, essential for many AI uses such as recommendation systems, picture recognition, and NLP. The essence of complicated data is captured in a vector database by representing each data point as a multidimensional vector. Quickly retrieving related vectors is made possible by modern indexing techniques like k-d trees and hashing. To transform big data analytics, this architecture generates highly scalable, efficient solutions for
Use these text extraction techniques to get quality data for your LLM models
A user-friendly platform for operating large language models (LLMs) in production, with features such as fine-tuning, serving, deployment, and monitoring of any LLMs.
Recent language models can take long contexts as input; more is needed to know about how well they use longer contexts. Can LLMs be extended to longer contexts? This is an unanswered question. Researchers at Abacus AI conducted multiple experiments involving different schemes for developing the context length ability of Llama, which is pre-trained on context length 2048. They linear rescaled these models with IFT at scales 4 and 16. Scaling the model to scale 16 can perform world tasks up to 16k context length or even up to 20-24k context length. Different methods of extending context length are Linear
Using ChatGPT & OpenAI's GPT API, this code tutorial teaches how to chat with PDFs, automate PDF tasks, and build PDF chatbots.
Complete guide to building an AI assistant that can answer questions about any file
Practical Advice from Experts: Fine-Tuning, Deployment, and Best Practices
LangChain is a Python library that helps you build GPT-powered applications in minutes. Get started with LangChain by building a simple question-answering app.
Latest blogs from the team at Mosaic Research
Seth Michael Larson pointed out that the Python gzip module can be used as a CLI tool like this:
Navigating the maze of pricing plans for digital services can sometimes be a daunting task. Today, we are unveiling Midjourney
Exploring the Development of the 3 Leading Open LLMs and Their Chatbot Derivatives
A practical and simple approach for “reasoning” with LLMs
Anthropic released Claude 2, a new iteration of its AI model, to take on ChatGPT and Google Bard...
A reference architecture for the LLM app stack. It shows the most common systems, tools, and design patterns used by AI startups and tech companies.
Step by step explanation of how one of the most important MLSys breakthroughs work — in gory detail.
An Introduction to Auto-GPT
Organizations are in a race to adopt Large Language Models. Let’s dive into how you can build industry-specific LLMs Through RAG
Explained with an example use case.
Large language models such as GPT-3/4, LLaMA and PaLM work in terms of tokens. They take text, convert it into tokens (integers), then predict which tokens should come next. Playing …
Want to learn more about LLMs and build cool LLM-powered applications? This free Full Stack LLM Bootcamp is all you need!
The model quickly top the Open LLM Leaderboard that ranks the performance of open source LLMs.
GPT, explained simply, in a metaphor of potion.
tldr; techniques to speed up training and inference of LLMs to use large context window up to 100K input tokens during training and…
A step-by-step tutorial to document loaders, embeddings, vector stores and prompt templates
The Observe.AI contact center LLM showed a 35% increase in accuracy compared to GPT-3.5 when automatically summarizing conversations.
10 ChatGPT Plugins for Data Science Cheat Sheet • Noteable Plugin: The ChatGPT Plugin That Automates Data Analysis • 3 Ways to Access Claude AI for Free • What are Vector Databases and Why Are They Important for LLMs? • A Data Scientist’s Essential Guide to Exploratory Data Analysis
With the release of PyTorch 2.0 and ROCm 5.4, we are excited to announce that LLM training works out of the box on AMD MI250 accelerators with zero code changes and at high performance!
This article provides a series of techniques that can lower memory consumption in PyTorch (when training vision transformers and LLMs) by approximately 20x without sacrificing modeling performance and prediction accuracy.
Running Falcon-7B in the cloud as a microservice
Transform your life with these ChatGPT’s hidden gems.
Anthropic, the AI startup founded by ex-OpenAI execs, has released its newest chatbot, Claude 2. It's ostensibly improved in several ways.
Google is launching its AI-backed note-taking tool to "a small group of users in the US," the company said in a blog post. Formerly referred to as Project Tailwind at Google I/O earlier this year, the new app is now known as NotebookLM (the LM stands for Language Model). The Verge reports: The core...
Developed by ETH Zürich, the language explores new paradigms for LLM programming.
It crazy how far the ML field has come when it comes to fine-tuning LLMs. A year ago: it was challenging to fine-tune GPT-2 (1.5B) on a single GPU without… | 76 comments on LinkedIn
A comprehensive guide on how to use Meta's LLaMA 2, the new open-source AI model challenging OpenAI's ChatGPT and Google's Bard.
How LLaMA is making open-source cool again
Not only has LLaMA been trained on more data, with more parameters, the model also performs better than its predecessor, according to Meta.
MosaicML claims that the MPT-7B-8K LLM exhibits exceptional proficiency in summarization and answering tasks compared to previous models.
The founders of Anthropic quit OpenAI to make a safe AI company. It’s easier said than done.
This article delves into the concept of Chain-of-Thought (CoT) prompting, a technique that enhances the reasoning capabilities of large language models (LLMs). It discusses the principles behind CoT prompting, its application, and its impact on the performance of LLMs.
A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers) - Mooler0410/LLMsPracticalGuide
An effective prompt is the first step in benefitting from ChatGPT. That's the challenge — an effective prompt.
In this article, we will demonstrate how to use different prompts to ask ChatGPT for help and make...
Falcon LLM, is the new large language model that has taken the crown from LLaMA.
Get started using Falcon-7B, Falcon-40B, and their instruct versions
Large language models have increased due to the ongoing development and advancement of artificial intelligence, which has profoundly impacted the state of natural language processing in various fields. The potential use of these models in the financial sector has sparked intense attention in light of this radical upheaval. However, constructing an effective and efficient open-source economic language model depends on gathering high-quality, pertinent, and current data. The use of language models in the financial sector exposes many barriers. These vary from challenges in getting data, maintaining various data forms and kinds, and coping with inconsistent data quality to the crucial
Welcome to the LMM garden! A searchable list of open-source and off-the-shelf LLMs available to ML practitioners. Know of a new LLM? Add it
Seamlessly integrate LLMs into scikit-learn.
GPUs may dominate, but CPUs could be perfect for smaller AI models
ChatGPT can generate usable content. But it can also analyze existing content — articles, descriptions — and suggest improvements for SEO and social media.
Learn how standard greedy tokenization introduces a subtle and powerful bias that can have all kinds of unintended consequences.
AI companies are using LangChain to supercharge their LLM apps. Here is a comprehensive guide of resources to build your LangChain + LLM journey. 🔗 What is… | 45 comments on LinkedIn
The next generation of AI is leaving behind the viral chatbot.
AI is getting very chatty! Here’s a visualisation charting the rise of Large Language Models like GPT4, LaMDA, LLaMa, PaLM and their bots...
A new AI Bard powered by PaLM V2 that can write, translate, and code better than ChatGPT.
On Tuesday, the result arrived via email: “NOT GUILTY.”
1) Reinforcement Learning with Human Feedback(RLHF) 2) The RLHF paper, 3) The transformer reinforcement learning framework.
Google's new machines combine Nvidia H100 GPUs with Google’s high-speed interconnections for AI tasks like training very large language models.
More languages, image inputs, and extension support among Bard features at I/O ’23.
Deploying large language models (LLMs) is challenging because they are memory inefficient and compute-intensive for practical applications. In reaction, researchers train smaller task-specific...
We show for the first time that large-scale generative pretrained transformer (GPT) family models can be pruned to at least 50% sparsity in one-shot, without any retraining, at minimal loss of...
OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset - openlm-research/open_llama
A guidance language for controlling large language models. - guidance-ai/guidance
Use the power of ChatGPT from within your own apps using OpenAI’s API and this guide.
Anyscale is the leading AI application platform. With Anyscale, developers can build, run and scale AI applications instantly.
In the rapidly evolving field of AI, using large language models in an efficient and effective manner is becoming more and more important. In this article, y...
Created by researchers from UC Berkeley, CMU, Stanford, and UC San Diego, Vicuna is part of the new wave of models that use Meta's LLaMA as its foundation.
LangChain + OpenAI + Panel + HuggingFace
Many intelligent robots have come and gone, failing to become a commercial success. We’ve lost Aibo, Romo, Jibo, Baxter—even Alexa is reducing staff. Perhaps they failed to reach their potential because you can’t have a meaningful conversation with them. We are now at an inflection point: AI
Your own LLM. MiniGPT-4. WebGPT on WebGPU. Transformers from scratch. ChatGTP Plugins demo live. Whisper JAX. LLaVA. MetaAI DINO SoTA Computer Vision. Autonomous agents in LangChain. RedPajama.
It's like learning a new language - kind of.
An introduction to the core ideas and approaches
Sundays, The Sequence Scope brings a summary of the most important research papers, technology releases and VC funding deals in the artificial intelligence space.
Facebook’s parent company is inviting researchers to pore over and pick apart the flaws in its version of GPT-3
The widespread public deployment of large language models (LLMs) in recent months has prompted a wave of new attention and engagement from advocates, policymakers, and scholars from many fields....
Introducing the new fully autonomous task manager that can create, track and prioritize your company's projects using artificial intelligence.
A Cross-Section of the Most Relevant Literature To Get Up to Speed
Exploring why AI won’t replace designers, but rather enhance their work.
The simplest, fastest repository for training/finetuning medium-sized GPTs. - karpathy/nanoGPT
In this guest post, Filip Haltmayer, a Software Engineer at Zilliz, explains how LangChain and Milvus can enhance the usefulness of Large Language Models (LLMs) by allowing for the storage and retrieval of relevant documents. By integrating Milvus, a vector database, with LangChain, LLMs can process more tokens and improve their conversational abilities.
Dolly 2.0 could spark a new wave of fully open source LLMs similar to ChatGPT.
Artificial intelligence models have found their way into many people’s lives, for work and for fun.
Chain-of-Thought (CoT) prompting can effectively elicit complex multi-step reasoning from Large Language Models~(LLMs). For example, by simply adding CoT instruction ``Let's think step-by-step''...
Prompt Engineering, also known as In-Context Prompting, refers to methods for how to communicate with LLM to steer its behavior for desired outcomes without updating the model weights. It is an empirical science and the effect of prompt engineering methods can vary a lot among models, thus requiring heavy experimentation and heuristics. This post only focuses on prompt engineering for autoregressive language models, so nothing with Cloze tests, image generation or multimodality models.
#langchain #chatgpt #gpt4 #artificialintelligence #automation #python #notion #productivity #datascience #pdf #machinelearning In this tutorial, learn how to easily extract information from a PDF document using LangChain and ChatGPT. I'll walk you through installing dependencies, loading and processing a PDF file, creating embeddings, and querying the PDF with natural language questions. 00:00 - Introduction 00:21 - Downloading a sample PDF 00:49 - Importing required modules 01:21 - Setting up the PDF path and loading the PDF 01:38 - Printing the first page of the PDF 01:53 - Creating embeddings and setting up the Vector database 02:24 - Creating a chat database chain 02:49 - Querying the PDF with a question 03:27 - Understanding the query results 04:00 - Conclusion Remember to like and subscribe for more tutorials on learning, research and AI! - Source code: https://github.com/EnkrateiaLucca/talk_pdf - Link to the medium article: https://medium.com/p/e723337f26a6 - Subscribe!: https://www.youtube.com/channel/UCu8WF59Scx9f3H1N_FgZUwQ - Join Medium: https://lucas-soares.medium.com/membership - Tiktok: https://www.tiktok.com/@enkrateialucca?lang=en - Twitter: https://twitter.com/LucasEnkrateia - LinkedIn: https://www.linkedin.com/in/lucas-soares-969044167/ Music from [www.epidemicsound.com](http://www.epidemicsound.com/)
Language is essentially a complex, intricate system of human expressions governed by grammatical rules. It poses a significant challenge to develop capable AI algorithms for comprehending and...
Explore what LLMs are, how they work, and gain insights into real-world examples, use cases, and best practices.
Garbage in, garbage out has never been more true.
If you're looking for a way to improve the performance of your large language model (LLM) application while reducing costs, consider utilizing a semantic cache to store LLM responses.
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
ChatGPT is a deep-learning model created by OpenAI whose ability to generate human-like prose has made AI a topic of conversation. Learn more
AI multiplies your efforts. I found out by how much...
OpenAI today announced its support of new third-party plugins for ChatGPT, and it already has Twitter buzzing about the company's potential platform play.
Quote "ChatGPT is like a genie in a bottle, but instead of granting you three wishes, it gives you endless responses until you realize you've been chatting with a machine for hours." 😂
Who Is publishing the most Impactful AI research right now? With the breakneck pace of innovation in AI, it is crucial to pick up some signal as soon as possible. No one has the time to read everything, but these 100 papers are sure to bend the road as to where our AI technology is going. The real test of impact of R&D teams is of course how the technology appears in products, and OpenAI shook the world by releasing ChatGPT at the end of November 2022, following fast on their March 2022 paper “T
ChatPDF is the fast and easy way to chat with any PDF, free and without sign-in. Talk to books, research papers, manuals, essays, legal contracts, whatever you have! The intelligence revolution is here, ChatGPT was just the beginning!
Dead simple way to run LLaMA on your computer
ChatGPT recently passed the U.S. Medical Licensing Exam, but using it for a real-world medical diagnosis would quickly turn deadly.
ChatGPT invented a hit puzzle game called Sumplete that could rival Wordle. There's just one problem: It already exists.
It’s March 2023 and right now ChatGPT, the amazing AI chatbot tool from OpenAI, is all the rage. But when OpenAI released their public web API for ChatGPT on the 1st of March you might have been a bit disappointed. If you’re an R user, that is. Because, when scrolling through the release announcement you find that there is a python package to use this new API, but no R package. I’m here to say: Don’t be disappointed! As long as there is a web API for a service then it’s going to be easy to use this service from R, no specialized package needed. So here’s an example of how to use the new (as of March 2023) ChatGPT API from R. But know that when the next AI API hotness comes out (likely April 2023, or so) then it’s going to be easy to interface with that from R, as well. Calling the ChatGPT web API from R To use the ChatGPT API in any way you first need to sign up and get an API key: The “password” you need to access the web API. It could look something like "sk-5xWWxmbnJvbWU4-M212Z2g5dzlu-MzhucmI5Yj-l4c2RkdmZ26". Of course, that’s not my real API key because that’s something you should keep secret! With an API key at hand you now look up the documentation and learn that this is how you would send a request to the API from the terminal: curl https://api.openai.com/v1/chat/completions \ -H "Authorization: Bearer $OPENAI_API_KEY" \ -H "Content-Type: application/json" \ -d '{ "model": "gpt-3.5-turbo", "messages": [{"role": "user", "content": "What is a banana?"}] }' But how do we send a request to the API using R? What we can do is to “replicate” this call using httr: a popular R package to send HTTP requests. Here’s how this request would be made using httr (with the curl lines as comments above the corresponding httr code) library(httr) api_key
LLaMA-13B reportedly outperforms ChatGPT-like tech despite being 10x smaller.
Explore developer resources, tutorials, API docs, and dynamic examples to get the most out of OpenAI's platform.
OpenAI’s chatbot offers paraphrases, whereas Google offers quotes. Which do we prefer?
As a Ruby developer, you can immediately incorporate AI into your applications through the use of the OpenAI API. Our beginners guide will take you through step by step.
Startup Empathy has launched a new tool that uses AI to generate obituaries. It might sound callous, but the results aren't terrible, surprisingly.
During the last two years there has been a plethora of large generative models such as ChatGPT or Stable Diffusion that have been published. Concretely, these models are able to perform tasks such...
A website aggregator is a website that collects data from other websites across the internet and puts...
Summarize web articles.
I was playing around with OpenAI (GPT-3) today, building a reasonably complicated email parser for a...
A new wave of chat bots like ChatGPT use artificial intelligence that could reinvent or even replace the traditional internet search engine.
The wave of enthusiasm around generative networks feels like another Imagenet moment - a step change in what ‘AI’ can do that could generalise far beyond the cool demos. What can it create, and where are the humans in the loop?
Everything I understand about chatgpt · GitHub
A conversational AI system that listens, learns, and challenges
The OpenAI ChatGPT chatbot was just released and is already quite popular. Say hello to the newest chatbot with one
The first obvious casualty of large language models is homework: the real training for everyone, though, and the best way to leverage AI, will be in verifying and editing information.
I figured out how to run a SQL query directly against a CSV file using the sqlite3 command-line utility:
The way we search online hasn’t changed in decades. A new idea from Google researchers could make it more like talking to a human expert
A simple quick solution for deploying an NLP project and challenges you may faced during the process.
From predicting single sentence to fine-tuning using custom dataset to finding the best hyperparameter configuration.
Determining the optimal architectural parameters reduces network size by 84% while improving performance on natural-language-understanding tasks.
AI researchers from the Ludwig Maximilian University (LMU) of Munich have developed a bite-sized text generator capable of besting OpenAI’s state of the art GPT-3 using only a tiny fraction of its parameters. GPT-3 is a monster of an AI sys
What does Microsoft getting an "exclusive license" to GPT-3 mean for the future of AI democratization?
Google published an article “Understanding searches better than ever before” and positioned BERT as one of the most important updates to…
TensorFlow code and pre-trained models for BERT.
Discussions: Hacker News (98 points, 19 comments), Reddit r/MachineLearning (164 points, 20 comments) Translations: Chinese (Simplified), French 1, French 2, Japanese, Korean, Persian, Russian, Spanish 2021 Update: I created this brief and highly accessible video intro to BERT The year 2018 has been an inflection point for machine learning models handling text (or more accurately, Natural Language Processing or NLP for short). Our conceptual understanding of how best to represent words and sentences in a way that best captures underlying meanings and relationships is rapidly evolving. Moreover, the NLP community has been putting forward incredibly powerful components that you can freely download and use in your own models and pipelines (It’s been referred to as NLP’s ImageNet moment, referencing how years ago similar developments accelerated the development of machine learning in Computer Vision tasks).
Visualizing machine learning one concept at a time.
Pre-training SmallBERTa - A tiny model to train on a tiny dataset An end to end colab notebook that allows you to train your own LM (using HuggingFace…
In this tutorial we learn to quickly train Huggingface BERT using PyTorch Lightning for transfer learning on any NLP task
Unless you have been out of touch with the Deep Learning world, chances are that you have heard about BERT — it has been the talk of the town for the last one year. At the end of 2018 researchers …
From BERT’s tangled web of attention, some intuitive patterns emerge.
I’m going to describe a way to put together a world-class continuous deployment infrastructure for your side-project without spending any money. With continuous deployment every code commit is tested against …
Large Language Models (LLMs) have gained significant prominence in modern machine learning, largely due to the attention mechanism. This mechanism employs a sequence-to-sequence mapping to construct context-aware token representations. Traditionally, attention relies on the softmax function (SoftmaxAttn) to generate token representations as data-dependent convex combinations of values. However, despite its widespread adoption and effectiveness, SoftmaxAttn faces several challenges. One key issue is the tendency of the softmax function to concentrate attention on a limited number of features, potentially overlooking other informative aspects of the input data. Also, the application of SoftmaxAttn necessitates a row-wise reduction along the input sequence length,
The challenge of managing and recalling facts from complex, evolving conversations is a key problem for many AI-driven applications. As information grows and changes over time, maintaining accurate context becomes increasingly difficult. Current systems often struggle to handle the evolving nature of relationships and facts, leading to incomplete or irrelevant results when retrieving information. This can affect the effectiveness of AI agents, especially when dealing with user memories and context in real-time applications. Some existing solutions have attempted to address this problem. One common approach is using a Retrieval-Augmented Generation (RAG) pipeline, which involves storing extracted facts and using techniques
Retrieval-Augmented Generation (RAG) is a machine learning framework that combines the advantages of both retrieval-based and generation-based models. The RAG framework is highly regarded for its ability to handle large amounts of information and produce coherent, contextually accurate responses. It leverages external data sources by retrieving relevant documents or facts and then generating an answer or output based on the retrieved information and the user query. This blend of retrieval and generation leads to better-informed outputs that are more accurate and comprehensive than models that rely solely on generation. The evolution of RAG has led to various types and approaches,
This post unveils a well-kept secret unknown to many: using externally hosted Large Language Models (LLMs) in Google Sheets to perform NLP tasks on text
A comparison between a report written by a human and one composed by AI reveals the weaknesses of the latter when it comes to journalism.
The Artifex blog covers the latest news and updates regarding Ghostscript, MuPDF, and SmartOffice. Subjects cover PDF and Postscript, open source, office productivity, new releases, and upcoming events.
Combining LLM reasoning for text-based models in Scikit-Learn.
Large Language Models (LLMs) have gained significant prominence in recent years, driving the need for efficient GPU utilization in machine learning tasks. However, researchers face a critical challenge in accurately assessing GPU performance. The commonly used metric, GPU Utilization, accessed through nvidia-smi or integrated observability tools, has proven to be an unreliable indicator of actual computational efficiency. Surprisingly, 100% GPU utilization can be achieved merely by reading and writing to memory without performing any computations. This revelation has sparked a reevaluation of performance metrics and methodologies in the field of machine learning, prompting researchers to seek more accurate ways to
Large language models (LLMs) have advanced significantly in recent years. However, its real-world applications are restricted due to substantial processing power and memory requirements. The need to make LLMs more accessible on smaller and resource-limited devices drives the development of more efficient frameworks for model inference and deployment. Existing methods for running LLMs include hardware acceleration techniques and optimizations like quantization and pruning. However, these methods often fail to provide a balance between model size, performance, and usability in constrained environments. Researchers developed an efficient, scalable, and lightweight framework for LLM inference, LightLLM, to address the challenge of efficiently deploying
Nvidia has released NVLM 1.0, a powerful open-source AI model that rivals GPT-4 and Google’s systems, marking a major breakthrough in multimodal language models for vision and text tasks.
Large Language Models (LLMs) have become a cornerstone in artificial intelligence, powering everything from chatbots and virtual assistants to advanced text generation and translation systems. Despite their prowess, one of the most pressing challenges associated with these models is the high cost of inference. This cost includes computational resources, time, energy consumption, and hardware wear. Optimizing these costs is paramount for businesses and researchers aiming to scale their AI operations without breaking the bank. Here are ten proven strategies to reduce LLM inference costs while maintaining performance and accuracy: Quantization Quantization is a technique that decreases the precision of model