llms.blog
Open Source24 articles

Open Source

Articles

  • LLM Inference on AMD ROCm in Production: MI300X Architecture, Triton Kernel Parity, and vLLM Serving Benchmarks

    LLM Inference on AMD ROCm in Production: MI300X Architecture, Triton Kernel Parity, and vLLM Serving Benchmarks Serving frontier large language models in enterprise production has historically been synonymous with NVIDIA CUDA infrastructure. However, the deployment of AMD Instinct MI300X accelerators across tier-one hyperscalers and neoclouds has established a viable alternative for high-throughput inference fleets. With 192 GB of high-bandwidth memory (HBM3) and 5.3 TB/s of peak theoretical m

    1 min

  • Nvidia Expands Nemotron Open-Weight Push to Counter Chinese Labs Under B Poolside Deal

    Nvidia Expands Nemotron Open-Weight Push to Counter Chinese Labs Under $6B Poolside Deal Nvidia plans to use the infrastructure and engineering team acquired through its $6 billion deal with AI startup Poolside to build frontier open-weight models under its Nemotron family, according to reporting from the Wall Street Journal. The initiative aims to counter the rapid global adoption of Chinese open-weight systems like DeepSeek-V3, Moonshot AI's Kimi K3, and Alibaba's Qwen series, while offering

    1 min

  • LLM 0.33 Adds Template Chaining, Per-Call Embedding Keys, and Server Tool Logging

    Simon Willison has released llm 0.33, an update to the open-source command-line tool and Python library for interacting with large language models. The release introduces template composition, stateless per-call embedding credentials, and server-side tool execution visibility in logs, alongside an upgrade to the OpenAI Python 3.x client and httpx2. Template Composition and Parameter Decoupling The primary workflow enhancement in version 0.33 is the ability to repeat the -t or --template flag

    1 min

  • inclusionAI Releases Six Ling-3.0 Base Checkpoints with Warmup-Stable-and-Merge Architecture

    Ant Group's AI research lab, inclusionAI, has publicly released six open-weight base checkpoints for its Ling-3.0 foundation model family under the permissive MIT license. The release spans two distinct parameter scales (Ling-3.0-flash and Ling-3.0-tiny) and captures three sequential stages of the pre-alignment training pipeline. Rather than providing solely post-trained chat models, the release provides unaligned base weights designed specifically for continued pre-training, domain-specific mi

    1 min

  • Anthropic Deploys Claude Mythos 5 in Security Tools, Commits 5M to Open-Source Defense Fund

    Anthropic Deploys Claude Mythos 5 in Security Tools, Commits $35M to Open-Source Defense Fund Claude Mythos 5 is now running vulnerability scans in Claude Security for Enterprise customers, marking the third stage of Anthropic's deliberate rollout of its cyber-capable model. Anthropic announced on August 21 that Claude Mythos 5, limited to vetted security defenders since April 2026, is now available for Enterprise customers to scan codebases for vulnerabilities. The company is also launching

    1 min

  • Hugging Face Summer 2026 Report: Qwen Derivatives Top 150K as AI Agents Become Hub's Top Users

    Hugging Face has published its State of Open Models: Summer 2026 report, detailing seven months of platform metrics that highlight a widening divergence between benchmark attention and production deployment. According to the analysis covering January through August 2026, public model repositories on the Hub grew from 2.43 million to 2.96 million, public datasets surpassed 1 million for the first time, and Spaces expanded to 1.44 million. Despite the catalog expansion, usage remains heavily conc

    1 min

  • NanoClaw Launches Slack Integration for Persistent Multi-Agent Workspaces

    NanoCo has released a native Slack Marketplace integration for its open-source autonomous agent harness, NanoClaw. The integration allows teams to provision persistent, multi-agent AI workforces directly within Slack channels using conversational prompts. Unlike standard single-bot integrations or ephemeral background subagents, NanoClaw assigns each newly generated agent a distinct Slack identity, complete with individual avatars, handles, permission boundaries, and dedicated memory contexts.

    1 min

  • Google's Gemma Open Models Pass 1 Billion Downloads as Variants Top 100,000

    Google DeepMind announced that its Gemma family of open-weight models has surpassed one billion cumulative downloads since its initial launch in early 2024. Alongside the download milestone, the laboratory reported that third-party developers have published more than 100,000 distinct fine-tuned variants and derivative architectures across community model hubs. The milestone marks the first cumulative adoption metrics released by Google for the Gemma ecosystem. To accompany the figures, Google l

    1 min

  • DeepSeek Open-Sources DeepSeek Harness: Modular Agent Runtime Built on Cordis Plugin Framework

    DeepSeek AI has released DeepSeek Harness (dsh), an open-source agent harness built on a modular "everything is a plugin" design. Published under the MIT license on GitHub, the project provides a runtime framework where all core agent functions—including model adapters, session storage, tool registries, sandboxes, and the execution loop itself—are implemented as interchangeable, hot-swappable plugins. Rather than developing a monolithic agent runner, DeepSeek structured the system around Cordis

    1 min

  • DeepReinforce Releases Ornith-1.5: MIT-Licensed 9B, 35B, and 397B Open Weights Trained on Autonomous Self-Improvement Loops

    DeepReinforce and the Ornith team have released Ornith-1.5, a family of open-weight foundation models trained using autonomous self-improvement loops. Released under the permissive MIT license, the model family spans three architectures: a 9B dense model, a 35B mixture-of-experts model activating approximately 3B parameters per token (35B-A3B), and a flagship 397B mixture-of-experts model. The release expands on the team's earlier Ornith-1.0 release by automating the entire post-training optimi

    1 min

  • Multi-LoRA Serving in Production: Architecture, Dynamic Adapter Swapping, and GPU Memory Management

    Multi-LoRA Serving in Production: Architecture, Dynamic Adapter Swapping, and GPU Memory Management Deploying hundreds or thousands of fine-tuned language models across enterprise workflows presents a fundamental infrastructure dilemma. While parameter-efficient fine-tuning (PEFT) methods like Low-Rank Adaptation (LoRA) reduce training compute by freezing base model weights and training compact low-rank matrices, naive deployment strategies fail at scale. Merging adapter weights directly into t

    1 min

  • TrueFoundry Open-Sources TrueForge Agent Harness to Cut Managed Inference Spend

    Enterprise ML infrastructure platform TrueFoundry has open-sourced its custom agent runtime, TrueForge, under the permissive MIT license. The framework is designed to orchestrate autonomous reasoning loops, tool interactions, and long-running execution across vendor-neutral LLM backends while systematically reducing token overhead and operational compute costs. According to benchmark data published by TrueFoundry, pairing TrueForge with the open-weight GLM-5.2 model completed 11 of 14 enterpris

    1 min

  • Z Lab Releases DFlash 2 for Qwen 3.8 27B: Block Diffusion Speculative Decoding with Target KV Injection

    Z Lab has released DFlash 2 checkpoints for Alibaba's Qwen 3.8 27B model family, advancing block-diffusion speculative decoding for open-weights LLM serving. By replacing conventional autoregressive draft models with a non-causal diffusion mechanism paired with direct target key-value (KV) cache injection, the framework achieves up to 3x to 4.3x throughput speedups in production inference engines like SGLang and vLLM without altering output token distributions. Speculative decoding conventional

    1 min

  • Block Open-Sources Berd: Apache 2.0 Desktop Workspace for Multi-Model AI Agents

    Block has open-sourced Berd, an Apache 2.0-licensed desktop application designed to serve as a unified workspace for managing AI agents across different foundation models, toolsets, and execution harnesses. Originally built for internal use across Square, Cash App, and Tidal, the desktop client reached version 0.6.2 on August 18, 2026, with builds available for macOS, Windows, and Linux. The release addresses growing operational fragmentation as developers juggle specialized agent environments

    1 min

  • Modular Open-Sources Mojo Language Compiler and Toolchain Under Apache 2.0

    Modular Open-Sources Mojo Language Compiler and Toolchain Under Apache 2.0 Modular has released the complete source code for the Mojo programming language compiler, standard tooling, and runtime infrastructure under the Apache 2.0 license with LLVM exceptions. The announcement, delivered on August 18, 2026 during the company's ModCon developer conference, fulfills a multi-year roadmap commitment to transition the systems programming language to a fully open development model. The compiler sour

    1 min

  • Alibaba Releases Qwen 3.8 27B with Native Vision and Dynamic Reasoning Controls

    Alibaba's Qwen research team has released Qwen 3.8 27B, an open-weight multimodal foundation model released under the Apache 2.0 license. The model combines 27 billion parameters with native vision processing, a 262,144-token maximum context window, and configurable inference-time reasoning controls. Under standard 4-bit quantization (Q4_K_M), the model compresses to approximately 17GB on disk, allowing local execution on consumer hardware with 24GB of VRAM or Apple Silicon unified memory syste

    1 min

  • White House to Expand AI Safety Testing to Open Models

    The Trump administration plans to extend its classified AI safety-testing framework to open-weight models once they reach frontier-level capabilities, according to a White House official who spoke with WIRED. Current Framework Covers Closed Models Only The existing voluntary framework, developed under a June executive order, applies to closed models from labs such as OpenAI and Anthropic. Developers can submit new models up to 30 days before public release for government cybersecurity evaluat

    1 min

  • Alibaba open-weights Qwen 3.8 with a 27B model that tops its bigger predecessor

    Alibaba's Qwen team published the open weights for Qwen3.8 on Thursday, releasing the models under the Apache 2.0 license. The move puts a capable new open model directly into the hands of researchers and companies that want to fine-tune and self-host it. The centerpiece is Qwen3.8-27B, a 27 billion parameter multimodal dense model. Qwen says it outperforms the larger Qwen3.7-Plus on coding and office tasks, a notable result for a model less than a tenth the size of some frontier flagships. The

    1 min

  • MiniMax Restricts H3 Video Model Access in Western Markets, Citing Copyright Uncertainty

    Chinese AI company MiniMax has released the open weights for its H3 video generation model but imposed licensing restrictions on users in the United States, European Union, United Kingdom, and South Korea. Developers in those regions must apply for a formal license before using the model, the Shanghai-based company said Monday. The 33-billion-parameter H3 model processes text, images, video, and audio in a single prompt and can generate 4- to 15-second clips with stereo sound. A single prompt a

    1 min

  • Z.ai Launches ZCode, a Free Agentic IDE That Undercuts Cursor and Claude Code

    On July 2, Beijing-based Z.ai (formerly Zhipu AI) released ZCode, a free desktop application it calls an "Agentic Development Environment" built around its GLM-5.2 model. The launch puts it in direct competition with Cursor, Claude Code, and GitHub Copilot at price points the American tools cannot match. It also arrives with a structural constraint every team should evaluate before switching: China's National Intelligence Law applies to every API call routed through Z.ai's servers. ZCode is not

    1 min