llms.blog
Hardware46 articles

Hardware

Articles

  • Anthropic Nears $7B Acquisition of AI Infrastructure Startup Decart Ahead of IPO

    Anthropic is finalizing negotiations to acquire Israeli artificial intelligence infrastructure startup Decart in a transaction valued at approximately $7 billion, according to reporting from Calcalist and Reuters. The acquisition, expected to be settled primarily in Anthropic equity, would mark the Claude developer's largest purchase to date as it prepares for a planned initial public offering. Founded in September 2023 by Dr. Dean Leitersdorf and Moshe Shalev, Decart specializes in hardware-ag

    1 min

  • LLM Inference on AMD ROCm in Production: MI300X Architecture, Triton Kernel Parity, and vLLM Serving Benchmarks

    LLM Inference on AMD ROCm in Production: MI300X Architecture, Triton Kernel Parity, and vLLM Serving Benchmarks Serving frontier large language models in enterprise production has historically been synonymous with NVIDIA CUDA infrastructure. However, the deployment of AMD Instinct MI300X accelerators across tier-one hyperscalers and neoclouds has established a viable alternative for high-throughput inference fleets. With 192 GB of high-bandwidth memory (HBM3) and 5.3 TB/s of peak theoretical m

    1 min

  • Groq Secures 50M at .5B Valuation to Expand Nvidia-Powered AI Neocloud

    AI infrastructure provider Groq has raised $350 million in a Series A funding round at a $3.5 billion valuation, led by investment firm Disruptive with expected participation from Nvidia subject to customary closing conditions. The financing accelerates the company's structural pivot from developing custom inference silicon toward operating an enterprise-grade inference cloud powered by Nvidia accelerated computing systems. The round follows a $650 million capital raise completed in June 2026 a

    1 min

  • RayNeo Launches iO Smart Glasses with Waveguide Text Display, Omitting Cameras and Speakers

    Augmented reality hardware maker RayNeo has introduced the RayNeo iO Smart Glasses, a 33-gram wearable designed around discreet text projection rather than spatial media playback or computer vision. The device omits outward-facing cameras and integrated acoustic speakers, aiming to bypass privacy bans in enterprise workplaces and reduce social friction. The glasses deploy a monochrome green MicroLED optical waveguide with 97 percent transparency and roughly 1,300 nits of peak brightness across

    1 min

  • Amazon Hikes Hardware Prices Across Echo, Fire TV, Kindle, and Eero Over AI-Driven Memory Costs

    Amazon has quietly increased retail prices across its first-party consumer hardware lines, raising MSRPs on Echo smart speakers, Fire TV streaming devices, Kindle e-readers, and Eero mesh networking systems to offset rising component costs for memory and storage. The price adjustments reflect how the enterprise artificial intelligence infrastructure buildout is impacting consumer electronics supply chains. Surging hyperscaler demand for high-bandwidth memory (HBM3e and HBM4) alongside high-dens

    1 min

  • Chinese NAND Flash Maker YMTC Files for .9B Shanghai STAR Market IPO

    The Shanghai Stock Exchange has accepted the listing application for Yangtze Memory Technologies Corp (YMTC) and parent entity CCSH Corporation, setting up a 33 billion yuan ($4.9 billion) initial public offering on China's science and technology-focused STAR Market. The offering marks the third-largest float in the history of the STAR Market, trailing only foundry Semiconductor Manufacturing International Corporation (SMIC) and DRAM manufacturer ChangXin Memory Technologies (CXMT). Offering

    1 min

  • FlashAttention-3: How Warp Specialization, Asynchronous TMA Tiling, and FP8 Hardware Acceleration Scale Attention on Hopper GPUs

    FlashAttention-3: How Warp Specialization, Asynchronous TMA Tiling, and FP8 Hardware Acceleration Scale Attention on Hopper GPUs The emergence of Transformer architectures scaled deep learning across language, vision, and multimodal domains, but standard exact attention has historically imposed severe compute and memory bandwidth bottlenecks. The standard multi-head self-attention operation computes: $$\text{Attention}(Q, K, V) = \text{softmax}\left(\frac{QK^T}{\sqrt{d}}\right)V$$ For a seque

    1 min

  • Anthropic Hires Former Google TPU Head Amir Salek to Drive Custom Silicon Strategy

    Anthropic has hired veteran semiconductor executive Amir Salek to join its compute infrastructure organization, according to reporting from Bloomberg. Salek, who previously founded and led Google's Custom Silicon team responsible for the Tensor Processing Unit (TPU) program, will help direct Anthropic's hardware strategy as the company explores custom silicon development. The appointment comes as leading frontier artificial intelligence laboratories seek greater control over hardware supply cha

    1 min

  • Apple Cuts 200 Jobs Across Siri and Vision Pro Teams in AI Realignment

    Apple has eliminated approximately 200 roles across its Siri voice assistant organization and the Vision Products Group, according to reporting from Bloomberg and AppleInsider. The personnel reductions reflect an internal reallocation of engineering resources as Apple shifts from legacy voice parsing architectures to foundation model pipelines and redirects hardware focus toward lightweight AI-enabled wearable devices. The workforce reductions impact roughly 100 employees in the Vision Products

    1 min

  • Arithmetic Intensity and the Roofline Model: Why LLM Generation Is Memory-Bound and Prefill Is Compute-Bound

    Arithmetic Intensity and the Roofline Model in Large Language Models: Why Generation Is Memory-Bound and Prefill Is Compute-Bound Every optimization in modern large language model (LLM) serving exists to solve a single hardware reality: running a Transformer model is not one computational problem, but two completely distinct workloads operating on opposite sides of a physical performance barrier. When an LLM processes a prompt during the prefill phase, it saturates modern GPU Tensor Cores, ope

    1 min

  • US Warns 35 Partner Countries to Choose Between Pax Silica and China's WAICO AI Coalition

    The U.S. Department of State is preparing formal diplomatic notices instructing 35 partner nations to select between Washington's AI alliance and Beijing's competing framework. According to a draft cable reviewed by Reuters and reported by The Decoder and CNBC, the U.S. warns that countries joining China's newly established AI initiative will be excluded from the U.S.-led Pax Silica coalition. The diplomatic draft states: "To be part of everything is to be part of nothing. Signature of the Pax

    1 min

  • Confidential LLM Inference in Production: Hardware TEEs, GPU Enclaves, Attestation, and Serving Performance Trade-Offs

    Confidential LLM Inference in Production: Hardware TEEs, GPU Enclaves, Attestation, and Serving Performance Trade-Offs Deploying large language models in multi-tenant cloud environments introduces a fundamental security boundary problem. Standard transport encryption (TLS) secures prompts in transit, and encryption-at-rest protects checkpoints on disk, but model weights, prompt tokens, and key-value (KV) caches exist in plaintext within system memory during active inference. For organizations p

    1 min

  • Nvidia in Early Talks with South Korean AI Chip Designer Rebellions

    Nvidia is in early-stage discussions with South Korean AI semiconductor designer Rebellions regarding possible strategic tie-ups, including technology licensing partnerships, direct equity investments, or a full acquisition. Nvidia Chief Executive Officer Jensen Huang met with Rebellions co-founder and Chief Executive Officer Sunghyun Park at Nvidia headquarters in Santa Clara, California, according to reporting from Bloomberg citing people familiar with the matter. The discussions remain preli

    1 min

  • Brazil Commits 44M to Sovereign AI, Splitting Compute Between Huawei, iFlytek, and US Suppliers

    Brazil has launched a national artificial intelligence infrastructure program totaling 2.3 billion reais ($444.2 million), dividing major compute and development contracts between Chinese and American technology providers to maintain technological sovereignty and avoid vendor lock-in. The initiative, announced by the administration of President Luiz Inacio Lula da Silva, allocates resources through the National Fund for Scientific and Technological Development (FNDCT). The funding structure est

    1 min

  • Federal Judge Partially Overturns Conviction of Ex-Google Engineer Linwei Ding in AI Trade Secrets Case

    A federal judge in San Francisco has overturned the economic espionage convictions of former Google software engineer Linwei Ding, while upholding his conviction on seven counts of stealing proprietary artificial intelligence trade secrets. U.S. District Judge Vince Chhabria ruled on Thursday that federal prosecutors failed to present sufficient evidence demonstrating that Ding intended or knew his actions would benefit the government of China. Under federal statutes, establishing direct or ind

    1 min

  • Broadcom Pursues $60B+ Debt Facility for Anthropic and Hyperscaler AI Chip Financing

    Broadcom is in advanced discussions with a syndicate of institutional lenders and private credit firms to raise more than $60 billion in debt to finance large-scale AI semiconductor infrastructure, according to reporting from Bloomberg. The capital package is structured to underwrite the manufacturing and deployment of custom AI processors, primarily benefiting frontier lab Anthropic alongside other enterprise compute customers. The financing structure highlights the growing role of complex pri

    1 min

  • Nvidia Strikes $6B Licensing Deal with Poolside and Backs Startup at $12B Valuation

    AI model developer Poolside has entered into a non-exclusive $6 billion licensing agreement with Nvidia, paired with a $1 billion direct equity investment that values the startup at $12 billion pre-money, according to an investor communication reported by Newcomer. As part of the transaction structure, Nvidia has extended job offers to 109 Poolside personnel, creating a hybrid licensing and talent transfer arrangement that mirrors recent structural deals across the frontier AI ecosystem. Deal

    1 min

  • Weight Pruning in Large Language Models: How SparseGPT, Wanda, and Semi-Structured 2:4 Sparsity Compress Neural Networks Without Retraining

    Modern large language models require tens to hundreds of gigabytes of high-bandwidth memory to store billions of parameters. While post-training quantization compresses model footprints by reducing numerical precision from 16-bit floating point to 8-bit or 4-bit integers, weight pruning attacks model size along an orthogonal axis: setting redundant parameter values exactly to zero. Historically, pruning deep neural networks required iterative cycles of magnitude thresholding and compute-heavy r

    1 min

  • Waymo Details Custom 5nm ASIC and Heterogeneous Compute Architecture for Robotaxis

    Alphabet subsidiary Waymo has disclosed the architectural specifications of the computing platform powering its sixth-generation autonomous driving system, revealing a custom 5-nanometer application-specific integrated circuit (ASIC) engineered specifically for front-end sensor ingestion and edge machine learning. The disclosure, authored by VP of Engineering Satish Jeyachandran and Compute Lead Daniel Rosenband, details how the company processes raw data from onboard sensor arrays in real time

    1 min

  • Micron Launches Micron Research Labs with $10B Commitment for AI Memory Architecture

    Micron Technology announced on August 20, 2026, the creation of Micron Research Labs, a domestic long-horizon research institution headquartered in Boise, Idaho. Backed by a planned $10 billion investment across the next decade, the entity is designed to conduct precompetitive semiconductor and architecture research positioned upstream of commercial fabrication roadmaps. The funding operates independently from the more than $250 billion in domestic manufacturing and commercial development that

    1 min