Skip to content
IFAI

AI compute

Industry tag545 stories

  1. IndustryReach 42

    OpenAI launches "OpenAI for Countries" to build sovereign AI infrastructure

    OpenAI just launched "OpenAI for Countries," an initiative under its Stargate project aimed at helping nations build sovereign data centers, deploy localized versions of ChatGPT, and seed local startup ecosystems. Partnering closely with the U.S. government, the company aims to roll out 10 country-level projects in its first phase as a democratic counterweight to authoritarian AI.

  2. Open sourceReach 36

    Nvidia drops Parakeet-TDT-v2: Transcribes an hour of audio in one second

    Nvidia just launched Parakeet-TDT-0.6B-v2, an open-source speech recognition model that can transcribe an hour of audio in just one second on GPU hardware. The 600M-parameter model tops the Hugging Face Open ASR leaderboard with a 6.05% word error rate, approaching proprietary rivals. Best of all, it is released under a permissive CC-BY-4.0 commercial license.

  3. IndustryReach 48

    Nvidia cooks up new China-specific AI chips after H20 ban

    Nvidia is designing yet another round of compliant AI processors for China after Washington effectively barred its H20 GPUs, forcing a $5.5B inventory charge. The chipmaker has already briefed Alibaba, Tencent, and ByteDance on its new roadmap. Why it matters: With Huawei ramping up mass shipments of its Ascend 910C to local tech giants, Nvidia is racing against time to prevent its China data center revenue from crashing to zero.

  4. AI modelsReach 47

    Microsoft is prepping to host Elon Musk's Grok on Azure

    Microsoft is reportedly in talks with xAI to host Elon Musk’s Grok AI model on Azure AI Foundry for developers and internal teams. The move reinforces Satya Nadella's push to turn Azure into the go-to home for every major AI model, even if bringing Musk's tech aboard escalates friction with partner OpenAI.

  5. IndustryReach 39

    Anthropic wants tougher US export controls on AI chips

    Anthropic just submitted formal recommendations on the Commerce Department's Diffusion Rule, urging the US to double down on AI chip export controls. The company is pushing to lower the current 1,700 H100 exemption threshold for Tier 2 nations and boost enforcement, arguing any delay will just let overseas rivals stockpile more hardware.

  6. AI modelsReach 45

    Meta's Llama 4 arrives on Google Vertex AI as a managed API

    Google just made Meta’s Llama 4 models generally available as a fully managed API on Vertex AI. Developers can now run Llama 4 Scout and Maverick via standard OpenAI-compatible endpoints without provisioning GPUs or managing infrastructure. Why it matters: it brings Meta's flagship open models straight to enterprise cloud pipelines with zero operational overhead.

  7. IndustryReach 52

    Huawei takes aim at Nvidia's H100 with new Ascend 910D

    Huawei is reportedly developing a new Ascend 910D AI chip designed to rival Nvidia's workhorse H100, and is actively seeking domestic partners for testing. Following fresh U.S. chip export curbs, a viable 910D could plug a critical computing gap in China's AI buildout.

  8. AI toolsReach 33

    NVIDIA launches DOCA Argus to protect AI factories

    NVIDIA just introduced DOCA Argus, a runtime cybersecurity framework running on its BlueField networking platform. Operating entirely outside the host without software agents, it uses memory forensics to spot threats up to 1,000x faster with zero performance overhead. Cisco is also teaming up with NVIDIA to embed it into enterprise setups.

  9. AI modelsReach 56

    DeepSeek R2 leak points to 1.2T params and Huawei chips

    Rumors around DeepSeek's upcoming R2 model just surfaced online, pointing to a massive 1.2T hybrid MoE model with 78B active parameters. The leak claims it achieves 82% hardware utilization on Huawei's Ascend 910B chips while undercutting GPT-4o pricing by over 97%, signaling a potential pivot away from Western AI hardware.

  10. IndustryReach 47

    China calls for AI self-reliance to counter U.S. tech curbs

    China is doubling down on state-backed artificial intelligence to rival the U.S., with President Xi Jinping urging the nation to leverage a "whole national system" to achieve tech self-reliance. The directive focuses on closing gaps in high-end chips and basic software while accelerating safety and regulatory frameworks. It highlights how intensifying tech controls are pushing domestic alternatives into overdrive.

  11. AI modelsReach 54

    Nvidia drops Describe Anything 3B for pinpoint image and video captions

    Nvidia just open-sourced Describe Anything 3B (DAM-3B), a multimodal model engineered for fine-grained, localized captions across images and video. Users can highlight regions using points, bounding boxes, or masks to get context-aware descriptions. It outpaced GPT-4o across multiple regional caption benchmarks.

  12. AI toolsReach 39

    NVIDIA lets RTX owners build custom AI plugins

    NVIDIA just released the G-Assist Plug-In Builder alongside the experimental launch of Project G-Assist inside the NVIDIA app. Powered by a responsive local small language model running directly on RTX GPUs, the tool lets users create Python and JSON-based plugins to control hardware, trigger game guides, and connect external APIs. It gives PC gamers and creators a genuinely customizable, hands-free on-device copilot.

  13. IndustryReach 41

    The Trump administration might ban DeepSeek in the US

    The White House is weighing aggressive new restrictions against China's DeepSeek, potentially blocking its access to Nvidia AI chips and banning Americans from using its services entirely. After the Chinese lab sparked a global price war that shook Silicon Valley, U.S. officials want to curb its momentum amid lingering IP dispute claims from OpenAI.

  14. Open sourceReach 42

    Stable Diffusion gets up to 3.8x faster on AMD chips

    Stability AI just teamed up with AMD to release ONNX-optimized versions of Stable Diffusion 3.5 and SDXL, engineered specifically for Radeon GPUs and Ryzen AI APUs. The new builds run up to 3.8x faster than standard PyTorch models while keeping full image quality intact. It is a major local AI performance win for AMD hardware users, ready to drop into ONNX Runtime workflows or Amuse 3.0.

  15. IndustryReach 41

    Nvidia starts producing Blackwell AI chips in Arizona

    Nvidia just started producing its Blackwell AI GPUs at TSMC’s plant in Phoenix, Arizona, with packaging and testing handled within the state. The company is also teaming up with Foxconn and Wistron to build supercomputer factories in Texas, aiming to ramp up mass production over the next 12 to 15 months.

  16. AI modelsReach 38

    Nvidia's new Nemotron Ultra takes on DeepSeek R1 at half the size

    Nvidia just released Llama-3.1-Nemotron-Ultra-253B-v1, a fully open-source dense model built on Meta's 405B base. By overhauling the architecture to fit on a single 8x H100 node, it edges out the massive 671B DeepSeek R1 on benchmarks like GPQA and LiveCodeBench, though DeepSeek still leads in heavy math.

  17. IndustryReach 44

    IBM launches z17 mainframe to bring AI straight to enterprise data

    IBM just unveiled the IBM z17 mainframe powered by its new Telum II processor, designed to score 100% of enterprise transactions in real-time. It processes over 450 billion inferences a day with 1ms latency—50% more than the z16. Why it matters: Core enterprise workloads like fraud detection and generative AI can now run directly on the mainframe without moving sensitive data off-prem.

  18. AI modelsReach 49

    OpenAI's o3 might cost $30,000 per task

    The Arc Prize Foundation just revised its compute cost estimate for OpenAI's upcoming o3 model, finding that o3 high could cost roughly $30,000 to solve a single ARC-AGI problem—ten times its initial $3,000 guess. The spike reflects intense test-time compute: the model needed 1,024 attempts per task to hit peak accuracy, using 172 times more compute than o3 low. Why it matters: Frontier reasoning gains are real, but brute-forcing complex logic might be economically unfeasible for most early applications.

  19. Open sourceReach 41

    Perplexity makes MoE communication 10x faster

    Perplexity just open-sourced pplx-kernels, a high-performance communication library for Mixture-of-Experts models that runs up to 10x faster than standard All-to-All primitives. It bypasses the CPU via GPU-to-NIC communication and overlaps data transfers with computation across NVLink, CX-7, and EFA networks. Why it matters: running massive MoE architectures across clusters just got substantially faster without sacrificing portability.