AMD just launched its Instinct MI300X accelerator and MI300A APU to challenge Nvidia’s dominance in large language model training and inference. The company claims the MI300X beats Nvidia’s H100 by 1.4x in Llama 2 inference, with Microsoft and Meta already lining up to deploy the hardware in cloud and data centers.
Apple just quietly dropped MLX and MLX Data, a new machine learning framework tailored specifically for Apple Silicon. Inspired by PyTorch and Jax, it takes advantage of unified memory so CPUs and GPUs can process tasks without moving data, packing enough punch to train and run models like Llama and Stable Diffusion locally. Why it matters: Apple is finally giving developers the tools to turn MacBooks into capable generative AI workstations.
McDonald's just announced a multi-year global partnership with Google Cloud to deploy edge computing and generative AI across thousands of restaurants worldwide. The chain will install Google Distributed Cloud hardware and software locally to power its mobile app and self-service kiosks. Why it matters: running AI right on-site helps keep kitchen and ordering systems fast and resilient without relying purely on remote servers.
Microsoft just released Orca 2, a pair of small language models trained to use tailored reasoning strategies rather than blindly mimicking giant models. By learning when to reason step-by-step or answer directly, it matches or beats models 5 to 10 times larger on complex zero-shot benchmarks.
Samsung just unveiled Gauss, its proprietary generative AI model built to power on-device features across its hardware lineup. Developed by Samsung Research, the tech splits into Language for translation and summaries, Code for programming assistance, and Image for generating and upscaling visuals. Running these features locally on upcoming flagships like the Galaxy S24 gives Samsung a latency and privacy edge over cloud-tethered chatbots.
Elon Musk just confirmed plans to integrate xAI's newly launched Grok assistant into Tesla electric vehicles, running a smaller quantized model natively using local car compute. Musk noted this setup could turn parked Teslas into a massive distributed inference network. Why it matters: Bringing LLMs directly to vehicle hardware cuts latency and cloud dependence, though there is no official launch date yet.
Uber just rolled out Waymo driverless vehicles to passengers in Metro Phoenix. Riders booking UberX or Uber Comfort can now get matched with a fully autonomous Waymo vehicle without needing a separate app. The launch comes right as competitor Cruise suffers a permit suspension, giving Waymo a massive distribution boost.
Lenovo just unveiled its hybrid AI roadmap at TechWorld 2023, spanning public models, private enterprise systems, and personal on-device models. The hardware giant deepened its partnership with Nvidia on optimized servers while deploying compression techniques to shrink foundation models down to PCs. Why it matters: PC makers are betting heavily that enterprise AI will run locally, not just inside massive cloud clusters.
Qualcomm's upcoming Snapdragon 8 Gen 3 has leaked in full, showing a massive bet on on-device generative AI. Leaked internal documents detail an upgraded Hexagon NPU supporting INT4 precision alongside Unreal Engine 5.2 ray tracing. Why it matters: it establishes the silicon foundation for the first true wave of generative AI features on Android phones.
Google is developing an "Organize Tabs" feature for Chrome that automatically reorders open tabs and places them into organized groups. Located near tab search in the top-left corner, it aims to automate the decluttering process for users with too many open tabs.
Stability AI just released an experimental version of Stable LM 3B, a compact 3-billion-parameter language model tailored to run locally on laptops and handhelds. Despite its small footprint, it outperforms prior 3B models and even beats some 7B open-source models on common reasoning benchmarks. The base model is open-sourced under CC-By-SA 4.0 on Hugging Face, with an instruction-tuned variant coming soon.
Google just introduced Chromebook Plus, a new hardware category that bakes system-level AI tools into affordable laptops starting at $399. Built with guaranteed minimum specs, the devices offer OS-level noise reduction and lighting tweaks for any video calling app, alongside Google Photos Magic Eraser. Why it matters: Google is quietly turning budget computers into capable, AI-first machines without inflating prices.
Apple CEO Tim Cook just confirmed that the company is actively researching ChatGPT-style generative AI and plans to increase AI hiring in the UK. Cook pointed out that AI is already quietly powering features like Apple Watch fall detection and iPhone predictive text. While Apple has stayed noticeably restrained during the chatbot boom, Cook's remarks confirm Cupertino is definitely building its countermove.
Invenio Imaging just put deep learning right inside the operating room, using NVIDIA edge AI to analyze fresh biopsies in three minutes instead of waiting weeks for a pathology lab. The system achieved 93% accuracy in 90 seconds for tumor biomarkers, letting surgeons make immediate calls during surgery.
Apple just released macOS Sonoma as a free software update for Mac users worldwide. Beyond interactive desktop widgets and video conferencing overlays, the update brings an on-device Transformer language model to overhaul autocorrect and inline sentence predictions. It basically means speech dictation and typing on Mac get a smart, private machine learning boost directly on silicon.
Google's upcoming Pixel 8 series just appeared in a leaked promo video showcasing big AI photo editing updates. The phones will debut Magic Editor, letting users merge multiple shots so everyone smiles at once, reposition subjects, and swap midday skies for sunsets. Google is also adding DSLR-style manual shutter and ISO controls.
Microsoft just launched four new commercial Surface devices, including the Surface Laptop Studio 2, Laptop Go 3, Go 4, and Surface Hub 3. Beyond major spec upgrades, the lineup leans heavily into enterprise AI with features like smart eye-contact correction, auto-framing cameras, and Copilot integration in Whiteboard.
Microsoft is hosting a special hardware event on September 21, likely unveiling refreshed Surface devices alongside new AI features. The company will not run an official real-time livestream during the morning session, with full video on-demand rolling out later that afternoon.
Microsoft's Surface chief Panos Panay just made a shock departure right before the company's hardware showcase. Consumer marketing lead Yusuf Mehdi and silicon chief Pavan Davuluri are splitting his responsibilities, alongside a new team focused on AI web experiences for Windows. Why it matters: Microsoft is steering its PC and hardware roadmap away from risky hardware bets and fully toward AI integration.
Apple just rolled out the iPhone 15 powered by the A17 Pro chip, intentionally sidestepping the generative AI hype. Instead of buzzy chatbots or AI image editors, Apple baked machine learning into everyday friction points—voice isolation for calls, automatic portrait depth capture, and synthetic voices for speech loss. Why it matters: Apple bets that invisible, reliable utility wins users faster than conversational parlor tricks.
