Co-founders behind Reface and Prisma join hands to improve on-device model inference with Mirai

Mirai raised a $10 million seed to improve how AI models run on devices like smartphones and laptops.

Taalas Launches Hardcore Chip With ‘Insane’ AI Inference Performance

Taalas has launched an AI accelerator that puts the entire AI model into silicon, delivering 1-2 orders of magnitude greater ...
Rock Paper Shotgun

Discord roll out global age verification system, including an "age inference" model that runs in the background

I hate Discord with the intensity of a supernova falling into a black hole. I hate its ungainly profusion of tabs and ...

Alibaba's Qwen 3.5 397B-A17 beats its larger trillion-parameter model — at a fraction of the cost

These speed gains are substantial. At 256K context lengths, Qwen 3.5 decodes 19 times faster than Qwen3-Max and 7.2 times ...
Business Wire

Vultr Launches Cloud Inference to Simplify Model Deployment and Automatically Scale AI Applications Globally

WEST PALM BEACH, Fla.--(BUSINESS WIRE)--Vultr, the world’s largest privately-held cloud computing platform, today announced the launch of Vultr Cloud Inference. This new serverless platform ...
Network World

Nvidia claims 10x cost savings with open-source inference models

Nvidia noted that cost per token went from 20 cents on the older Hopper platform to 10 cents on Blackwell. Moving to ...
Forbes

The Inference Economy: How Sparse Computing And Model Optimization Are Reshaping Enterprise AI Deployment

The AI industry stands at an inflection point. While the previous era pursued larger models—GPT-3's 175 billion parameters to PaLM's 540 billion—focus has shifted toward efficiency and economic ...

An Inference Tsunami May Be Coming for Google Cloud

Alphabet (NASDAQ:GOOG) stock is officially in correction territory after falling in sympathy with many of its heavy-spending ...