Microsoft brings Florence vision model to Azure, powers Reddit alt text

Two years after Microsoft first unveiled Florence as a complete rethinking of computer vision, the foundation model is finally hitting production. Microsoft just rolled out a Florence-powered update to its Vision APIs inside Azure Cognitive Services, opening it up in preview for existing Azure customers.

Unlike traditional vision tools that do just one narrow job like object detection, Florence handles language, images, and video inside a single unified architecture. It was trained on billions of image-text pairs, allowing it to tackle everything from background removal to video summarization.

Cosmic Crisps and 10,000 tags per image

To show off its precision, Azure AI boss John Montgomery noted that Florence can tell the difference between a Cosmic Crisp apple and a Honeycrisp apple, or pinpoint an exact frame inside a long video clip.

Because it deeply connects visuals with text, the model can measure cross-modal similarity, segment specific objects, and paste them cleanly onto new backgrounds.

Reddit is stepping up as one of the first major public adopters. The platform is using Florence to automatically generate alt text for images in threads, helping visually impaired users follow along. Montgomery noted that Florence can generate up to 10,000 tags per image, which Reddit also plans to feed into its search engine to improve post rankings.

Microsoft is also rolling Florence out across its own ecosystem. Teams is tapping it for video segmentation; PowerPoint, Word, and Outlook are using it to auto-generate alt text; while OneDrive and Microsoft Designer are using it for visual search, tagging, and background generation.

Why it matters

We think this release signals a major shift from stitching together brittle, single-purpose computer vision pipelines to deploying unified multimodal foundations. Historically, developers had to run separate models for OCR, image classification, and text generation. Consolidating those workloads into one multimodal API not only cuts down inference complexity and latency, but it also gives the AI much richer context.

For Reddit and other UGC-heavy platforms, turning visual posts into rich semantic tags is a massive win. It instantly unlocks buried visual data for search indexing and recommendations without requiring human moderation.

That said, Microsoft’s vague stance on its training data remains a lingering question mark. Montgomery insisted the billions of training pairs were responsibly sourced and partner-backed, but with copyright battles intensifying across AI, enterprise customers will inevitably want more transparency on where those billions of images actually came from.