Midjourney wants AI to stop writing boring stories

Ask any popular LLM to write a story about a dog on the moon, and you will almost certainly get an astronaut's abandoned pet or a generic space-colony tale. The prose might be clean, but the premise is completely predictable.

Midjourney, the image generation heavyweight with nearly 20 million users on its Discord server alone, is now tackling that exact problem in pure text. Alongside machine learning researchers at New York University, the team dropped a new research paper on Hugging Face detailing how to make open-source language models significantly more creative.

Training models to avoid the safe path

When AI helps with coding or factual questions, there is usually one correct answer to optimize for. Creative writing is the exact opposite: an open-ended prompt should theoretically branch out into wildly different directions.

Modern instruction tuning and preference methods like DPO often reward safe, predictable responses that appeal to average human preferences. Meanwhile, traditional fixes like cranking up generation temperature only happen at inference time and do not change what the model actually learned during training. The result is storytelling that feels repetitive, formulaic, and devoid of surprises.

Rewarding the rare and weird

To fix the creative collapse, the researchers introduced two new post-training techniques: Diversified Direct Preference Optimization (DDPO) and Diversified Odds Ratio Preference Optimization (DORPO).

The core trick lies in measuring deviation. During training, the system compares multiple candidate responses to the same writing prompt. Instead of just picking the safest crowd-pleaser, it calculates how much each response differs from the pack.

When a candidate response takes an unconventional narrative route while maintaining high readability, the training algorithm gives it extra weight. The researchers demonstrated this using stories from Reddit's r/writingPrompts community, fine-tuning Meta's Llama-3.1-8B and Mistral-7B-v0.3 using LoRA.

Why it matters

If you use AI to brainstorm fiction, script ideas, or campaign concepts, you know the frustration of hitting the same narrative tropes over and over. Baking diversity directly into post-training means writers could soon get genuinely novel plot twists and character dynamics rather than homogenized corporate fluff.

For the broader AI ecosystem, this research proves that standard text-based Transformers still have plenty of untapped potential before hitting a wall. But the bigger narrative is Midjourney itself. After signaling plans to build its own hardware in late summer 2024, researching text-based LLM alignment hints that David Holz's team is thinking far beyond diffusion images. Whether Midjourney plans to ship its own native multimodal model or upgrade its internal prompt systems, it is clearly quietly positioning itself to become a full-stack creative intelligence platform.

The catch will be execution in the wild. Pushing for deviation carries a real risk of models mistaking sheer incoherence for originality. Keeping the output readable while dialing up the surprise factor will be the real test for any product team adopting this approach.