Skip to content
IFAI

Open source

Google open-sources Agile Deliberation to fix your blurry AI rules

Published Reach 45

Google just open-sourced Agile Deliberation, an AI framework that flips traditional prompt writing. Instead of forcing you to define subjective concepts upfront, the model actively hunts down tricky edge cases to help you pinpoint your own criteria—making content moderation and brand style labeling much cleaner.

Ever tried asking an AI to filter out all the "healthy food" photos on a website, only to tweak your prompt dozens of times because it keeps missing the mark? Truth is, the model is often confused simply because you haven't nailed down your own definition of healthy.

Google just open-sourced Agile Deliberation to flip that messy dynamic on its head.

Hunting down edge cases

Instead of forcing you to write the ultimate prompt upfront, the framework lets the AI actively search for ambiguous edge cases to help you figure out what you actually mean.

The system runs in two key phases. First comes Concept Scoping, which breaks a fuzzy idea into clear inclusions and exclusions to set up an initial baseline.

Next is Concept Iteration. Here, the AI digs up controversial, borderline examples and asks you to make the call. It then refines its internal instructions based on your feedback, repeating the cycle until the classification rules genuinely reflect your intent. It is built specifically for sticky tasks like content moderation and enterprise data labeling, such as spotting misleading ads or enforcing brand style guidelines.

Why it matters

Classification prompts usually hit a wall not because the model lacks intelligence, but because human expectations are inherently slippery.

Agile Deliberation is clever because it replaces abstract prompt engineering with concrete edge-case testing, pulling tacit knowledge right out of your head. For teams wrestling with subjective review guidelines and inconsistent labeling, this could kill off hours of internal debate.

That said, the framework is only as solid as your own answers. If the human reviewer keeps contradicting themselves on tricky examples, the AI won't be able to turn that confusion into clean rules either.

Sources (1)

  1. [1]
    x.com(opens in a new tab)Originalx.com

Best of AI, daily