Skip to content
IFAI

AI tools

Artists fight back with Nightshade data-poisoning tool

Published Reach 41

Researchers at the University of Chicago just unveiled Nightshade, a tool that lets artists add invisible pixel tweaks to their work before posting online. If scraped into AI training sets, the poisoned samples corrupt the model into swapping concepts—like turning dogs into cats or handbags into toasters. It aims to force tech giants to respect copyright, with an open-source release planned.

Artists fight back with Nightshade data-poisoning tool
Image: technologyreview.com

Generative AI companies have spent years scraping the open internet for training data without asking. Now, artists are getting a way to strike back.

Researchers at the University of Chicago, led by professor Ben Zhao, have created Nightshade. It is a data poisoning tool that lets creators alter their images with invisible pixel changes before uploading them online. To a human, the art looks completely normal. But to an AI scraper, the image teaches the model that dogs are cats and hats are toasters.

Turning dogs into cats with 300 images

Nightshade targets the fundamental vulnerability of generative AI: models depend on billions of web-scraped images to understand the world. By subtly messing with pixel values, the tool feeds models false associations that are notoriously painful to detect and remove.

In testing against recent versions of Stable Diffusion, researchers found that feeding the model just 50 poisoned dog images made its dog generations look distorted, sporting extra limbs and cartoonish faces. Bump that number to 300 poisoned samples, and asking Stable Diffusion for a dog produced an image of a cat.

Because diffusion models rely on concept associations, the poison spreads laterally. Corrupting the word "dog" also infects "puppy," "husky," and "wolf." Poisoning images tagged as "fantasy art" ended up breaking prompts for "dragon" or fantasy castles as well.

Zhao’s team plans to integrate Nightshade into Glaze, their previous tool designed to shield artists from style mimicry, and will open-source the code so others can build their own variations.

Artists welcome the leverage

For artists, current opt-out systems from companies like Stability AI and OpenAI feel like bureaucratic lip service. Illustrator Eva Toorenent pointed out that opt-out policies force artists to jump through endless hoops while keeping all power with tech platforms.

Artist Autumn Beverly, who previously pulled her art offline after finding it inside the LAION dataset without her consent, said tools like Nightshade give her the confidence to share her work again.

Security researchers outside the project are taking note. Vitaly Shmatikov, an AI security professor at Cornell, warned that robust defenses against this kind of data poisoning do not exist yet. Columbia University professor Junfeng Yang suggested that if Nightshade works as intended, it could finally force AI developers to negotiate licensing deals and pay creators.

Why it matters

For individual artists, Nightshade is the first proactive deterrent with real teeth. Up until now, opting out of AI training meant deleting your portfolio or relying on the goodwill of companies scraping billions of pages. If embedding an invisible defense becomes standard practice for digital artists, posting work online won't feel like an automatic surrender of intellectual property.

For the AI industry, the era of consequence-free web scraping might be closing. When training sets can be poisoned from the inside out, vacuuming up raw data from the open web becomes an existential liability rather than a free lunch. Cleaning corrupted weights from a trained model is brutally difficult, which means companies may finally be forced to pay for verified, licensed datasets.

We think Nightshade is an exceptionally clever asymmetric weapon because it turns a model's semantic reasoning into its own undoing. That said, open-sourcing the poison creates obvious risks: bad actors could weaponize the same technique to sabotage open-source models or critical visual systems. It is an uneasy escalation, but artists finally have something to bargain with.

Sources (1)

  1. [1]
    technologyreview.com(opens in a new tab)Originaltechnologyreview.com

Topic trackerArtists' technical resistance against AI scraping

Every story on this topic, newest first.

  1. How to keep your art out of AI generators
  2. Nightshade lets artists poison AI scrapers
  3. Artists fight back with Nightshade data-poisoning toolThis story
  4. A middle finger to AI scrapers

Best of AI, daily