Tech

How a specially designed font is being used to poison AI scrapers

Ars Technica51 min ago
Abstract close-up of text characters displayed on a screen
Abstract close-up of text characters displayed on a screenPhoto: Seraphfim Gallery / Pexels

A newly developed tool called ShieldFont is offering website publishers a novel way to resist having their content scraped and used to train artificial intelligence models, using a specially engineered typeface rather than the server-level blocking methods that have so far dominated the fight against unauthorised AI data collection. The tool works by embedding text in a custom font designed to render normally for human readers while appearing as scrambled, meaningless text to the automated systems that scrape web content.

The core technical trick relies on a gap between how humans and machines actually read text on a webpage. Human readers see rendered glyphs displayed visually in a browser, interpreting the shapes on screen regardless of the underlying code. AI scrapers, by contrast, typically extract the underlying character data directly from a page's source, a process that ShieldFont exploits by mapping the visual glyphs a human sees to different, effectively meaningless underlying character codes.

The result, according to the tool's developers, is a webpage that looks completely normal and readable to a person browsing the site, while any automated system extracting the raw text content instead receives a garbled, nonsensical string that is useless for training a language model, corrupting rather than simply blocking the data collection attempt.

This approach differs meaningfully from the more established methods publishers have used to resist AI scraping, such as robots.txt directives that ask crawlers to stay away, or server-side blocking that identifies and denies requests from known AI crawler user agents. Those methods rely on scrapers voluntarily respecting stated boundaries or on publishers successfully identifying and blocking every crawler attempting access, both of which have proven imperfect as AI companies have sometimes been found scraping content despite explicit opt-out signals.

ShieldFont's approach is instead described by its developers as a poisoning technique — rather than trying to prevent scraping outright, it aims to make scraped data actively harmful to the resulting AI model if used for training, on the theory that corrupted or nonsensical training data degrades model quality in ways that give AI developers a direct incentive to respect publisher wishes, beyond mere compliance obligations.

The emergence of tools like ShieldFont reflects a broader, ongoing tension between AI developers seeking training data at scale and content publishers who argue their work is being used without consent or compensation to build commercial AI products, a conflict that has already produced numerous lawsuits, licensing negotiations and technical countermeasures across the publishing and media industries.

Technical countermeasures like ShieldFont sit within an escalating back-and-forth between scraping tools and anti-scraping defences that resembles, in structure if not specifics, longstanding cat-and-mouse dynamics in web security more broadly, where each new defensive technique tends to prompt scraper developers to adapt their extraction methods in response, rather than settling the underlying conflict permanently.

An important limitation acknowledged even by proponents of font-based obfuscation techniques is that sufficiently motivated scrapers could potentially develop workarounds, such as optical character recognition systems that read rendered text visually rather than extracting underlying character codes, effectively defeating the font-substitution trick by processing the page more like a human would.

For publishers currently frustrated by the limited enforceability of existing opt-out mechanisms, tools like ShieldFont offer a technical option that does not depend on AI companies voluntarily honouring stated preferences, which is likely part of its appeal even among publishers aware that any single technical defence may eventually be circumvented as the broader arms race between content protection and AI data collection continues to evolve.

Whether approaches like ShieldFont see wide adoption is likely to depend on how effectively they hold up against evolving scraper techniques over time, and on whether publishers view the modest implementation effort as worthwhile compared with existing legal and policy-based approaches to the same underlying problem of unauthorised AI training data collection.

This article is an AI-curated summary based on Ars Technica. The illustration is a stock photo by Seraphfim Gallery from Pexels.

Read next