LittleNephilim
LittleNephilim's profile header
LittleNephilim

@LittleNephilim@twit.social

June 5, 2023

behold the "HTML bomb"

it's a defensive counterattack on AI web-scrapers that persistently scrape and rescrape your web site, even when you tell them not to

the bomb file looks like a tiny HTML page, but when scraped -- or even requested by a regular browser ...

... it unpacks into a huge-ass 10-gig HTML page ...

... which quickly crashes any browser or scraper

Item #6 in my latest "Linkfest" newsletter, free to read and subscribe to here: buttondown.com/clivethompson/a

Older posts from other instances may not be displayed.
Open in original site

Elk Logo

Welcome to Elk!

Elk is a nimble Mastodon web client. You can login to your Mastodon account and use it to interact with the fediverse.

Expect some bugs and missing features here and there. Elk is Open Source and we're actively improving it as a community project. Join us and let's build it together!

If you'd like to report a bug, help us testing, give feedback, or contribute, reach out to us on GitHub and get involved.

To boost development, you can sponsor the Team through GitHub Sponsors. We hope you enjoy Elk!

TAKAHASHI Shuuji三咲智子 Kevin DengAnthony FuPatakJoaquín SánchezDaniel Roe

The Elk Team