Social 📸 Photography

IT NewsAI site Perplexity uses “stealth tactics” to flout no-crawl edicts, Cloudflare says - AI search engine Perplexity is using stealth bots and other ... - <a href="https://arstechnica.com/information-technology/2025/08/ai-site-perplexity-uses-stealth-tactics-to-flout-no-crawl-edicts-cloudflare-says/" rel="nofollow noopener" translate="no" target="_blank">https://arstechnica.com/information-technology/2025/08/ai-site-perplexity-uses-stealth-tactics-to-flout-no-crawl-edicts-cloudflare-says/</a> <a href="https://schleuss.online/tags/robots" class="mention hashtag" rel="nofollow noopener" target="_blank">#robots</a>.txt <a href="https://schleuss.online/tags/security" class="mention hashtag" rel="nofollow noopener" target="_blank">#security</a> <a href="https://schleuss.online/tags/scraping" class="mention hashtag" rel="nofollow noopener" target="_blank">#scraping</a> <a href="https://schleuss.online/tags/biz" class="mention hashtag" rel="nofollow noopener" target="_blank">#biz</a>⁢ <a href="https://schleuss.online/tags/ai" class="mention hashtag" rel="nofollow noopener" target="_blank">#ai</a>

Ramin HonaryBookmarking this: <a href="https://billauer.co.il/blog/2025/05/phpbb-attack-bots-ip-addresses/" rel="nofollow noopener" target="_blank">https://billauer.co.il/blog/2025/05/phpbb-attack-bots-ip-addresses/</a> <a class="hashtag" href="https://fe.disroot.org/tag/tech" rel="nofollow noopener" target="_blank">#tech</a> <a class="hashtag" href="https://fe.disroot.org/tag/webadmin" rel="nofollow noopener" target="_blank">#WebAdmin</a> <a class="hashtag" href="https://fe.disroot.org/tag/bots" rel="nofollow noopener" target="_blank">#Bots</a> <a class="hashtag" href="https://fe.disroot.org/tag/scraping" rel="nofollow noopener" target="_blank">#Scraping</a> <a class="hashtag" href="https://fe.disroot.org/tag/scraperbots" rel="nofollow noopener" target="_blank">#ScraperBots</a> <a class="hashtag" href="https://fe.disroot.org/tag/devops" rel="nofollow noopener" target="_blank">#DevOps</a> <a class="hashtag" href="https://fe.disroot.org/tag/security" rel="nofollow noopener" target="_blank">#security</a>

PrivacyDigest<a href="https://mas.to/tags/Browser" class="mention hashtag" rel="nofollow noopener" target="_blank">#Browser</a> <a href="https://mas.to/tags/Extensions" class="mention hashtag" rel="nofollow noopener" target="_blank">#Extensions</a> Turn Nearly 1 Million <a href="https://mas.to/tags/Browsers" class="mention hashtag" rel="nofollow noopener" target="_blank">#Browsers</a> Into Website-Scraping <a href="https://mas.to/tags/Bots" class="mention hashtag" rel="nofollow noopener" target="_blank">#Bots</a> - Slashdot <a href="https://mas.to/tags/scraping" class="mention hashtag" rel="nofollow noopener" target="_blank">#scraping</a> <a href="https://mas.to/tags/hijack" class="mention hashtag" rel="nofollow noopener" target="_blank">#hijack</a><a href="https://tech.slashdot.org/story/25/07/09/2257245/browser-extensions-turn-nearly-1-million-browsers-into-website-scraping-bots?utm_source=rss1.0mainlinkanon&utm_medium=feed" rel="nofollow noopener" translate="no" target="_blank">https://tech.slashdot.org/story/25/07/09/2257245/browser-extensions-turn-nearly-1-million-browsers-into-website-scraping-bots?utm_source=rss1.0mainlinkanon&utm_medium=feed</a>

Frontend DogmaThe Open-Source Software Saving the Internet From AI Bot Scrapers, by <a href="https://mastodon.social/@emanuelmaiberg" class="u-url mention" rel="nofollow noopener" target="_blank">@emanuelmaiberg</a> (<a href="https://mastodon.social/@404mediaco" class="u-url mention" rel="nofollow noopener" target="_blank">@404mediaco</a>):<a href="https://archive.fo/weURd" rel="nofollow noopener" translate="no" target="_blank">https://archive.fo/weURd</a><a href="https://mas.to/tags/ai" class="mention hashtag" rel="nofollow noopener" target="_blank">#ai</a> <a href="https://mas.to/tags/scraping" class="mention hashtag" rel="nofollow noopener" target="_blank">#scraping</a> <a href="https://mas.to/tags/tooling" class="mention hashtag" rel="nofollow noopener" target="_blank">#tooling</a>

🫧 🌸 🫧<a href="https://anubis.techaro.lol/" rel="nofollow noopener" translate="no" target="_blank">https://anubis.techaro.lol/</a><a href="https://socialbc.ca/tags/Scraping" class="mention hashtag" rel="nofollow noopener" target="_blank">#Scraping</a> <a href="https://socialbc.ca/tags/NoBot" class="mention hashtag" rel="nofollow noopener" target="_blank">#NoBot</a>

Jonathan BaileyAn architecture firm has filed a lawsuit against Pinterest over alleged scraping. However, the case is a real blast from the past.<a href="https://www.plagiarismtoday.com/2025/07/09/architect-sues-pinterest-over-scraping/" rel="nofollow noopener" translate="no" target="_blank">https://www.plagiarismtoday.com/2025/07/09/architect-sues-pinterest-over-scraping/</a><a href="https://mastodon.world/tags/Copyright" class="mention hashtag" rel="nofollow noopener" target="_blank">#Copyright</a> <a href="https://mastodon.world/tags/Pinterest" class="mention hashtag" rel="nofollow noopener" target="_blank">#Pinterest</a> <a href="https://mastodon.world/tags/Scraping" class="mention hashtag" rel="nofollow noopener" target="_blank">#Scraping</a>

DocYeet :verified:Ok, time to deploy Anubis in front of Gitea, I'm done with those FAANG oligarchs scraping my repos 24/7 to check if anything changed...F*ck off.But that also means Gitea might get unstable for some time, woopsIf you are curious : <a href="https://git.halis.io" rel="nofollow noopener" translate="no" target="_blank">https://git.halis.io</a>If you see the cute furry, it worked<a href="https://mastodon.halis.io/tags/homelab" class="mention hashtag" rel="nofollow noopener" target="_blank">#homelab</a> <a href="https://mastodon.halis.io/tags/selfhosted" class="mention hashtag" rel="nofollow noopener" target="_blank">#selfhosted</a> <a href="https://mastodon.halis.io/tags/kubernetes" class="mention hashtag" rel="nofollow noopener" target="_blank">#kubernetes</a> <a href="https://mastodon.halis.io/tags/anubis" class="mention hashtag" rel="nofollow noopener" target="_blank">#anubis</a> <a href="https://mastodon.halis.io/tags/nginx" class="mention hashtag" rel="nofollow noopener" target="_blank">#nginx</a> <a href="https://mastodon.halis.io/tags/ingress" class="mention hashtag" rel="nofollow noopener" target="_blank">#ingress</a> <a href="https://mastodon.halis.io/tags/gitea" class="mention hashtag" rel="nofollow noopener" target="_blank">#gitea</a> <a href="https://mastodon.halis.io/tags/ai" class="mention hashtag" rel="nofollow noopener" target="_blank">#ai</a> <a href="https://mastodon.halis.io/tags/scraping" class="mention hashtag" rel="nofollow noopener" target="_blank">#scraping</a> <a href="https://mastodon.halis.io/tags/faang" class="mention hashtag" rel="nofollow noopener" target="_blank">#faang</a>

Kevin Russell<a href="https://front-end.social/@zeldman" class="u-url mention" rel="nofollow noopener" target="_blank">@zeldman</a> Watt is being Dunn about AI scraping images and descriptions?Make RED sure you fill your gravy description meat with AI hostile get em on the beaches words.Images uploaded to mastodon should have AI poison added to them.<a href="https://mstdn.social/tags/Scraping" class="mention hashtag" rel="nofollow noopener" target="_blank">#Scraping</a> <a href="https://mstdn.social/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#AI</a> <a href="https://mstdn.social/tags/ZuckSucks" class="mention hashtag" rel="nofollow noopener" target="_blank">#ZuckSucks</a>

Petra van Cronenburg<a href="https://indieweb.social/@akamran" class="u-url mention" rel="nofollow noopener" target="_blank">@akamran</a> <a href="https://me.dm/@davidtoddmccarty" class="u-url mention" rel="nofollow noopener" target="_blank">@davidtoddmccarty</a> If you search Google for <a href="https://mastodon.online/tags/Mastodon" class="mention hashtag" rel="nofollow noopener" target="_blank">#Mastodon</a> hashtag scraping, you find software and programs that help AI for doing that. It exists.Fact is that from today, the main instances mastodon.social and mastodon.online prohibit <a href="https://mastodon.online/tags/scraping" class="mention hashtag" rel="nofollow noopener" target="_blank">#scraping</a> officially: <a href="https://techcrunch.com/2025/06/17/mastodon-updates-its-terms-to-prohibit-ai-model-training/" rel="nofollow noopener" translate="no" target="_blank">https://techcrunch.com/2025/06/17/mastodon-updates-its-terms-to-prohibit-ai-model-training/</a>Problem of decentralisation: admins/users of other instances must get aware of the problem and change their terms, too.It may be funny but it's no joke.<a href="https://mastodon.online/tags/gravy" class="mention hashtag" rel="nofollow noopener" target="_blank">#gravy</a>

Michael Karbacher<a href="https://ifwo.eu/tags/Hinweis" class="mention hashtag" rel="nofollow noopener" target="_blank">#Hinweis</a> auf <a href="https://ifwo.eu/tags/Nutzbarkeit" class="mention hashtag" rel="nofollow noopener" target="_blank">#Nutzbarkeit</a> von <a href="https://ifwo.eu/tags/Data" class="mention hashtag" rel="nofollow noopener" target="_blank">#Data</a> <a href="https://ifwo.eu/tags/Analytics" class="mention hashtag" rel="nofollow noopener" target="_blank">#Analytics</a> / <a href="https://ifwo.eu/tags/Data" class="mention hashtag" rel="nofollow noopener" target="_blank">#Data</a> <a href="https://ifwo.eu/tags/Science" class="mention hashtag" rel="nofollow noopener" target="_blank">#Science</a> <a href="https://ifwo.eu/tags/Methode" class="mention hashtag" rel="nofollow noopener" target="_blank">#Methode</a>n <a href="https://ifwo.eu/tags/Scraping" class="mention hashtag" rel="nofollow noopener" target="_blank">#Scraping</a>, <a href="https://ifwo.eu/tags/Pattern" class="mention hashtag" rel="nofollow noopener" target="_blank">#Pattern</a> <a href="https://ifwo.eu/tags/Recognition" class="mention hashtag" rel="nofollow noopener" target="_blank">#Recognition</a>, <a href="https://ifwo.eu/tags/Machine" class="mention hashtag" rel="nofollow noopener" target="_blank">#Machine</a> <a href="https://ifwo.eu/tags/Learning" class="mention hashtag" rel="nofollow noopener" target="_blank">#Learning</a> oder <a href="https://ifwo.eu/tags/Text" class="mention hashtag" rel="nofollow noopener" target="_blank">#Text</a> <a href="https://ifwo.eu/tags/Mining" class="mention hashtag" rel="nofollow noopener" target="_blank">#Mining</a> für <a href="https://ifwo.eu/tags/soziologisch" class="mention hashtag" rel="nofollow noopener" target="_blank">#soziologisch</a>e <a href="https://ifwo.eu/tags/Forschung" class="mention hashtag" rel="nofollow noopener" target="_blank">#Forschung</a>. <a href="https://ifwo.eu/tags/Sutter" class="mention hashtag" rel="nofollow noopener" target="_blank">#Sutter</a> / <a href="https://ifwo.eu/tags/Maasen" class="mention hashtag" rel="nofollow noopener" target="_blank">#Maasen</a> - <a href="https://ifwo.eu/tags/Neuerfindung" class="mention hashtag" rel="nofollow noopener" target="_blank">#Neuerfindung</a> <a href="https://ifwo.eu/tags/Soziologie" class="mention hashtag" rel="nofollow noopener" target="_blank">#Soziologie</a> S.76 f. 2020 DOI: 10.5771/9783845295008-73<a href="https://ifwo.eu/tags/MachineLearning" class="mention hashtag" rel="nofollow noopener" target="_blank">#MachineLearning</a> <a href="https://ifwo.eu/tags/ML" class="mention hashtag" rel="nofollow noopener" target="_blank">#ML</a> <a href="https://ifwo.eu/tags/TextMining" class="mention hashtag" rel="nofollow noopener" target="_blank">#TextMining</a> <a href="https://ifwo.eu/tags/Soziologie" class="mention hashtag" rel="nofollow noopener" target="_blank">#Soziologie</a> <a href="https://ifwo.eu/tags/BigData" class="mention hashtag" rel="nofollow noopener" target="_blank">#BigData</a> <a href="https://ifwo.eu/tags/Methodologie" class="mention hashtag" rel="nofollow noopener" target="_blank">#Methodologie</a> <a href="https://ifwo.eu/tags/Methodik" class="mention hashtag" rel="nofollow noopener" target="_blank">#Methodik</a> <a href="https://ifwo.eu/tags/Sozialforschung" class="mention hashtag" rel="nofollow noopener" target="_blank">#Sozialforschung</a> <a href="https://ifwo.eu/tags/Sozialwissenschaft" class="mention hashtag" rel="nofollow noopener" target="_blank">#Sozialwissenschaft</a>

Frontend Dogma5 Best JavaScript Web Scraping Libraries in 2025, by @apify.bsky.social:<a href="https://blog.apify.com/best-javascript-web-scraping-libraries/" rel="nofollow noopener" translate="no" target="_blank">https://blog.apify.com/best-javascript-web-scraping-libraries/</a><a href="https://mas.to/tags/javascript" class="mention hashtag" rel="nofollow noopener" target="_blank">#javascript</a> <a href="https://mas.to/tags/libraries" class="mention hashtag" rel="nofollow noopener" target="_blank">#libraries</a> <a href="https://mas.to/tags/scraping" class="mention hashtag" rel="nofollow noopener" target="_blank">#scraping</a> <a href="https://mas.to/tags/linklists" class="mention hashtag" rel="nofollow noopener" target="_blank">#linklists</a>

Kevin Karhan :verified:<a href="https://mastodon.social/@anirvan" class="u-url mention" rel="nofollow noopener" target="_blank">@anirvan</a> <a href="https://mastodon.social/@404mediaco" class="u-url mention" rel="nofollow noopener" target="_blank">@404mediaco</a> the only way to deal with this is the same as with any other <a href="https://infosec.space/tags/malware" class="mention hashtag" rel="nofollow noopener" target="_blank">#malware</a> and <a href="https://infosec.space/tags/DDoS" class="mention hashtag" rel="nofollow noopener" target="_blank">#DDoS</a>:<ul><li>Block the entire <a href="https://infosec.space/tags/ASN" class="mention hashtag" rel="nofollow noopener" target="_blank">#ASN</a>|s of every single hoster that allows "<a href="https://infosec.space/tags/scraping" class="mention hashtag" rel="nofollow noopener" target="_blank">#scraping</a>"!</li></ul>I do maintain a <a href="https://infosec.space/tags/blocklist" class="mention hashtag" rel="nofollow noopener" target="_blank">#blocklist</a> of those and will happily accept suggestions and pull requests...<a href="https://github.com/greyhat-academy/lists.d/blob/main/scrapers.ipv4.block.list.tsv" rel="nofollow noopener" translate="no" target="_blank">https://github.com/greyhat-academy/lists.d/blob/main/scrapers.ipv4.block.list.tsv</a>

Frontend DogmaA Thought on JavaScript “Proof of Work” Anti-Scraper Systems, by <a href="https://mastodon.social/@cks" class="u-url mention" rel="nofollow noopener" target="_blank">@cks</a>:<a href="https://utcc.utoronto.ca/~cks/space/blog/web/JavaScriptScraperObstacles" rel="nofollow noopener" translate="no" target="_blank">https://utcc.utoronto.ca/~cks/space/blog/web/JavaScriptScraperObstacles</a><a href="https://mas.to/tags/javascript" class="mention hashtag" rel="nofollow noopener" target="_blank">#javascript</a> <a href="https://mas.to/tags/ai" class="mention hashtag" rel="nofollow noopener" target="_blank">#ai</a> <a href="https://mas.to/tags/scraping" class="mention hashtag" rel="nofollow noopener" target="_blank">#scraping</a>

René VoorburgVici.org is experiencing large-scale distributed scraping, with bots fraudulently posing as regular users. Presumably harvested data is being used for AI training. <a href="https://archaeo.social/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#AI</a> <a href="https://archaeo.social/tags/scraping" class="mention hashtag" rel="nofollow noopener" target="_blank">#scraping</a> <a href="https://archaeo.social/tags/ethics" class="mention hashtag" rel="nofollow noopener" target="_blank">#ethics</a>

@reiver ⊼ (Charles) :batman:3/For more on scraping (as in web-scraping) see here: <a href="https://mastodon.social/@reiver/114353728684249608" rel="nofollow noopener" translate="no" target="_blank">https://mastodon.social/@reiver/114353728684249608</a>CC: <a href="https://mastodon.social/@404mediaco" class="u-url mention" rel="nofollow noopener" target="_blank">@404mediaco</a> <a href="https://mastodon.social/tags/Scraper" class="mention hashtag" rel="nofollow noopener" target="_blank">#Scraper</a> <a href="https://mastodon.social/tags/Scraping" class="mention hashtag" rel="nofollow noopener" target="_blank">#Scraping</a> <a href="https://mastodon.social/tags/WebScraper" class="mention hashtag" rel="nofollow noopener" target="_blank">#WebScraper</a> <a href="https://mastodon.social/tags/WebScraping" class="mention hashtag" rel="nofollow noopener" target="_blank">#WebScraping</a>

@reiver ⊼ (Charles) :batman:2/Scraping (as in Web Scraping) is the act of extracting data from HTML web-pages where the data is NOT machine-legible.If the data, even in an HTML web-page, is in a machine-legible format, then it is NOT scraping....And, getting data in JSON (key-value pairs) is definitely NOT scraping — as JSON's purpose is to communicate data in a machine-legible manner.CC: <a href="https://mastodon.social/@404mediaco" class="u-url mention" rel="nofollow noopener" target="_blank">@404mediaco</a> <a href="https://mastodon.social/tags/Scraper" class="mention hashtag" rel="nofollow noopener" target="_blank">#Scraper</a> <a href="https://mastodon.social/tags/Scraping" class="mention hashtag" rel="nofollow noopener" target="_blank">#Scraping</a> <a href="https://mastodon.social/tags/WebScraper" class="mention hashtag" rel="nofollow noopener" target="_blank">#WebScraper</a> <a href="https://mastodon.social/tags/WebScraping" class="mention hashtag" rel="nofollow noopener" target="_blank">#WebScraping</a>

@reiver ⊼ (Charles) :batman:1/If these researchers used a typical HTTP-based API that returns JSON, then —What these researchers did is NOT scraping.CC: <a href="https://mastodon.social/@404mediaco" class="u-url mention" rel="nofollow noopener" target="_blank">@404mediaco</a>RE: <a href="https://www.404media.co/researchers-scrape-2-billion-discord-messages-and-publish-them-online/" rel="nofollow noopener" translate="no" target="_blank">https://www.404media.co/researchers-scrape-2-billion-discord-messages-and-publish-them-online/</a><a href="https://mastodon.social/tags/Scraper" class="mention hashtag" rel="nofollow noopener" target="_blank">#Scraper</a> <a href="https://mastodon.social/tags/Scraping" class="mention hashtag" rel="nofollow noopener" target="_blank">#Scraping</a> <a href="https://mastodon.social/tags/WebScraper" class="mention hashtag" rel="nofollow noopener" target="_blank">#WebScraper</a> <a href="https://mastodon.social/tags/WebScraping" class="mention hashtag" rel="nofollow noopener" target="_blank">#WebScraping</a>

Kevin Karhan :verified:<a href="https://chaos.social/@fx" class="u-url mention" rel="nofollow noopener" target="_blank">@fx</a> <a href="https://chaos.social/@julialuna" class="u-url mention" rel="nofollow noopener" target="_blank">@julialuna</a> I think that this makes <a href="https://infosec.space/tags/Anubis" class="mention hashtag" rel="nofollow noopener" target="_blank">#Anubis</a> really <a href="https://infosec.space/tags/ableist" class="mention hashtag" rel="nofollow noopener" target="_blank">#ableist</a> and bad for <a href="https://infosec.space/tags/blind" class="mention hashtag" rel="nofollow noopener" target="_blank">#blind</a> people cuz <a href="https://infosec.space/tags/JavaScript" class="mention hashtag" rel="nofollow noopener" target="_blank">#JavaScript</a> won't work on <a href="https://infosec.space/tags/LynxBrowser" class="mention hashtag" rel="nofollow noopener" target="_blank">#LynxBrowser</a>.<ul><li>The better option would be to literally <a href="https://infosec.space/tags/block" class="mention hashtag" rel="nofollow noopener" target="_blank">#block</a> all the <a href="https://infosec.space/tags/GAFAMs" class="mention hashtag" rel="nofollow noopener" target="_blank">#GAFAMs</a> and their <a href="https://infosec.space/tags/ASN" class="mention hashtag" rel="nofollow noopener" target="_blank">#ASN</a>|s as well as any hoster allowing <a href="https://infosec.space/tags/bots" class="mention hashtag" rel="nofollow noopener" target="_blank">#bots</a> and <a href="https://infosec.space/tags/scrapers" class="mention hashtag" rel="nofollow noopener" target="_blank">#scrapers</a>.</li></ul>Given how <a href="https://infosec.space/tags/IRC" class="mention hashtag" rel="nofollow noopener" target="_blank">#IRC</a>, <a href="https://infosec.space/tags/Tor" class="mention hashtag" rel="nofollow noopener" target="_blank">#Tor</a> and <a href="https://infosec.space/tags/Mining" class="mention hashtag" rel="nofollow noopener" target="_blank">#Mining</a> is a big no-no on most hosters, it stands to reason that it's trivial to force them to ban "<a href="https://infosec.space/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#AI</a>" and related <a href="https://infosec.space/tags/scraping" class="mention hashtag" rel="nofollow noopener" target="_blank">#scraping</a> workloads as well!<ul><li>There are better alternatives, espechally on <a href="https://infosec.space/tags/OnionServices" class="mention hashtag" rel="nofollow noopener" target="_blank">#OnionServices</a>, to prevent and stall <a href="https://infosec.space/tags/DDoS" class="mention hashtag" rel="nofollow noopener" target="_blank">#DDoS</a>|ing like several <a href="https://infosec.space/tags/OnionServices" class="mention hashtag" rel="nofollow noopener" target="_blank">#OnionServices</a> deployed presently...</li></ul>

Jan VlugCool dat er in de overheidsbrede handreiking voor verantwoorde inzet van generatieve AI onder andere dit staat:"Bij voorkeur wordt een <a href="https://mastodon.social/tags/opensource" class="mention hashtag" rel="nofollow noopener" target="_blank">#opensource</a>-applicatie of -model gebruikt. Deze modellen bieden meer inzicht, bijvoorbeeld op het gebied van transparantie."Verder wordt ingegaan op <a href="https://mastodon.social/tags/proprietary" class="mention hashtag" rel="nofollow noopener" target="_blank">#proprietary</a> modellen, voorkomen van <a href="https://mastodon.social/tags/vendorlockin" class="mention hashtag" rel="nofollow noopener" target="_blank">#vendorlockin</a>, <a href="https://mastodon.social/tags/privacy" class="mention hashtag" rel="nofollow noopener" target="_blank">#privacy</a> en <a href="https://mastodon.social/tags/scraping" class="mention hashtag" rel="nofollow noopener" target="_blank">#scraping</a>, <a href="https://mastodon.social/tags/herbruikbaarheid" class="mention hashtag" rel="nofollow noopener" target="_blank">#herbruikbaarheid</a>, <a href="https://mastodon.social/tags/bias" class="mention hashtag" rel="nofollow noopener" target="_blank">#bias</a>, <a href="https://mastodon.social/tags/discriminatie" class="mention hashtag" rel="nofollow noopener" target="_blank">#discriminatie</a> en <a href="https://mastodon.social/tags/transparantie" class="mention hashtag" rel="nofollow noopener" target="_blank">#transparantie</a>.Lees de hele handreiking hier:<a href="https://www.rijksoverheid.nl/binaries/rijksoverheid/documenten/publicaties/2025/04/22/overheidsbrede-handreiking-generatieve-ai/Overheidsbrede+handreiking+Generatieve+AI.pdf" rel="nofollow noopener" translate="no" target="_blank">https://www.rijksoverheid.nl/binaries/rijksoverheid/documenten/publicaties/2025/04/22/overheidsbrede-handreiking-generatieve-ai/Overheidsbrede+handreiking+Generatieve+AI.pdf</a><a href="https://mastodon.social/tags/overheid" class="mention hashtag" rel="nofollow noopener" target="_blank">#overheid</a> <a href="https://mastodon.social/tags/AI" class="mention hashtag" rel="nofollow noopener" target="_blank">#AI</a>

Frontend DogmaMeet LLMs.txt, a Proposed Standard for AI Website Content Crawling, by @searchengineland.bsky.social:<a href="https://searchengineland.com/llms-txt-proposed-standard-453676" rel="nofollow noopener" translate="no" target="_blank">https://searchengineland.com/llms-txt-proposed-standard-453676</a><a href="https://mas.to/tags/ai" class="mention hashtag" rel="nofollow noopener" target="_blank">#ai</a> <a href="https://mas.to/tags/crawling" class="mention hashtag" rel="nofollow noopener" target="_blank">#crawling</a> <a href="https://mas.to/tags/scraping" class="mention hashtag" rel="nofollow noopener" target="_blank">#scraping</a> <a href="https://mas.to/tags/robotstxt" class="mention hashtag" rel="nofollow noopener" target="_blank">#robotstxt</a>

Recent searches

Search options

Administered by:

Server stats:

#scraping