nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-04-10 10:07:00 +00:00

100 lines
1 KiB
Text

AdsTxtCrawlerTP
AfD-Verbotsverfahren
AwarioRssBot
BackDoorBot
Battleztar Bazinga
Blow
Bullseye
ChatGPT-User
Chlooe
Cloud mapping
Collector
CopyRightCheck
Cosmos
CrazyWebCrawler
Crescent
CrunchBot
DBLBot
Disco
DomainStatsBot
EirGrabber
EroCrawler
Exabot
Fimap
Firefox/7.0
Flunky
Fyrebot
GalaxyBot
GetRight
Gigabot
GrabNet
Grabber
GridBot
Harvest
Image Fetch
InterGET
InternetSeer
JOC Web Spider
LeechGet
Likse
LinksManager
Mag-Net
Majestic-SEO
Mata Hari
MeanPath Bot
MegaIndex.ru
Minefield
Nameprotect
Ninja
Nuclei
Octopus
OutfoxBot
PageGrabber
Pavuk
Petalbot
Pi-Monster
Proximic
Psbot
Quick-Crawler
Re-re
RealDownload
RocketCrawler
SEOstats
Siphon
Sogou web spider
Sottopop
Spinn3r
Sqworm
Sucker
Suzuran
Swiftbot
Teleport
Turnitin
Twice
Typhoeus
Virusdie
Web Collage
Web Fuck
WebSucker
WebWhacker
WebmasterWorldForumBot
Webster
Woobot
Xaldon WebSpider
Xenu
Zeus
ZoominfoBot
arquivo-web-crawler
cohere-ai
crawler.feedback
ips-agent
iubenda-radar
muhstik-scan
openai.com
page scorer
seocompany.store
spyfu
sysscan
trendiction.de
ubermetrics-technologies.com
webmeup-crawler