nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-12-01 22:04:49 +00:00

100 lines
1 KiB
Text

AdsTxtCrawlerTP
AfD-Verbotsverfahren
AllSubmitter
Anarchy
BDCbot
BDFetch
Barkrowler
BetaBot
Bigfoot
Buck
ChinaClaw
Cogentbot
Copyscape
Cosmos
DomCopBot
DomainCrawler
EMail Wolf
Ecxi
EroCrawler
Exabot
ExtractorPro
FemtosearchBot
FlashGet
Fuzz
GetWeb
Grafula
Hloader
HonoluluBot
IDBTE4M
IRLbot
IlseBot
IndeedBot
InternetMeasurement
JetCar
Jetty
Keybot Translation-Search-Machine
LNSpiderguy
Lanshanbot
Magnet
Majestic SEO
Majestic-SEO
MeanPath Bot
Mojolicious
Mr.4x3
Needle
NetLyzer
Netvibes
Niki-bot
Nuclei
OrangeSpider
OutfoxBot
PageGrabber
Panscient
Picscout
Pimonster
ProPowerBot
Pump
PxBroker
PyCurl
QueryN Metasearch
RankActive
ScanAlert
Screaming
Seekport
SiteSucker
Siteimprove
Sitevigil
Sociscraper
SpaceBison
Spammen
Telesoft
TheNomad
Toata
Tracemyfile
Turnitin
URLy.Warning
UnisterBot
VoidEYE
Wallpapers/3.0
Web Fetch
WebImageCollector
WebSucker
Wotbox
ZumBot
ZyBorg
autoemailspider
clark-crawler
com.plumanalytics
crawler.feedback
crawler4j
demandbase-bot
everyfeed-spider
instabid
isitwp.com
oBot
scan.lol
seoscanners
seostar
siteripz
webgains-bot