nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-01-12 22:04:50 +00:00

100 lines
1 KiB
Text

AfD-Verbotsverfahren
Anarchie
BDFetch
Bitacle
Black Hole
BlowFish
Bolt
BuiltBotTough
Bytespider
Cegbfeieh
Cloud mapping
Curious
DataCha0s
Demon
Digincore
Dragonfly
EMail Siphon
EMail Wolf
EirGrabber
Evil
ExtLinksBot
FDM
FHscan
GermCrawler
Getintent
Grafula
GrapeFX
Harvest
InfoNaviRobot
InterGET
JOC Web Spider
Keyword Density
Kozmosbot
LexiBot
Lightspeedsystems
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Mag-Net
Majestic SEO
Majestic-SEO
Masscan
MegaIndex.ru
NICErsPRO
Nessus
Niki-bot
OutclicksBot
PageAnalyzer
PageGrabber
Pandalytics
Papa Foto
Pump
Rankivabot
RankurBot
SEOlyticsCrawler
SISTRIX
ScanAlert
Seekport
SemanticJuice
Semrush
Shodan
SmartDownload
Sogou web spider
Sottopop
Steeler
Swiftbot
Szukacz
Teleport
Telesoft
TinyTestBot
Toata
Tracemyfile
TurnitinBot
URLy.Warning
Upflow
VCI
VidibleScraper
WeSEE
Web Pix
WebGo IS
WebPix
WebReaper
Webalta
WebmasterWorldForumBot
Wonderbot
Xaldon_WebSpider
Xenu
YoudaoBot
adscanner
archive.org_bot
clark-crawler
crawler.feedback
demandbase-bot
instabid
lwp-trivial
mediawords
probe-image-size
s1z.ru
sysscan
webgains-bot