nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-07-29 22:04:50 +00:00

100 lines
1.1 KiB
Text

80legs
ADmantX
Aspiegel
Asterias
BLEXBot
BackWeb
BetaBot
Boardreader
Brandprotect
Buck
Bytespider
Copyscape
Crawling at Home Project
Disco
Discoverybot
DittoSpyder
DomCopBot
Dragonfly
ECCP/1.0
EirGrabber
Extreme Picture Finder
FacebookBot
FemtosearchBot
Flunky
Freeuploader
Fuzz
G-i-g-a-b-o-t
Getintent
Google-Extended
IDBTE4M
InfraSec Scanner
Iria
JOC Web Spider
Jbrofuzz
JikeSpider
Jyxobot
Kenjin Spider
Likse
LinkextractorPro
Litemage_walker
MIDown tool
Mag-Net
MarkMonitor
MarkWatch
Masscan
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Mister PiX
Mojeek
Name Intelligence
Nameprotect
Nikto
PHPCrawl
Pandalytics
PictureFinder
PyCurl
RankingBot
RankingBot2
Reaper
SMTBot
ScanAlert
Scrapy
SemanticJuice
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
Siteimprove
SlySearch
Spanner
Stripper
Sucker
SuperHTTP
Teleport
Telesoft
TinyTestBot
Trendiction
URLy.Warning
WWW-Collector-E
WWWOFFLE
Wallpapers/3.0
WallpapersHD
Web Collage
Web Sucker
WebGo IS
WebSauger
Webalta
Whacker
Zeus
cah.io.community
crawler4j
facebookscraper
iubenda-radar
netEstate NE Crawler
polaris version
probe-image-size
serpstatbot
siteripz
x09Mozilla
zauba.io