nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-02 22:07:00 +00:00

250 lines
2.6 KiB
Text

80legs
ADmantX
AIBOT
ALittle Client
Aboundexbot
AfD-Verbotsverfahren
AllSubmitter
Ankit
Anthill
Apexoo
Aspiegel
Atomseobot
BDFetch
BackDoorBot
BackWeb
Backlink-Ceck
Barkrowler
Battleztar Bazinga
Bigfoot
Bitacle
Black Hole
Blow
BlowFish
Bolt
BotALot
Brandwatch
Bullseye
BunnySlippers
BuzzSumo
CODE87
Calculon
CazoodleBot
CensysInspect
CheTeam
CherryPicker
Cliqzbot
CopyRightCheck
Crescent
CrunchBot
Curious
CyotekWebCopy
DBLBot
DIIbot
DSearch
DTS Agent
Demon
Deusu
Dirbuster
Discobot
Discoverybot
DomCopBot
DomainCrawler
DomainSigmaCrawler
Download Wonder
Drip
ECCP/1.0
EasyDL
EroCrawler
ExtLinksBot
ExtractorPro
Ezooms
FemtosearchBot
FlashGet
Flunky
FyberSpider
Fyrebot
GalaxyBot
Getintent
Go!Zilla
Go-Ahead-Got-It
Grabber
Grafula
GrapeFX
GridBot
Haansoft
HaosouSpider
Heritrix
Hloader
HonoluluBot
Humanlinks
IDBot
Id-search
IlseBot
Image Sucker
IndeedBot
InfoNaviRobot
InternetSeer
JOC Web Spider
Jbrofuzz
JetCar
Jyxobot
Keybot Translation-Search-Machine
Keyword Density
Kozmosbot
LWP::Simple
Lanshanbot
Leap
LeechFTP
LieBaoFast
Likse
LinkextractorPro
Lipperhey Spider
Ltx71
MJ12bot
MSFrontPage
MTRobot
Majestic-SEO
MarkWatch
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft URL Control
Mojeek
MolokaiBot
Mozlila
Msrabot
NearSite
NetAnts
NetLyzer
Netvibes
NextGenSearchBot
Nikto
Nmap
Nuclei
Nutch
Offline Navigator
OpenLinkProfiler
OrangeSpider
POE-Component-Client-HTTP
PageGrabber
PageScorer
Pavuk
Pi-Monster
Picscout
Piepmatz
PleaseCrawl
ProWebWalker
Psbot
PxBroker
PyCurl
RSSingBot
RankActiveLinkBot
RankFlex
RankingBot
Re-re
RealDownload
Ripper
RocketCrawler
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
SISTRIX
SMTBot
SalesIntelligent
Scanbot
ScoutJet
Screaming
Seekport
SemrushBot
SentiBot
Seomoz
Shodan
Site Sucker
SiteCheckerBotCrawler
SiteSucker
SmartDownload
Snake
Snapbot
SpaceBison
SpankBot
SputnikBot
Sqlmap
Sqworm
SuperBot
SuperHTTP
Suzuran
Swiftbot
Teleport
Telesoft
Telesphoreo
Titan
Tracemyfile
Trendiction
Turingos
TurnitinBot
TwengaBot
Upflow
V-BOT
VeriCiteCrawler
Virusdie
VoidEYE
WBSearchBot
WISENutbot
WPScan
WWW-Mechanize
WeSEE
Web Fuck
Web Pix
Web Sauger
WebAuto
WebCollage
WebCopier
WebFetch
WebImageCollector
WebPix
WebSauger
WebStripper
WebmasterWorldForumBot
WebsiteExtractor
Whack
Whacker
Whatweb
Wonderbot
Wotbox
YoudaoBot
Zade
Zauba
ZmEu
ZoomBot
ZoominfoBot
adscanner
autoemailspider
cah.io.community
clark-crawler
coccocbot
cognitiveseo
crawler.feedback
instabid
iubenda-radar
linkdexbot
lwp-trivial
meanpathbot
netEstate NE Crawler
pcBrowser
ripz
s1z.ru
satoristudio.net
scan.lol
seocompany.store
serpstatbot
sitechecker.pro
sysscan
trendiction.de
ubermetrics-technologies.com
webmeup-crawler
x09Mozilla
xpymep1.exe
zgrab