nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-13 22:07:15 +00:00

250 lines
2.6 KiB
Text

80legs
ADmantX
AIBOT
ALittle Client
ASPSeek
Abonti
Aboundex
Acunetix
AiHitBot
Alexibot
Alligator
Anarchie
Anthill
BDCbot
BDFetch
BLEXBot
BackWeb
Backlink-Ceck
Badass
Bitacle
Blackboard
Boardreader
Bolt
BotALot
Brandprotect
CATExplorador
CCBot
CODE87
CSHttp
CazoodleBot
CensysInspect
CherryPicker
ChinaClaw
Chlooe
CopyRightCheck
Copyscape
Crawling at Home Project
CyotekWebCopy
DIIbot
Deusu
Devil
Dirbuster
DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainSigmaCrawler
DomainStatsBot
Domains Project
Dotbot
Download Wonder
Dragonfly
EMail Siphon
EMail Wolf
EasyDL
Ebingbong
Ecxi
EirGrabber
Express WebPictures
ExtractorPro
FDM
FemtosearchBot
Fimap
FlashGet
Foobot
Fuzz
FyberSpider
Fyrebot
Getintent
Go!Zilla
GrapeshotCrawler
HTMLparser
HTTrack
HaosouSpider
Humanlinks
HybridBot
Id-search
IndeedBot
Indy Library
Intelliseek
Internet Ninja
JOC Web Spider
JamesBOT
Jbrofuzz
JetCar
Joomla
Jorgee
Kenjin Spider
Kinza
Lanshanbot
LeechFTP
LexiBot
Lftp
LieBaoFast
Likse
LinkWalker
Linkbot
Ltx71
MFC_Tear_Sample
MJ12bot
MQQBrowser
MSFrontPage
Mag-Net
Magnet
Majestic SEO
Masscan
MauiBot
Microsoft Data Access
Mojeek
Mojolicious
NICErsPRO
NPbot
Navroad
NearSite
NetLyzer
NetMechanic
Niki-bot
Nikto
Nimbostratus
Nutch
Offline Navigator
OnCrawl
OpenVAS
PHPCrawl
Page Analyzer
PageAnalyzer
PageGrabber
PageScorer
PageThing.com
Pavuk
PeoplePal
Pi-Monster
Picscout
Pimonster
PleaseCrawl
Pockey
ProWebWalker
Probethenet
Pu_iN
PxBroker
PyCurl
RankFlex
Rankivabot
RealDownload
Reaper
RebelMouse
Recorder
RepoMonkey
Rogerbot
SEOkicks
SEOkicks-Robot
ScanAlert
ScoutJet
Screaming
ScrepyBot
Searchestate
SemanticJuice
Shodan
Siphon
SiteCheckerBotCrawler
SiteSnagger
Sociscraper
Sosospider
SpaceBison
SpankBot
Spinn3r
SputnikBot
Sqworm
Steeler
Stripper
SuperBot
SurveyBot
Suzuran
Swiftbot
Szukacz
Telesoft
The Intraformant
TheNomad
Titan
Toata
Toweyabot
Tracemyfile
Trendiction
True_Robot
Turnitin
Typhoeus
URLy Warning
Upflow
VCI
VeriCiteCrawler
VidibleScraper
Voltron
WBSearchBot
WWW-Collector-E
WWW-Mechanize
WallpapersHD
WebAuto
WebCollage
WebCopier
WebFetch
WebLeacher
WebPix
WebSauger
WebStripper
WebSucker
Webalta
Webshag
Whack
Who.is Bot
WinHTTrack
WiseGuys Robot
Wonderbot
Woobot
Wotbox
Wprecon
Xaldon WebSpider
Xaldon_WebSpider
YoudaoBot
Zermelo
ZmEu
ZumBot
arquivo-web-crawler
autoemailspider
backlink-check
check1.exe
coccocbot
cognitiveseo
crawler.feedback
dataforseo.com
demandbase-bot
domainsproject.org
eCatch
internetVista monitor
isitwp.com
linkdexbot
lwp-trivial
magpie-crawler
mediawords
pcBrowser
plumanalytics
scalaj-http
scan.lol
seobility
sexsearcher
sitechecker.pro
sysscan
tAkeOut
ubermetrics-technologies.com
voyagerx.com
webpros.com
zauba.io