nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-08-16 10:08:57 +00:00

250 lines
2.6 KiB
Text

01h4x.com
80legs
ALittle Client
Acunetix
AiHitBot
Alexibot
AllSubmitter
AlphaBot
Anarchie
Anarchy
Ankit
Anthill
Apexoo
AwarioRssBot
AwarioSmartBot
BBBike
BDCbot
BLEXBot
BackDoorBot
Barkrowler
Battleztar Bazinga
Bigfoot
Blackboard
Blow
Boardreader
Brandprotect
Brandwatch
Buck
Buddy
BuiltBotTough
BuiltWith
Bullseye
CATExplorador
CazoodleBot
CensysInspect
CheeseBot
Chlooe
Cloud mapping
Cocolyzebot
Collector
Copier
Cosmos
Craftbot
Crawling at Home Project
CrazyWebCrawler
Custo
DBLBot
DSearch
DTS Agent
DataCha0s
Demon
DigitalPebble
Disco
Discobot
DnyzBot
DomainAppender
DomainCrawler
Evil
Extractor
Extreme Picture Finder
EyeNetIE
Ezooms
FemtosearchBot
FlashGet
Foobot
FrontPage
GT::WWW
GermCrawler
Gigablast
Gigabot
Go!Zilla
GrabNet
Grafula
GrapeshotCrawler
GridBot
HEADMasterSEO
HTTrack
Heritrix
Hloader
IDBot
IRLbot
Id-search
IlseBot
Image Fetch
Image Sucker
InfoNaviRobot
Internet Ninja
Iria
Iskanie
JamesBOT
Jbrofuzz
JetCar
Jetty
Joomla
JustView
Kenjin Spider
Keyword Density
Kozmosbot
LNSpiderguy
Leap
LexiBot
LinkScan
Linkdexbot
LinkpadBot
LinqiaMetadataDownloaderBot
Lipperhey
Litemage_walker
Lmspider
Ltx71
MQQBrowser
MSIECrawler
Mag-Net
Magnet
Majestic12
MarkWatch
Mass Downloader
Microsoft Data Access
Moblie Safari
Morfeus Fucking Scanner
Musobot
NICErsPRO
Nessus
Net Vampire
NetAnts
NetLyzer
NetMechanic
NetSpider
Nikto
Nimbostratus
Offline Explorer
Offline Navigator
OnCrawl
OrangeBot
OutclicksBot
OutfoxBot
Page Analyzer
PageAnalyzer
PleaseCrawl
ProWebWalker
PyCurl
Quick-Crawler
RSSingBot
RankActiveLinkBot
RebelMouse
RepoMonkey
Ripper
RocketCrawler
SEOkicks
SEOkicks-Robot
SEOprofiler
SEOstats
SISTRIX
SMTBot
SalesIntelligent
Scanbot
SearchmetricsBot
SemrushBot
SeobilityBot
Site Sucker
SiteLockSpider
SlySearch
Snake
Sogou web spider
SpaceBison
Spammen
Spbot
Spinn3r
Sqlmap
Sqlworm
Sqworm
Stripper
Sucuri
SuperBot
SuperHTTP
SurveyBot
Szukacz
T8Abot
TeleportPro
Telesoft
Telesphorep
Tracemyfile
Turnitin
Typhoeus
URLy.Warning
UnisterBot
V-BOT
VB Project
VeriCiteCrawler
VoidEYE
Voil
WBSearchBot
WISENutbot
WPScan
Wallpapers/3.0
Web Auto
Web Fuck
Web Pix
Web Sauger
Web Sucker
WebAuto
WebBandit
WebCollage
WebGo IS
WebReaper
WebSucker
WebWhacker
Webshag
Whatweb
Who.is Bot
WinHTTrack
WiseGuys Robot
Wonderbot
Woobot
Wprecon
Xenu
Zauba
Zermelo
Zeus
ZoominfoBot
archive.org_bot
clark-crawler
coccocbot-web
cognitiveseo
com.plumanalytics
demandbase-bot
gopher
heritrix
lwp-request
lwp-trivial
magpie-crawler
meanpathbot
muhstik-scan
netEstate NE Crawler
page scorer
plumanalytics
ripz
satoristudio.net
scalaj-http
seoscanners
serpstatbot
sogouspider
spyfu
tAkeOut
ubermetrics-technologies.com
webmeup-crawler
webpros.com
x09Mozilla
x22Mozilla
zauba.io
zgrab