nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-11 22:07:10 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404enemy
AIBOT
Abonti
Aboundex
Aboundexbot
AlphaBot
Anarchy99
Anthill
Atomseobot
Attach
AwarioRssBot
AwarioSmartBot
BDFetch
BackDoorBot
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
BatchFTP
BetaBot
BlackWidow
BotALot
Brandwatch
Buddy
CATExplorador
CazoodleBot
CensysInspect
CheTeam
CheeseBot
CherryPicker
Cliqzbot
Cosmos
CrazyWebCrawler
Crescent
Curious
Custo
CyotekWebCopy
DSearch
Devil
Dispatch
DnyzBot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Domains Project
Download Wonder
Dragonfly
EMail Siphon
EasyDL
Ebingbong
Ecxi
EirGrabber
EroCrawler
ExtLinksBot
Extractor
EyeNetIE
FHscan
FemtosearchBot
Fimap
Flunky
Foobot
G-i-g-a-b-o-t
Genieo
GetWeb
Getintent
Gigabot
Go-Ahead-Got-It
GrabNet
Grabber
HEADMasterSEO
HMView
HTTP::Lite
HTTrack
HaosouSpider
Harvest
Havij
Heritrix
IDBTE4M
IDBot
IlseBot
Image Fetch
IndeedBot
Indy Library
InfoNaviRobot
InterGET
Iria
JamesBOT
JikeSpider
Jorgee
Kenjin Spider
Keyword Density
Kinza
Kozmosbot
LeechFTP
Lftp
LibWeb
Lightspeedsystems
LinkScan
Linkbot
Lipperhey
Lmspider
MIDown tool
Mail.RU_Bot
MarkWatch
Mata Hari
Mb2345Browser
Meanpathbot
MicroMessenger
Microsoft Data Access
Moblie Safari
MolokaiBot
Mr.4x3
Name Intelligence
Needle
Nessus
NetLyzer
NetSpider
Netvibes
NextGenSearchBot
Ninja
Octopus
OpenLinkProfiler
OrangeSpider
OutfoxBot
POE-Component-Client-HTTP
PageScorer
Petalbot
Pi-Monster
Picscout
PleaseCrawl
ProPowerBot
Psbot
Pump
Quick-Crawler
RankActive
RankFlex
Rankivabot
ReGet
RebelMouse
Recorder
RedesScrapy
RepoMonkey
RocketCrawler
SBIder
SEOkicks
SEOlyticsCrawler
SEOstats
ScoutJet
Screaming
ScreenerBot
ScrepyBot
SemanticJuice
SeoSiteCheckup
SeobilityBot
Shodan
SiteExplorer
SiteLockSpider
SiteSucker
Sitebeam
Snake
Snoopy
Sogou web spider
Sosospider
Sottopop
SpankBot
Spanner
Spbot
Spinn3r
SputnikBot
Sqlmap
Sqworm
Stripper
Sucker
Sucuri
Surfbot
SurveyBot
Suzuran
T0PHackTeam
Teleport
Telesphorep
Thumbor
TightTwatBot
Titan
Toata
Toweyabot
Tracemyfile
True_Robot
Turnitin
TwengaBot
Typhoeus
UnisterBot
VCI
Voil
Voltron
WASALive-Bot
WPScan
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
WeSEE
Web Pix
WebAuto
WebCollage
WebCopier
WebEnhancer
WebFetch
WebFuck
WebLeacher
WebPix
WebReaper
WebStripper
WebSucker
Webalta
Webshag
Webster
Whacker
Who.is Bot
WinHTTrack
Xaldon WebSpider
Xaldon_WebSpider
Zermelo
Zitebot
archive.org_bot
arquivo.pt
autoemailspider
check1.exe
coccocbot
crawl.sogou.com
demandbase-bot
evc-batch
instabid
lwp-request
mediawords
netEstate NE Crawler
s1z.ru
satoristudio.net
scan.lol
seobility
seocompany.store
sitechecker.pro
sogouspider
sp_auditbot
trendiction.com
webgains-bot
webmeup-crawler
webpros.com
x22Mozilla
xpymep1.exe