nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-20 22:08:36 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
AIBOT
ASPSeek
Abonti
Acunetix
AhrefsBot
AllSubmitter
Alligator
Anarchy99
Asterias
Attach
BDCbot
BLEXBot
Bitacle
Black Hole
Blackboard
BlowFish
Boardreader
Bolt
Brandprotect
Brandwatch
CATExplorador
CSHttp
CazoodleBot
ChinaClaw
Chlooe
Claritybot
Cliqzbot
Cloud mapping
Cogentbot
Copier
Crawling at Home Project
CrunchBot
CyotekWebCopy
DIIbot
DSearch
DTS Agent
DataCha0s
DigitalPebble
Dirbuster
Discobot
DomCopBot
Dotbot
Download Wonder
Drip
EMail Siphon
Express WebPictures
FDM
Flunky
Foobot
Freeuploader
FrontPage
FyberSpider
Fyrebot
GT::WWW
GalaxyBot
Gigabot
Go!Zilla
Gotit
GrabNet
HEADMasterSEO
HMView
HTMLparser
HybridBot
Image Fetch
IndeedBot
Intelliseek
InternetSeer
Iskanie
IstellaBot
Jbrofuzz
JennyBot
JikeSpider
Jyxobot
Kenjin Spider
Keyword Density
Kozmosbot
LNSpiderguy
LWP::Simple
Lanshanbot
Leap
LeechFTP
LibWeb
Libwhisker
Linkdexbot
LinkextractorPro
LinkpadBot
LinksManager
Lmspider
Ltx71
MFC_Tear_Sample
MIDown tool
MQQBrowser
MSFrontPage
MTRobot
Magnet
MeanPath Bot
Meanpathbot
MicroMessenger
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Musobot
NPbot
Name Intelligence
Nameprotect
NearSite
Needle
Nessus
NetLyzer
NextGenSearchBot
Nibbler
Niki-bot
Nikto
Octopus
Offline Explorer
Offline Navigator
OpenLinkProfiler
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
Panscient
Papa Foto
Petalbot
Pi-Monster
Picscout
Piepmatz
Pimonster
ProWebWalker
Psbot
PxBroker
RankingBot
RankurBot
Re-re
ReGet
RealDownload
Recorder
Ripper
Rogerbot
SBIder
SEOlyticsCrawler
SEOstats
SMTBot
ScanAlert
Screaming
ScrepyBot
Searchestate
Semrush
SeobilityBot
Shodan
Siphon
SiteCheckerBotCrawler
SiteSucker
SmartDownload
Snapbot
Sottopop
SpaceBison
Spammen
Spinn3r
SputnikBot
Sqlmap
Sqworm
Sucuri
Swiftbot
Szukacz
T0PHackTeam
T8Abot
Telesoft
Thumbor
Titan
Tracemyfile
Trendictionbot
True_Robot
Turingos
TurnitinBot
Twice
URLy.Warning
VCI
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
Virusdie
WEBDAV
WWW-Mechanize
Wallpapers
WallpapersHD
Web Fetch
Web Fuck
Web Sucker
WebFetch
WebLeacher
WebPix
WebStripper
WebWhacker
WebZIP
WebmasterWorldForumBot
Webshag
Webster
Who.is Bot
Widow
WinHTTrack
Woobot
Wprecon
Xaldon WebSpider
Xenu
Zauba
Zermelo
Zitebot
ZoomBot
ZoominfoBot
arquivo-web-crawler
autoemailspider
backlink-check
cah.io.community
check1.exe
coccocbot-web
cognitiveseo
crawler4j
dataforseo.com
eCatch
evc-batch
gopher
heritrix
ips-agent
lwp-trivial
netEstate NE Crawler
pcBrowser
plumanalytics
polaris version
probe-image-size
satoristudio.net
scan.lol
seobility
serpstatbot
sitechecker.pro
sogouspider
sp_auditbot
spyfu
sysscan
tAkeOut
ubermetrics-technologies.com
voyagerx.com
webprosbot
x09Mozilla
xpymep1.exe
zauba.io