nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-17 22:07:30 +00:00

250 lines
2.6 KiB
Text

360Spider
404enemy
AIBOT
ALittle Client
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Alligator
Anarchie
AwarioSmartBot
BackStreet
Backlink-Ceck
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
Bigfoot
Bitacle
Black Hole
BlackWidow
Blackboard
Boardreader
Brandprotect
Brandwatch
Buck
Calculon
ChinaClaw
Chlooe
Cloud mapping
Collector
CopyRightCheck
Copyscape
Cosmos
CrazyWebCrawler
Crescent
CrunchBot
DBLBot
DatabaseDriverMysqli
Demon
Deusu
Digincore
Dirbuster
Discoverybot
DomainStatsBot
Dotbot
Download Wonder
ECCP/1.0
EMail Siphon
EasyDL
Ebingbong
EirGrabber
Express WebPictures
Extractor
ExtractorPro
Ezooms
FemtosearchBot
Freeuploader
G-i-g-a-b-o-t
GT::WWW
GermCrawler
GetRight
Gigabot
Go-Ahead-Got-It
Gotit
GrabNet
GrapeshotCrawler
GridBot
HTMLparser
HTTrack
Haansoft
HaosouSpider
Hloader
Humanlinks
IRLbot
Iblog
Image Sucker
IndeedBot
Indy Library
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
Iria
IstellaBot
JOC Web Spider
JamesBOT
JetCar
Keyword Density
Kinza
LNSpiderguy
LWP::Simple
Lanshanbot
LexiBot
LibWeb
Linkbot
LinkextractorPro
LinqiaScrapeBot
MFC_Tear_Sample
MIDown tool
MSFrontPage
MSIECrawler
MTRobot
Masscan
MauiBot
MeanPath Bot
Meanpathbot
MegaIndex.ru
Moblie Safari
Morfeus Fucking Scanner
Msrabot
Musobot
NPbot
Name Intelligence
Needle
NetMechanic
Nettrack
Nibbler
Niki-bot
Nikto
Ninja
Nmap
Octopus
OnCrawl
OpenLinkProfiler
OrangeSpider
PECL::HTTP
PHPCrawl
Page Analyzer
PageAnalyzer
PageGrabber
PageThing.com
Panscient
Papa Foto
PeoplePal
Pi-Monster
Picscout
Pimonster
Psbot
Pump
PxBroker
PyCurl
QueryN Metasearch
RankFlex
RankingBot2
Re-re
RealDownload
Reaper
RebelMouse
Recorder
RedesScrapy
SEOlyticsCrawler
SEOstats
SMTBot
ScanAlert
ScoutJet
Screaming
ScreenerBot
ScrepyBot
SearchmetricsBot
SemanticJuice
Semrush
SeobilityBot
Seomoz
Site Sucker
SiteCheckerBotCrawler
SiteSnagger
SiteSucker
Siteimprove
SlySearch
Sosospider
SpaceBison
SputnikBot
Sqlmap
Sqworm
Sucker
Sucuri
SuperBot
SuperHTTP
Surfbot
T8Abot
Teleport
TeleportPro
Telesphoreo
Telesphorep
Toata
Toweyabot
True_Robot
TwengaBot
Twice
URLy.Warning
Upflow
V-BOT
Vacuum
VelenPublicWebCrawler
WEBDAV
WPScan
WWWOFFLE
Wallpapers/3.0
WallpapersHD
Web Collage
Web Pix
Web Sucker
WebEnhancer
WebGo IS
WebLeacher
WebReaper
WebSucker
WebWhacker
Webalta
WebmasterWorldForumBot
Website Quester
WebsiteQuester
Whatweb
Who.is Bot
Widow
WinHTTrack
YoudaoBot
Zauba
Zermelo
Zeus
ZmEu
ZoomBot
ZoominfoBot
autoemailspider
check1.exe
clark-crawler
crawler.feedback
ips-agent
lwp-request
magpie-crawler
netEstate NE Crawler
plumanalytics
probe-image-size
ripz
s1z.ru
scan.lol
seoscanners
seostar
serpstatbot
sitechecker.pro
siteripz
sogouspider
tAkeOut
ubermetrics-technologies.com
voyagerx.com
webpros.com
x22Mozilla
xpymep1.exe
zauba.io