nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-29 22:07:04 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
80legs
ADmantX
Aboundex
Acunetix
AiHitBot
Alexibot
AlphaBot
Anarchie
Anarchy99
Asterias
Attach
AwarioRssBot
BDCbot
BackStreet
Backlink-Ceck
BacklinkCrawler
Bandit
Bolt
Brandprotect
Buck
BuiltWith
BunnySlippers
BuzzSumo
CSHttp
Calculon
CazoodleBot
CheeseBot
CherryPicker
ChinaClaw
Chlooe
Claritybot
Copier
CopyRightCheck
Craftbot
Crawling at Home Project
CrunchBot
Curious
DSearch
Demon
Dirbuster
Discoverybot
Domains Project
Download Wonder
ECCP/1.0
EMail Wolf
Ebingbong
Ecxi
Evil
Exabot
ExtractorPro
Ezooms
FHscan
Fimap
Freeuploader
FrontPage
Fyrebot
Getintent
Gigabot
GrabNet
Grafula
GridBot
HEADMasterSEO
HMView
HTMLparser
Haansoft
HaosouSpider
Harvest
Humanlinks
HybridBot
IDBot
IlseBot
Image Sucker
InfoNaviRobot
InfoTekies
Intelliseek
InternetSeer
Iskanie
IstellaBot
JikeSpider
Jorgee
Kenjin Spider
Keyword Density
Kinza
Lanshanbot
Lftp
LibWeb
Libwhisker
LieBaoFast
Likse
LinkScan
LinkWalker
Linkdexbot
LinkpadBot
Lmspider
MIIxpc
MSFrontPage
MTRobot
Magnet
Mass Downloader
Mata Hari
Mb2345Browser
MeanPath Bot
Meanpathbot
Mediatoolkitbot
Metauri
Minefield
Mister PiX
Moblie Safari
Mojolicious
Mozlila
NICErsPRO
Name Intelligence
Nameprotect
NearSite
Net Vampire
NetAnts
NetMechanic
Nettrack
Netvibes
NextGenSearchBot
Nikto
Nimbostratus
Not
Nuclei
Offline Explorer
OpenLinkProfiler
Openvas
PHPCrawl
PageGrabber
PageThing.com
PeoplePal
Pi-Monster
PictureFinder
Piepmatz
PleaseCrawl
ProWebWalker
Psbot
Pu_iN
Pump
PyCurl
QueryN Metasearch
Quick-Crawler
RSSingBot
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
RealDownload
Reaper
Recorder
RocketCrawler
SEOprofiler
SMTBot
Scanbot
ScreenerBot
ScrepyBot
SearchmetricsBot
SentiBot
Shodan
SlySearch
Snake
Snapbot
SocialRankIOBot
Sociscraper
Sottopop
Spbot
SputnikBot
Sucuri
SuperHTTP
Szukacz
T8Abot
Teleport
TeleportPro
Telesoft
Telesphorep
The Intraformant
Thumbor
TightTwatBot
Titan
Toweyabot
Tracemyfile
Turingos
TurnitinBot
Typhoeus
Upflow
VB Project
Vacuum
VeriCiteCrawler
WPScan
WWW-Mechanize
WWW::Mechanize
Web Auto
Web Pix
WebBandit
WebCollage
WebCopier
WebFetch
WebFuck
WebLeacher
WebSucker
WebWhacker
WebZIP
Webalta
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteQuester
Whack
Whatweb
WinHTTrack
WiseGuys Robot
Wonderbot
Woobot
Xaldon WebSpider
YoudaoBot
Zade
Zauba
Zermelo
ZoominfoBot
ZumBot
adscanner
arquivo-web-crawler
backlink-check
coccocbot-web
crawl.sogou.com
crawler4j
dataforseo.com
demandbase-bot
evc-batch
gopher
heritrix
isitwp.com
meanpathbot
muhstik-scan
netEstate NE Crawler
oBot
pcBrowser
plumanalytics
seobility
seocompany.store
seostar
serpstatbot
sitechecker.pro
trendiction.com
trendiction.de
webprosbot
x22Mozilla
xpymep1.exe