nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-04 10:09:03 +00:00

250 lines
2.6 KiB
Text

01h4x.com
80legs
ADmantX
ALittle Client
Aboundex
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Aipbot
Alexibot
AllSubmitter
AlphaBot
Anarchie
Anthill
AwarioSmartBot
BDFetch
Bandit
BatchFTP
Battleztar Bazinga
Blackboard
Blow
BlowFish
Brandwatch
BunnySlippers
CCBot
CODE87
Calculon
Cegbfeieh
CheTeam
ChinaClaw
Claritybot
Cliqzbot
Cloud mapping
Cogentbot
CopyRightCheck
Copyscape
Cosmos
Craftbot
CrazyWebCrawler
CrunchBot
Curious
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Domains Project
ECCP/1.0
EMail Wolf
EasyDL
Ebingbong
Express WebPictures
ExtLinksBot
Extractor
EyeNetIE
FDM
FemtosearchBot
Fimap
FlashGet
Foobot
Fuzz
Fyrebot
Genieo
GermCrawler
Getintent
GoZilla
Grabber
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HTTP::Lite
Haansoft
Harvest
Havij
IDBTE4M
IlseBot
Image Fetch
Image Sucker
InfoNaviRobot
Intelliseek
InterGET
Internet Ninja
InternetSeer
Iria
JamesBOT
Jbrofuzz
JikeSpider
Jorgee
JustView
Kenjin Spider
Keyword Density
LNSpiderguy
Larbin
Leap
LeechGet
LexiBot
LibWeb
LieBaoFast
LinkWalker
LinkpadBot
LinksManager
Lipperhey Spider
Litemage_walker
MIDown tool
MIIxpc
MSFrontPage
MSIECrawler
MTRobot
Mag-Net
Magnet
Majestic SEO
Majestic12
MarkWatch
Mb2345Browser
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Mr.4x3
Musobot
NPbot
Name Intelligence
Navroad
NearSite
Nessus
NetAnts
NetLyzer
NetMechanic
NetSpider
NetZIP
Nettrack
Netvibes
Nibbler
Nutch
Octopus
OnCrawl
OpenLinkProfiler
Openfind
OutfoxBot
PECL::HTTP
Page Analyzer
PageGrabber
Pandalytics
Picsearch
Pimonster
Pu_iN
PyCurl
RSSingBot
RankFlex
RankingBot2
Rankivabot
RankurBot
Re-re
ReGet
RebelMouse
Recorder
RedesScrapy
Ripper
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SMTBot
ScanAlert
ScoutJet
Scrapy
Searchestate
Seomoz
Shodan
SiteCheckerBotCrawler
SiteExplorer
SlySearch
SmartDownload
Snoopy
SocialRankIOBot
SpaceBison
SpankBot
Spbot
SputnikBot
Sqlmap
Stripper
Sucuri
SuperHTTP
T0PHackTeam
TheNomad
Thumbor
Toata
Tracemyfile
Trendiction
Turingos
Turnitin
TurnitinBot
URLy Warning
VCI
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
Voltron
WASALive-Bot
WBSearchBot
WISENutbot
Wallpapers
Web Auto
Web Fuck
WebAuto
WebBandit
WebGo IS
WebImageCollector
WebReaper
WebSauger
WebStripper
WebWhacker
Webalta
Webster
Widow
WinHTTrack
Wonderbot
Woobot
Xenu
YoudaoBot
ZoominfoBot
archive.org_bot
arquivo.pt
backlink-check
clark-crawler
com.plumanalytics
crawl.sogou.com
crawler.feedback
crawler4j
domainsproject.org
evc-batch
gopher
isitwp.com
magpie-crawler
meanpathbot
oBot
page scorer
pcBrowser
polaris version
probe-image-size
scalaj-http
seostar
sitechecker.pro
spyfu
sysscan
tAkeOut
trendiction.de
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
x22Mozilla