nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-08-05 22:07:01 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
AIBOT
ASPSeek
Abonti
Acunetix
AfD-Verbotsverfahren
Aipbot
Alexibot
AllSubmitter
Anthill
Aspiegel
AwarioSmartBot
BackWeb
Backlink-Ceck
Badass
Bandit
Barkrowler
BatchFTP
BetaBot
Bitacle
Bolt
Brandprotect
Brandwatch
Buck
Buddy
BuiltWith
CCBot
CSHttp
Calculon
Cegbfeieh
CensysInspect
CheeseBot
CherryPicker
Cocolyzebot
Copyscape
Cosmos
CrazyWebCrawler
CrunchBot
Curious
CyotekWebCopy
DBLBot
DIIbot
DataCha0s
DatabaseDriverMysqli
Deusu
Disco
Discoverybot
Dispatch
DomCopBot
DomainAppender
Domains Project
Download Wonder
Dragonfly
Drip
ECCP/1.0
Ebingbong
EirGrabber
EroCrawler
Evil
Exabot
Express WebPictures
Extractor
Extreme Picture Finder
FemtosearchBot
Fuzz
Fyrebot
GT::WWW
GetRight
Gigablast
GoZilla
GrapeFX
GridBot
HEADMasterSEO
HMView
HTMLparser
Havij
Heritrix
Humanlinks
HybridBot
IDBTE4M
IDBot
IRLbot
Image Fetch
Image Sucker
InternetSeer
Iria
JOC Web Spider
JennyBot
Jorgee
JustView
Jyxobot
Kozmosbot
LNSpiderguy
LWP::Simple
LeechGet
LexiBot
Libwhisker
Linkbot
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
Lipperhey
Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample
MJ12bot
MSFrontPage
MTRobot
Mag-Net
Magnet
Mail.RU_Bot
MarkWatch
Mass Downloader
Masscan
Mb2345Browser
Meanpathbot
Mediatoolkitbot
Microsoft Data Access
Mojolicious
Morfeus Fucking Scanner
Mozlila
Msrabot
NPbot
Name Intelligence
Nameprotect
Navroad
NearSite
Nessus
NetAnts
NetSpider
NetZIP
Nettrack
Nibbler
NimbleCrawler
Nmap
Offline Navigator
OnCrawl
OpenLinkProfiler
OrangeBot
PECL::HTTP
POE-Component-Client-HTTP
PageThing.com
Panscient
Papa Foto
Pavuk
PeoplePal
Picscout
Picsearch
PictureFinder
Pimonster
PleaseCrawl
Pu_iN
Pump
PyCurl
Quick-Crawler
RankActiveLinkBot
RankingBot2
Rankivabot
Recorder
RepoMonkey
Ripper
RocketCrawler
Rogerbot
SBIder
SEOkicks-Robot
SEOprofiler
SMTBot
Scanbot
Scrapy
ScrepyBot
SeoSiteCheckup
Seomoz
Site Sucker
Sitevigil
SmartDownload
Snapbot
Sosospider
SpaceBison
SpankBot
Sucker
SuperHTTP
Surfbot
SurveyBot
Suzuran
Swiftbot
Szukacz
T0PHackTeam
Thumbor
Toweyabot
Tracemyfile
Trendictionbot
True_Robot
Turingos
Upflow
V-BOT
VidibleScraper
VoidEYE
Voltron
WEBDAV
WISENutbot
WWW-Mechanize
WWWOFFLE
Wallpapers/3.0
Web Auto
Web Enhancer
Web Fetch
Web Sucker
WebGo IS
WebImageCollector
WebReaper
WebSauger
WebWhacker
Webshag
WebsiteExtractor
Webster
Who.is Bot
WinHTTrack
Xaldon WebSpider
Xenu
YoudaoBot
Zade
Zeus
ZyBorg
arquivo.pt
autoemailspider
coccocbot-web
com.plumanalytics
crawl.sogou.com
crawler.feedback
eCatch
evc-batch
gopher
heritrix
instabid
lwp-request
mediawords
page scorer
plumanalytics
ripz
satoristudio.net
serpstatbot
sitechecker.pro
sogouspider
spyfu
trendiction.de
voyagerx.com
x09Mozilla
zauba.io