nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-08-17 10:08:53 +00:00

250 lines
2.6 KiB
Text

404checker
404enemy
80legs
AIBOT
ALittle Client
AhrefsBot
AlphaBot
Anarchy99
Anthill
Apexoo
AwarioRssBot
AwarioSmartBot
BDCbot
BDFetch
BLEXBot
BackWeb
Badass
BatchFTP
Blow
Bolt
BotALot
Brandprotect
BuiltWith
BunnySlippers
BuzzSumo
Calculon
CazoodleBot
CensysInspect
Claritybot
Cocolyzebot
Cogentbot
Copyscape
CrunchBot
Curious
Custo
CyotekWebCopy
DTS Agent
Disco
Discobot
Discoverybot
DittoSpyder
DomCopBot
DomainAppender
Dotbot
Dragonfly
EMail Siphon
EMail Wolf
EasyDL
Ebingbong
Ecxi
Exabot
Express WebPictures
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
FHscan
FemtosearchBot
Fimap
Firefox/7.0
FlashGet
Foobot
FyberSpider
Fyrebot
GT::WWW
GalaxyBot
GermCrawler
GetRight
GetWeb
Go!Zilla
GrabNet
Grabber
GrapeshotCrawler
HTMLparser
Haansoft
Heritrix
Hloader
IDBTE4M
Iblog
IlseBot
Image Sucker
Indy Library
InfoNaviRobot
InterGET
InternetSeer
Iria
JamesBOT
Jorgee
Keyword Density
Kinza
LWP::Simple
Larbin
LeechFTP
LexiBot
Lftp
LieBaoFast
Likse
Lmspider
MFC_Tear_Sample
MIDown tool
MJ12bot
MSIECrawler
MTRobot
Mag-Net
Magnet
Majestic SEO
MarkWatch
Masscan
Mata Hari
Mb2345Browser
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Microsoft Data Access
Microsoft URL Control
Mozlila
Mr.4x3
Nameprotect
NetSpider
NetZIP
Netcraft
Nimbostratus
Ninja
Nmap
Nutch
Octopus
Offline Explorer
Offline Navigator
OnCrawl
OpenVAS
Openfind
OutclicksBot
Pandalytics
Panscient
PeoplePal
Petalbot
Picscout
Picsearch
Probethenet
Psbot
Pu_iN
PyCurl
QueryN Metasearch
RSSingBot
RankActiveLinkBot
RankFlex
RankingBot
Rankivabot
Reaper
RedesScrapy
RepoMonkey
Ripper
SBIder
SMTBot
Scanbot
ScoutJet
Screaming
SeobilityBot
SiteCheckerBotCrawler
SiteExplorer
SiteSnagger
Sitebeam
SlySearch
SmartDownload
SocialRankIOBot
Sottopop
SpaceBison
Spammen
SpankBot
SputnikBot
Sqlmap
Stripper
Surfbot
SurveyBot
Swiftbot
T0PHackTeam
T8Abot
TeleportPro
Telesphoreo
Thumbor
Toweyabot
Tracemyfile
Trendiction
Turingos
Typhoeus
URLy Warning
URLy.Warning
Upflow
Vagabondo
VelenPublicWebCrawler
WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
WeSEE
Web Collage
Web Enhancer
Web Pix
WebBandit
WebCopier
WebEnhancer
WebFetch
WebFuck
WebImageCollector
WebLeacher
WebSucker
WebsiteQuester
Webster
Whack
Whacker
Who.is Bot
Widow
Woobot
Wotbox
Xaldon_WebSpider
Zeus
ZoomBot
ZoominfoBot
archive.org_bot
arquivo-web-crawler
arquivo.pt
backlink-check
coccocbot-web
cognitiveseo
evc-batch
instabid
internetVista monitor
ips-agent
isitwp.com
muhstik-scan
page scorer
plumanalytics
probe-image-size
s1z.ru
scalaj-http
scan.lol
seobility
seoscanners
seostar
serpstatbot
sitechecker.pro
tAkeOut
trendiction.com
webmeup-crawler
webpros.com
webprosbot
x09Mozilla