nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-06-07 22:07:05 +00:00

250 lines
2.5 KiB
Text

404enemy
AIBOT
ASPSeek
Abonti
AhrefsBot
Aipbot
Apexoo
Atomseobot
AwarioRssBot
BDCbot
BDFetch
BLEXBot
BackWeb
Backlink-Ceck
BacklinkCrawler
Bandit
BatchFTP
Battleztar Bazinga
Bigfoot
Blackboard
Blow
BlowFish
Bolt
BotALot
Brandprotect
Buddy
BuiltWith
Bullseye
BunnySlippers
CazoodleBot
Chlooe
Citoid
Claritybot
Cocolyzebot
Collector
Copier
CopyRightCheck
Copyscape
Cosmos
Craftbot
Crescent
Curious
DIIbot
DataCha0s
Deusu
Dirbuster
Discobot
Dispatch
DomainAppender
DomainCrawler
DomainStatsBot
Dotbot
Dragonfly
Drip
ECCP/1.0
EMail Siphon
EasyDL
Ebingbong
Ecxi
EirGrabber
EroCrawler
Express WebPictures
EyeNetIE
Ezooms
FDM
FHscan
FemtosearchBot
Firefox/7.0
FlashGet
Fuzz
FyberSpider
G-i-g-a-b-o-t
GT::WWW
GermCrawler
GetWeb
Getintent
Go!Zilla
Grabber
HEADMasterSEO
HMView
Haansoft
Harvest
Havij
IDBot
IRLbot
Iblog
Image Sucker
IndeedBot
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
Iria
JennyBot
JetCar
Jetty
Jorgee
JustView
Keybot Translation-Search-Machine
Kinza
Lanshanbot
LeechFTP
LexiBot
Likse
LinkScan
LinkWalker
LinkextractorPro
LinkpadBot
Litemage_walker
MJ12bot
MQQBrowser
MSFrontPage
Mail.RU_Bot
Majestic-SEO
Majestic12
Mass Downloader
Masscan
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Microsoft URL Control
Moblie Safari
Mojeek
MolokaiBot
Mr.4x3
Musobot
NICErsPRO
Name Intelligence
Needle
Nessus
Net Vampire
NetAnts
NetLyzer
Netcraft
Nettrack
Netvibes
Nibbler
Niki-bot
Nimbostratus
Nmap
OrangeBot
OrangeSpider
POE-Component-Client-HTTP
Page Analyzer
PageThing.com
Picsearch
PictureFinder
Pimonster
Pixray
PleaseCrawl
Pockey
ProWebWalker
Probethenet
Pu_iN
PyCurl
Quick-Crawler
RankingBot
ReGet
RepoMonkey
Rogerbot
SBIder
SEOkicks
SEOlyticsCrawler
SEOprofiler
SISTRIX
ScanAlert
ScoutJet
Seekport
SemanticJuice
SemrushBot
Seomoz
Shodan
Siphon
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
Sitebeam
Siteimprove
Sitevigil
Snapbot
SocialRankIOBot
Sociscraper
SpaceBison
Stripper
Sucuri
Surfbot
Suzuran
T0PHackTeam
T8Abot
Telesphorep
The Intraformant
TheNomad
Toweyabot
Tracemyfile
Typhoeus
UnisterBot
V-BOT
Vacuum
Vagabondo
VelenPublicWebCrawler
Virusdie
Voltron
WASALive-Bot
WBSearchBot
WeSEE
Web Collage
Web Fetch
Web Fuck
WebGo IS
WebLeacher
WebReaper
WebStripper
WebZIP
Webalta
Webshag
WebsiteExtractor
Who.is Bot
WiseGuys Robot
Wotbox
Wprecon
Zade
Zeus
ZoominfoBot
ZumBot
ZyBorg
arquivo-web-crawler
cah.io.community
check1.exe
com.plumanalytics
crawler4j
demandbase-bot
evc-batch
gopher
heritrix
internetVista monitor
linkdexbot
page scorer
polaris version
ripz
scalaj-http
scan.lol
seocompany.store
sitechecker.pro
sogouspider
sp_auditbot
spyfu
sysscan
webpros.com
webprosbot
zgrab