nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-08-09 10:09:26 +00:00

250 lines
2.7 KiB
Text

01h4x.com
404checker
404enemy
AIBOT
ASPSeek
Aboundex
Aboundexbot
Acunetix
AiHitBot
Alligator
Anarchy
Anarchy99
Anthill
Asterias
AwarioRssBot
AwarioSmartBot
BDFetch
Backlink-Ceck
Bandit
Battleztar Bazinga
Bigfoot
Black Hole
Blackboard
BlowFish
Boardreader
Brandprotect
BuzzSumo
CODE87
CSHttp
Cegbfeieh
CensysInspect
ChinaClaw
Claritybot
Cloud mapping
Cogentbot
CopyRightCheck
Copyscape
Cosmos
Crawling at Home Project
Custo
DBLBot
Devil
Disco
DittoSpyder
DnBCrawler-Analytics
DomainCrawler
Dotbot
Dragonfly
ECCP/1.0
EMail Siphon
EasyDL
EroCrawler
Exabot
Express WebPictures
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms
FHscan
FemtosearchBot
Firefox/7.0
FlashGet
FyberSpider
Fyrebot
GT::WWW
GrabNet
Grabber
HEADMasterSEO
Haansoft
Heritrix
Humanlinks
IDBTE4M
IRLbot
IlseBot
InfoNaviRobot
InterGET
Iskanie
IstellaBot
JOC Web Spider
JamesBOT
Jbrofuzz
JetCar
JikeSpider
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
Keyword Density
Kinza
Lanshanbot
Larbin
LeechFTP
LeechGet
LexiBot
Lightspeedsystems
LinkWalker
Linkbot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Litemage_walker
MFC_Tear_Sample
MIDown tool
MQQBrowser
MSFrontPage
Mag-Net
MarkWatch
MauiBot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Mister PiX
Moblie Safari
Mojeek
Mojolicious
Morfeus Fucking Scanner
NICErsPRO
NPbot
NearSite
Net Vampire
NetAnts
NetLyzer
NetMechanic
Netvibes
Nibbler
Ninja
Nuclei
Offline Navigator
OpenLinkProfiler
Openfind
Openvas
OrangeSpider
OutclicksBot
PECL::HTTP
Page Analyzer
Panscient
Pi-Monster
PictureFinder
PleaseCrawl
ProWebWalker
Pump
PyCurl
QueryN Metasearch
RSSingBot
RankActiveLinkBot
RankingBot2
Rankivabot
RankurBot
Re-re
RebelMouse
SEOkicks
SEOkicks-Robot
Scanbot
ScreenerBot
SearchmetricsBot
Site Sucker
SiteSnagger
Siteimprove
Snake
Snoopy
SocialRankIOBot
SpaceBison
Spanner
Sqlworm
Sucuri
SurveyBot
Suzuran
T0PHackTeam
Teleport
The Intraformant
Thumbor
TightTwatBot
Titan
Toata
Toweyabot
True_Robot
Typhoeus
URLy.Warning
VCI
VelenPublicWebCrawler
Voil
WISENutbot
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers/3.0
WallpapersHD
WeSEE
Web Auto
Web Collage
Web Sauger
Web Sucker
WebBandit
WebCollage
WebEnhancer
WebFetch
WebFuck
WebGo IS
WebImageCollector
WebPix
WebStripper
WebSucker
WebZIP
Webalta
Webshag
WebsiteQuester
Webster
Whack
Whacker
Whatweb
Who.is Bot
Widow
Wonderbot
Zauba
Zeus
ZumBot
adscanner
coccocbot
crawler.feedback
crawler4j
dataforseo.com
domainsproject.org
eCatch
evc-batch
facebookscraper
heritrix
ips-agent
iubenda-radar
meanpathbot
mediawords
netEstate NE Crawler
page scorer
polaris version
probe-image-size
scan.lol
seobility
seostar
serpstatbot
siteripz
sp_auditbot
spyfu
sysscan
webpros.com
webprosbot
x09Mozilla
x22Mozilla
zauba.io
zgrab