nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-19 22:07:14 +00:00

250 lines
2.6 KiB
Text

ADmantX
Aboundex
Aboundexbot
AllSubmitter
Alligator
Ankit
Anthill
Aspiegel
Atomseobot
AwarioSmartBot
BLEXBot
BackStreet
Backlink-Ceck
Bandit
Battleztar Bazinga
Bitacle
Boardreader
Bolt
Buck
BuiltWith
Bullseye
CCBot
CheTeam
CheeseBot
Cloud mapping
Copier
CopyRightCheck
Cosmos
Crescent
CrunchBot
Curious
Custo
CyotekWebCopy
DTS Agent
Deusu
Devil
Dirbuster
Discobot
DomCopBot
DomainAppender
Dragonfly
ECCP/1.0
Ebingbong
Ecxi
Evil
Exabot
ExtLinksBot
Extractor
Extreme Picture Finder
Ezooms
FHscan
Foobot
Freeuploader
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GalaxyBot
GermCrawler
GetWeb
Getintent
GoZilla
Gotit
Grafula
HMView
HTTP::Lite
Haansoft
HaosouSpider
Harvest
Hloader
IRLbot
Id-search
Image Sucker
Indy Library
Intelliseek
InternetSeer
Iria
IstellaBot
JOC Web Spider
Jbrofuzz
JennyBot
Jetty
Joomla
JustView
Jyxobot
Kenjin Spider
Keybot Translation-Search-Machine
Kinza
LNSpiderguy
Lanshanbot
Leap
LeechGet
LexiBot
Lftp
Libwhisker
LieBaoFast
Lightspeedsystems
LinkScan
Linkbot
LinkextractorPro
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
MFC_Tear_Sample
MJ12bot
MQQBrowser
MSFrontPage
MTRobot
Mag-Net
Magnet
Mass Downloader
Masscan
Mediatoolkitbot
MegaIndex.ru
Microsoft URL Control
MolokaiBot
Mr.4x3
Musobot
NPbot
Nameprotect
NearSite
Needle
Net Vampire
NetAnts
NetLyzer
Netcraft
Nettrack
Netvibes
NextGenSearchBot
NimbleCrawler
Nimbostratus
Ninja
Not
Nuclei
Offline Navigator
Openvas
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
PageScorer
Pavuk
Petalbot
Picsearch
PictureFinder
Piepmatz
Pixray
ProPowerBot
Pu_iN
Pump
RankActive
Re-re
ReGet
Recorder
RedesScrapy
SEOkicks-Robot
SISTRIX
SMTBot
SemanticJuice
SentiBot
Seomoz
Shodan
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteSucker
SmartDownload
Snapbot
Sociscraper
Sosospider
Sottopop
Spammen
Spanner
Spbot
Steeler
Sucuri
SuperBot
T8Abot
Teleport
Thumbor
Toata
Tracemyfile
Trendiction
Trendictionbot
Typhoeus
URLy.Warning
UnisterBot
Upflow
VCI
VoidEYE
WEBDAV
WISENutbot
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Web Auto
Web Enhancer
Web Fuck
Web Sucker
WebFetch
WebImageCollector
WebPix
WebSauger
WebStripper
WebWhacker
Webalta
WebmasterWorldForumBot
Webshag
WebsiteExtractor
Whack
Whacker
Who.is Bot
Widow
Woobot
Wotbox
Xenu
Zauba
Zermelo
Zeus
Zitebot
ZmEu
ZoomBot
ZoominfoBot
adscanner
arquivo.pt
check1.exe
clark-crawler
crawler.feedback
demandbase-bot
domainsproject.org
facebookscraper
heritrix
internetVista monitor
ips-agent
linkdexbot
lwp-trivial
muhstik-scan
netEstate NE Crawler
page scorer
probe-image-size
scalaj-http
scan.lol
seocompany.store
sexsearcher
sitechecker.pro
spyfu
trendiction.de
webmeup-crawler
webpros.com
webprosbot
x22Mozilla
zauba.io