nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-02-03 22:07:23 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
80legs
ADmantX
ALittle Client
Abonti
Acunetix
Alexibot
Anarchy
Apexoo
Atomseobot
AwarioSmartBot
BLEXBot
BackStreet
Battleztar Bazinga
BetaBot
Bigfoot
BlackWidow
Blackboard
BlowFish
Brandwatch
Buck
BunnySlippers
CCBot
CODE87
CensysInspect
CheeseBot
ChinaClaw
Chlooe
Claritybot
Copyscape
Craftbot
CrazyWebCrawler
Crescent
CrunchBot
Curious
Custo
DBLBot
DSearch
DataCha0s
Devil
Digincore
DigitalPebble
Dispatch
DittoSpyder
DnBCrawler-Analytics
DomCopBot
DomainAppender
DomainCrawler
Domains Project
Dragonfly
ECCP/1.0
Ebingbong
Ecxi
EroCrawler
ExtLinksBot
Extractor
ExtractorPro
FHscan
Flunky
Freeuploader
FrontPage
Fuzz
FyberSpider
Genieo
GetRight
Gigabot
Go!Zilla
GoZilla
GrabNet
GrapeFX
GrapeshotCrawler
HMView
HTTrack
Havij
Hloader
HonoluluBot
HybridBot
IDBTE4M
IRLbot
Iblog
Image Fetch
Image Sucker
Indy Library
InfoTekies
Internet Ninja
IstellaBot
Jbrofuzz
JetCar
JikeSpider
Jorgee
JustView
Jyxobot
Kenjin Spider
Kinza
Kozmosbot
LWP::Simple
Larbin
LeechFTP
LeechGet
Lftp
LibWeb
Likse
Linkbot
LinkextractorPro
LinkpadBot
LinksManager
LinqiaRSSBot
MIDown tool
Majestic-SEO
MarkMonitor
MarkWatch
Mass Downloader
MauiBot
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
Microsoft Data Access
Microsoft URL Control
Moblie Safari
MolokaiBot
NICErsPRO
Navroad
NetLyzer
NetZIP
Netcraft
Nibbler
Nikto
Offline Explorer
Openvas
OutfoxBot
PHPCrawl
Page Analyzer
PageThing.com
Pandalytics
Panscient
PeoplePal
Picscout
Pimonster
ProPowerBot
Probethenet
Pump
RankFlex
RankingBot
RankurBot
Recorder
RepoMonkey
Rogerbot
SBIder
SEOlyticsCrawler
SEOprofiler
Scanbot
Scrapy
ScrepyBot
SearchmetricsBot
SemanticJuice
SemrushBot
SentiBot
Seomoz
Shodan
Siphon
Site Sucker
SiteExplorer
Sitebeam
SlySearch
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
SpaceBison
Spammen
Spanner
Sqlmap
Stripper
Sucker
SuperHTTP
Surfbot
SurveyBot
Szukacz
T0PHackTeam
Telesoft
Telesphorep
The Intraformant
TightTwatBot
Toweyabot
Tracemyfile
Trendictionbot
Turingos
Turnitin
TurnitinBot
TwengaBot
Twice
UnisterBot
Vagabondo
Voil
WWW-Mechanize
WWWOFFLE
WeSEE
Web Collage
Web Enhancer
Web Fetch
Web Pix
WebAuto
WebCopier
WebFuck
WebGo IS
WebPix
WebReaper
WebSauger
WebStripper
WebZIP
Webalta
WebmasterWorldForumBot
Webshag
Whatweb
Who.is Bot
Wonderbot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Zauba
Zitebot
ZmEu
ZyBorg
adscanner
archive.org_bot
cognitiveseo
crawl.sogou.com
demandbase-bot
domainsproject.org
eCatch
heritrix
internetVista monitor
iubenda-radar
lwp-request
lwp-trivial
muhstik-scan
oBot
plumanalytics
probe-image-size
s1z.ru
scalaj-http
scan.lol
sexsearcher
tAkeOut
trendiction.de
x09Mozilla
x22Mozilla
xpymep1.exe