nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-24 22:09:28 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
ADmantX
ALittle Client
Abonti
Acunetix
AfD-Verbotsverfahren
AiHitBot
Alexibot
Anarchy
Apexoo
AwarioRssBot
BDFetch
BackWeb
BacklinkCrawler
Badass
Bitacle
Boardreader
Bolt
Buck
BunnySlippers
BuzzSumo
CCBot
Calculon
CensysInspect
CheeseBot
ChinaClaw
Chlooe
Claritybot
Cliqzbot
Cogentbot
Copier
CrazyWebCrawler
CrunchBot
Curious
CyotekWebCopy
DBLBot
DTS Agent
DataCha0s
Deusu
Devil
Digincore
DigitalPebble
Discobot
DnBCrawler-Analytics
DomainAppender
DomainCrawler
Dragonfly
EMail Wolf
Ecxi
EirGrabber
EroCrawler
Express WebPictures
ExtLinksBot
EyeNetIE
Ezooms
FDM
FemtosearchBot
G-i-g-a-b-o-t
GT::WWW
GalaxyBot
Genieo
GetRight
Gigabot
Go!Zilla
GrabNet
GrapeshotCrawler
GridBot
HMView
HTTP::Lite
Haansoft
Humanlinks
HybridBot
IDBTE4M
IDBot
Iblog
Id-search
IlseBot
Image Fetch
IndeedBot
Indy Library
InfoTekies
Internet Ninja
Jbrofuzz
JennyBot
JetCar
Jetty
JustView
Keyword Density
Kinza
Larbin
Leap
LeechGet
LieBaoFast
Lightspeedsystems
Likse
LinkWalker
Linkbot
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
Litemage_walker
MIDown tool
MIIxpc
MJ12bot
MQQBrowser
MTRobot
Majestic-SEO
Majestic12
MarkWatch
Mata Hari
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
Metauri
Microsoft URL Control
Mister PiX
Mojolicious
Morfeus Fucking Scanner
Mozlila
Mr.4x3
NPbot
NetMechanic
NetSpider
NetZIP
Nikto
Nimbostratus
Ninja
Nmap
Offline Explorer
OpenVAS
Openvas
OrangeBot
PHPCrawl
POE-Component-Client-HTTP
Page Analyzer
PageAnalyzer
PageThing.com
Panscient
Papa Foto
Petalbot
Picscout
PictureFinder
Pockey
ProPowerBot
ProWebWalker
Psbot
Pump
QueryN Metasearch
RSSingBot
RankFlex
RankingBot2
ReGet
RedesScrapy
RepoMonkey
Rogerbot
SEOkicks
SEOprofiler
SISTRIX
SMTBot
SalesIntelligent
ScreenerBot
ScrepyBot
SemrushBot
SentiBot
Siphon
SiteExplorer
SiteSnagger
Sociscraper
Sosospider
Spanner
Sucker
SuperHTTP
Suzuran
Swiftbot
Szukacz
T8Abot
TeleportPro
Telesoft
Telesphorep
The Intraformant
TightTwatBot
Titan
Toata
Tracemyfile
Trendiction
TurnitinBot
Typhoeus
Upflow
V-BOT
VB Project
VCI
Vacuum
VelenPublicWebCrawler
VidibleScraper
Virusdie
VoidEYE
Voil
Voltron
WBSearchBot
WISENutbot
WWW::Mechanize
Wallpapers/3.0
Web Collage
Web Fetch
Web Fuck
Web Pix
Web Sucker
WebAuto
WebCollage
WebImageCollector
WebPix
WebReaper
WebSauger
WebStripper
WebWhacker
WebZIP
Webshag
Website Quester
Whacker
Whatweb
Who.is Bot
Widow
YoudaoBot
Zauba
Zitebot
ZmEu
ZoomBot
ZoominfoBot
ZumBot
autoemailspider
clark-crawler
cognitiveseo
demandbase-bot
facebookscraper
gopher
ips-agent
isitwp.com
netEstate NE Crawler
pcBrowser
polaris version
scan.lol
seobility
sitechecker.pro
tAkeOut
webmeup-crawler
x22Mozilla
xpymep1.exe
zauba.io
zgrab