nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-16 10:18:07 +00:00

250 lines
2.7 KiB
Text

ADmantX
ALittle Client
ASPSeek
Abonti
Aboundex
Aboundexbot
AiHitBot
Alligator
Anarchy
Attach
AwarioRssBot
BDCbot
BackStreet
Backlink-Ceck
BacklinkCrawler
Bandit
Barkrowler
BatchFTP
BlackWidow
Blackboard
BlowFish
Boardreader
Bolt
Buddy
BuiltBotTough
BuiltWith
CODE87
Calculon
Cegbfeieh
CensysInspect
CheTeam
CherryPicker
Cliqzbot
Cogentbot
Copier
CopyRightCheck
Curious
DBLBot
DatabaseDriverMysqli
Devil
Dirbuster
Discoverybot
DomCopBot
DomainCrawler
DomainSigmaCrawler
Domains Project
Dragonfly
ECCP/1.0
EMail Siphon
Ebingbong
EroCrawler
Exabot
Extreme Picture Finder
EyeNetIE
FHscan
Freeuploader
Fyrebot
GT::WWW
GalaxyBot
Genieo
GermCrawler
GetRight
Gigabot
GoZilla
Gotit
Grafula
GrapeFX
GrapeshotCrawler
HMView
HTMLparser
HTTP::Lite
Heritrix
IDBTE4M
IRLbot
Iblog
IlseBot
Image Sucker
InfoNaviRobot
JOC Web Spider
JamesBOT
JetCar
JustView
Kenjin Spider
Kinza
LWP::Simple
LeechGet
LexiBot
Lftp
Libwhisker
Lightspeedsystems
Likse
LinkWalker
Linkbot
Linkdexbot
LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
Lmspider
MFC_Tear_Sample
MJ12bot
MSFrontPage
Mag-Net
Magnet
Mail.RU_Bot
Majestic-SEO
MarkMonitor
Masscan
MauiBot
Mb2345Browser
MeanPath Bot
Meanpathbot
Mediatoolkitbot
MegaIndex.ru
Microsoft URL Control
Mister PiX
Moblie Safari
Mojeek
Morfeus Fucking Scanner
NPbot
Nessus
NetMechanic
NetSpider
NetZIP
NextGenSearchBot
Nimbostratus
Nuclei
Offline Explorer
Offline Navigator
OutclicksBot
POE-Component-Client-HTTP
Page Analyzer
Panscient
Papa Foto
Pavuk
Petalbot
Pi-Monster
Picsearch
PictureFinder
Piepmatz
Pimonster
Pixray
PleaseCrawl
Probethenet
Pump
QueryN Metasearch
RSSingBot
RankActiveLinkBot
RankFlex
ReGet
RealDownload
Reaper
Recorder
RedesScrapy
Rogerbot
Searchestate
SearchmetricsBot
SentiBot
SeobilityBot
Seomoz
Siphon
Site Sucker
SiteCheckerBotCrawler
Siteimprove
Sitevigil
SmartDownload
Snake
Sogou web spider
Sosospider
Spammen
SpankBot
Spanner
Sqworm
Stripper
Surfbot
SurveyBot
Suzuran
Swiftbot
T8Abot
TeleportPro
Telesoft
Telesphorep
Titan
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
Turingos
Turnitin
TurnitinBot
TwengaBot
URLy.Warning
Upflow
Vagabondo
VidibleScraper
Virusdie
VoidEYE
WASALive-Bot
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Web Sauger
WebFuck
WebImageCollector
Webalta
WebmasterWorldForumBot
Webshag
Webster
Whacker
Widow
WinHTTrack
Woobot
Xaldon_WebSpider
Zade
Zermelo
ZumBot
ZyBorg
coccocbot-web
com.plumanalytics
crawler4j
dataforseo.com
eCatch
evc-batch
facebookscraper
heritrix
internetVista monitor
lwp-request
lwp-trivial
mediawords
oBot
pcBrowser
scalaj-http
seobility
seoscanners
seostar
serpstatbot
sexsearcher
sitechecker.pro
spyfu
sysscan
ubermetrics-technologies.com
voyagerx.com
webmeup-crawler
webpros.com
webprosbot
x22Mozilla
xpymep1.exe
zauba.io
zgrab