nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-28 10:18:19 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
AIBOT
Aipbot
Alexibot
AllSubmitter
Anthill
Asterias
Attach
BDFetch
BLEXBot
BacklinkCrawler
Battleztar Bazinga
Black Hole
Blow
BotALot
Brandwatch
BuiltWith
BunnySlippers
BuzzSumo
CATExplorador
CCBot
CazoodleBot
CheTeam
Chlooe
Cliqzbot
Cloud mapping
Cogentbot
Collector
Copier
CopyRightCheck
Copyscape
Craftbot
Custo
CyotekWebCopy
DBLBot
Deusu
Dirbuster
Disco
DomCopBot
DomainStatsBot
Domains Project
Dragonfly
Drip
EasyDL
EirGrabber
EroCrawler
Extractor
ExtractorPro
Extreme Picture Finder
FDM
Firefox/7.0
Freeuploader
Fuzz
FyberSpider
Genieo
Gigabot
Go!Zilla
Go-Ahead-Got-It
GoZilla
Grabber
GrapeFX
GrapeshotCrawler
GridBot
HMView
HTTrack
Harvest
Havij
Heritrix
Hloader
IRLbot
IlseBot
InfoNaviRobot
Internet Ninja
InternetSeer
IstellaBot
JOC Web Spider
JetCar
Jetty
JikeSpider
Jorgee
LWP::Simple
Lanshanbot
LeechGet
LibWeb
LieBaoFast
Likse
LinkWalker
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Litemage_walker
MIDown tool
MQQBrowser
Mag-Net
Mail.RU_Bot
MarkMonitor
MarkWatch
Mediatoolkitbot
Microsoft URL Control
Moblie Safari
Mojolicious
Morfeus Fucking Scanner
Mr.4x3
NPbot
Name Intelligence
NearSite
Nessus
NetMechanic
Niki-bot
NimbleCrawler
Nimbostratus
Nutch
Octopus
OnCrawl
Openfind
OrangeBot
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
PageAnalyzer
PageGrabber
PageThing.com
Pandalytics
PeoplePal
Petalbot
Pimonster
ProPowerBot
ProWebWalker
Psbot
Pu_iN
PxBroker
PyCurl
RSSingBot
RankFlex
RankingBot
Rankivabot
Re-re
RealDownload
RebelMouse
Recorder
RocketCrawler
Rogerbot
SEOkicks
SEOkicks-Robot
SEOstats
SMTBot
ScoutJet
Screaming
SearchmetricsBot
SemrushBot
SeobilityBot
Seomoz
Shodan
SiteLockSpider
Sitebeam
Siteimprove
Sitevigil
Snake
Snapbot
Sociscraper
Sottopop
Spammen
Spbot
SputnikBot
Sqlmap
Sqlworm
Steeler
Stripper
Sucuri
SuperBot
SuperHTTP
Surfbot
Szukacz
T0PHackTeam
TeleportPro
Telesphoreo
The Intraformant
TheNomad
Titan
Toata
Trendiction
Turingos
Turnitin
TurnitinBot
Typhoeus
URLy.Warning
VB Project
VCI
VeriCiteCrawler
Virusdie
VoidEYE
Voltron
WASALive-Bot
WPScan
WWW-Mechanize
Wallpapers
Wallpapers/3.0
Web Collage
Web Fetch
WebAuto
WebImageCollector
WebStripper
WebSucker
WebWhacker
WebZIP
WebmasterWorldForumBot
Webshag
WebsiteQuester
Webster
WinHTTrack
Xaldon_WebSpider
Xenu
YoudaoBot
ZoomBot
ZyBorg
archive.org_bot
arquivo.pt
clark-crawler
cognitiveseo
com.plumanalytics
dataforseo.com
demandbase-bot
evc-batch
gopher
internetVista monitor
ips-agent
lwp-request
magpie-crawler
mediawords
muhstik-scan
page scorer
polaris version
probe-image-size
ripz
satoristudio.net
scalaj-http
scan.lol
seobility
sogouspider
spyfu
tAkeOut
ubermetrics-technologies.com
voyagerx.com
webprosbot
xpymep1.exe
zauba.io
zgrab