nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-09-28 10:09:23 +00:00

250 lines
2.7 KiB
Text

80legs
ALittle Client
Aboundex
Aboundexbot
AhrefsBot
AiHitBot
Aipbot
Alexibot
Alligator
AlphaBot
Ankit
Attach
BDFetch
BackDoorBot
BackWeb
Backlink-Ceck
BacklinkCrawler
Badass
Bandit
BetaBot
Black Hole
BlowFish
Boardreader
BotALot
Brandprotect
Buddy
Bullseye
CCBot
CSHttp
Calculon
CazoodleBot
CherryPicker
Cliqzbot
Cloud mapping
Crescent
Curious
DTS Agent
DataCha0s
Deusu
DigitalPebble
Discobot
Discoverybot
DomCopBot
DomainAppender
DomainStatsBot
Dotbot
Dragonfly
ECCP/1.0
Ebingbong
Express WebPictures
Ezooms
FlashGet
Flunky
Freeuploader
Fuzz
Getintent
Go!Zilla
Grafula
HEADMasterSEO
HMView
HTMLparser
HaosouSpider
Humanlinks
IDBTE4M
IRLbot
Iblog
Indy Library
Internet Ninja
InternetSeer
Iskanie
IstellaBot
Jbrofuzz
Jorgee
JustView
Kinza
LWP::Simple
Larbin
Lftp
LieBaoFast
Lightspeedsystems
LinkScan
Linkdexbot
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Lipperhey Spider
MQQBrowser
MSFrontPage
Mag-Net
Mail.RU_Bot
Majestic SEO
Majestic-SEO
MarkMonitor
MarkWatch
MauiBot
Mb2345Browser
MeanPath Bot
MegaIndex.ru
Metauri
MicroMessenger
Microsoft Data Access
Moblie Safari
Mojeek
Morfeus Fucking Scanner
Mozlila
Msrabot
NICErsPRO
Navroad
NearSite
Nessus
Net Vampire
NetLyzer
NetSpider
Netcraft
Netvibes
NextGenSearchBot
Niki-bot
NimbleCrawler
Nutch
Offline Navigator
OpenLinkProfiler
OpenVAS
Openvas
OrangeBot
OutfoxBot
POE-Component-Client-HTTP
PageGrabber
PageScorer
Pandalytics
Papa Foto
Pavuk
Petalbot
Picscout
Piepmatz
Pixray
ProWebWalker
Pump
PyCurl
Re-re
ReGet
RealDownload
RebelMouse
RedesScrapy
RepoMonkey
RocketCrawler
SEOlyticsCrawler
SEOprofiler
SMTBot
ScrepyBot
SemrushBot
Shodan
SiteCheckerBotCrawler
SiteSnagger
Siteimprove
SlySearch
SmartDownload
Snake
Snapbot
SocialRankIOBot
Sosospider
SpaceBison
Spammen
SpankBot
Sqlworm
Stripper
Sucuri
Surfbot
SurveyBot
Suzuran
Szukacz
T0PHackTeam
T8Abot
TeleportPro
Telesphorep
The Intraformant
TightTwatBot
Titan
Toweyabot
Tracemyfile
V-BOT
Vacuum
Vagabondo
VelenPublicWebCrawler
VidibleScraper
Virusdie
Voltron
WEBDAV
WISENutbot
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
WeSEE
Web Collage
Web Enhancer
Web Sauger
WebAuto
WebCopier
WebFuck
WebImageCollector
WebSauger
WebStripper
WebZIP
Webalta
Webster
Whack
WinHTTrack
WiseGuys Robot
Wonderbot
Woobot
Wprecon
Xenu
YoudaoBot
ZmEu
ZumBot
ZyBorg
arquivo.pt
autoemailspider
backlink-check
clark-crawler
cognitiveseo
crawler.feedback
crawler4j
dataforseo.com
demandbase-bot
evc-batch
instabid
ips-agent
lwp-request
lwp-trivial
meanpathbot
muhstik-scan
netEstate NE Crawler
pcBrowser
polaris version
satoristudio.net
scalaj-http
scan.lol
seostar
sexsearcher
sitechecker.pro
sogouspider
spyfu
tAkeOut
trendiction.com
ubermetrics-technologies.com
webmeup-crawler
webpros.com
zauba.io