nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-03-25 13:00:44 +00:00

250 lines
2.7 KiB
Text

01h4x.com
80legs
AIBOT
ALittle Client
Aboundexbot
Acunetix
AfD-Verbotsverfahren
AlphaBot
Asterias
Attach
AwarioSmartBot
BBBike
BDFetch
BackStreet
BackWeb
BacklinkCrawler
Battleztar Bazinga
Bigfoot
BlackWidow
Boardreader
BotALot
Buck
BuiltBotTough
BunnySlippers
CherryPicker
Citoid
Claritybot
Cocolyzebot
Cogentbot
Copier
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
CyotekWebCopy
DBLBot
Demon
Devil
DigitalPebble
Disco
DittoSpyder
DnyzBot
DomainAppender
EMail Siphon
Ecxi
Exabot
Express WebPictures
Ezooms
FyberSpider
Fyrebot
GT::WWW
GalaxyBot
GetRight
GetWeb
GoZilla
GrabNet
GrapeshotCrawler
GridBot
HEADMasterSEO
HTMLparser
HTTP::Lite
HTTrack
Hloader
Humanlinks
IDBTE4M
IndeedBot
InfoNaviRobot
Intelliseek
Iria
Iskanie
JOC Web Spider
JikeSpider
JustView
Kenjin Spider
Keybot Translation-Search-Machine
Keyword Density
LNSpiderguy
LWP::Simple
Larbin
LeechFTP
LexiBot
LibWeb
Lightspeedsystems
Likse
Linkdexbot
LinkpadBot
LinksManager
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Ltx71
MQQBrowser
MTRobot
Majestic SEO
Masscan
MauiBot
Mb2345Browser
Meanpathbot
Minefield
Mister PiX
Mojeek
Mojolicious
MolokaiBot
Musobot
NICErsPRO
NPbot
Nameprotect
NearSite
Nessus
NetLyzer
NetSpider
Netvibes
NextGenSearchBot
Nibbler
Niki-bot
Ninja
Nuclei
OnCrawl
OpenLinkProfiler
OrangeBot
POE-Component-Client-HTTP
PageAnalyzer
PageThing.com
Pandalytics
Pavuk
PeoplePal
Pi-Monster
Picsearch
Pimonster
PleaseCrawl
Pockey
ProPowerBot
ProWebWalker
Probethenet
Quick-Crawler
RankingBot
RankurBot
Reaper
RebelMouse
Recorder
RocketCrawler
SBIder
SEOlyticsCrawler
SEOprofiler
SMTBot
SalesIntelligent
ScanAlert
ScreenerBot
Searchestate
SearchmetricsBot
Semrush
Site Sucker
SiteSnagger
SiteSucker
SlySearch
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
Spammen
Spinn3r
SputnikBot
Steeler
SuperHTTP
Suzuran
Swiftbot
T8Abot
TeleportPro
Telesoft
Telesphoreo
Telesphorep
The Intraformant
Titan
Toweyabot
Tracemyfile
Trendiction
True_Robot
Turnitin
TurnitinBot
URLy Warning
URLy.Warning
VeriCiteCrawler
Virusdie
VoidEYE
Voil
Voltron
WBSearchBot
WEBDAV
WWW-Collector-E
Wallpapers
Wallpapers/3.0
Web Sauger
Web Sucker
WebAuto
WebCollage
WebCopier
WebEnhancer
WebGo IS
WebImageCollector
WebReaper
WebWhacker
WebmasterWorldForumBot
Webshag
WebsiteExtractor
Whacker
Whatweb
Widow
WiseGuys Robot
Woobot
Wprecon
Zade
ZmEu
ZoomBot
adscanner
arquivo-web-crawler
autoemailspider
backlink-check
check1.exe
cognitiveseo
crawler.feedback
crawler4j
dataforseo.com
domainsproject.org
eCatch
evc-batch
facebookscraper
gopher
instabid
lwp-request
lwp-trivial
muhstik-scan
oBot
plumanalytics
probe-image-size
s1z.ru
satoristudio.net
scalaj-http
seobility
seocompany.store
sexsearcher
sitechecker.pro
sogouspider
voyagerx.com
webgains-bot
webmeup-crawler
webpros.com
x09Mozilla
x22Mozilla
xpymep1.exe