nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-17 10:09:26 +00:00

250 lines
2.7 KiB
Text

360Spider
ADmantX
ALittle Client
Abonti
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Alexibot
AllSubmitter
AlphaBot
Anarchie
Anarchy99
Anthill
Apexoo
AwarioSmartBot
BLEXBot
BackDoorBot
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
Barkrowler
BatchFTP
Battleztar Bazinga
BetaBot
Bitacle
Blackboard
Blow
Bolt
BotALot
Brandprotect
Buddy
BuiltBotTough
BuiltWith
BuzzSumo
CATExplorador
CODE87
CSHttp
ChinaClaw
Chlooe
Claritybot
Craftbot
Crawling at Home Project
CrazyWebCrawler
Curious
Custo
CyotekWebCopy
DBLBot
DatabaseDriverMysqli
Deusu
Digincore
Dirbuster
Disco
Discoverybot
Dispatch
DittoSpyder
DnBCrawler-Analytics
DnyzBot
DomainCrawler
Dotbot
Dragonfly
EasyDL
EirGrabber
EroCrawler
Exabot
Extreme Picture Finder
EyeNetIE
FemtosearchBot
Firefox/7.0
FlashGet
FrontPage
Fuzz
Fyrebot
GT::WWW
GalaxyBot
Getintent
GoZilla
Gotit
Grabber
Grafula
GrapeFX
GridBot
HEADMasterSEO
HTMLparser
HaosouSpider
Harvest
Heritrix
HybridBot
IDBTE4M
IRLbot
IndeedBot
Intelliseek
InternetSeer
Jorgee
Jyxobot
Kinza
Kozmosbot
LeechFTP
Lftp
LieBaoFast
LinkScan
LinkextractorPro
LinkpadBot
LinqiaScrapeBot
MFC_Tear_Sample
MSFrontPage
Mag-Net
Magnet
Majestic SEO
Majestic-SEO
Majestic12
MarkWatch
Masscan
Mata Hari
MauiBot
MeanPath Bot
Meanpathbot
Mediatoolkitbot
MicroMessenger
Microsoft URL Control
Mister PiX
Mojolicious
Morfeus Fucking Scanner
Mozlila
Msrabot
NICErsPRO
NPbot
Name Intelligence
Needle
Nettrack
Nimbostratus
Ninja
Octopus
Openfind
OutfoxBot
PHPCrawl
PageAnalyzer
PageScorer
PageThing.com
Pandalytics
Papa Foto
Petalbot
PictureFinder
Pixray
ProWebWalker
PxBroker
QueryN Metasearch
RankActive
RankActiveLinkBot
RankFlex
RankingBot2
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
SEOprofiler
ScanAlert
Scanbot
ScoutJet
Scrapy
Screaming
ScrepyBot
SemanticJuice
SemrushBot
SiteLockSpider
SiteSucker
Siteimprove
Sitevigil
SlySearch
Snake
SocialRankIOBot
Sosospider
SpaceBison
Spanner
Spbot
SputnikBot
Sqlworm
Stripper
SuperBot
SuperHTTP
Telesoft
Telesphoreo
Thumbor
TightTwatBot
Titan
Toweyabot
Tracemyfile
UnisterBot
Upflow
VB Project
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
VoidEYE
Voil
Voltron
WASALive-Bot
WEBDAV
WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
Wallpapers
Web Fuck
Web Sauger
Web Sucker
WebGo IS
WebImageCollector
WebLeacher
WebSauger
WebStripper
WebSucker
WebWhacker
Webalta
WebsiteQuester
Webster
Widow
WinHTTrack
WiseGuys Robot
Woobot
Wprecon
Xaldon WebSpider
Xenu
Zade
Zauba
Zermelo
Zitebot
adscanner
archive.org_bot
arquivo-web-crawler
autoemailspider
cognitiveseo
com.plumanalytics
dataforseo.com
domainsproject.org
eCatch
evc-batch
instabid
isitwp.com
lwp-request
magpie-crawler
muhstik-scan
polaris version
probe-image-size
satoristudio.net
scalaj-http
seoscanners
webpros.com
x09Mozilla