nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-10 10:09:17 +00:00

250 lines
2.6 KiB
Text

404checker
80legs
ALittle Client
ASPSeek
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
AllSubmitter
Anarchy
Anarchy99
Ankit
Apexoo
Asterias
Attach
AwarioRssBot
BDFetch
BLEXBot
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
Black Hole
Blackboard
BlowFish
BotALot
Brandprotect
BuiltWith
Bullseye
Calculon
CazoodleBot
CheeseBot
CherryPicker
ChinaClaw
Chlooe
Claritybot
Cocolyzebot
Cogentbot
Copier
Copyscape
Cosmos
Curious
CyotekWebCopy
DIIbot
Demon
DigitalPebble
Discoverybot
DnyzBot
DomCopBot
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Domains Project
Dotbot
Drip
Ebingbong
EroCrawler
Evil
Exabot
Express WebPictures
ExtLinksBot
EyeNetIE
FDM
FHscan
FemtosearchBot
Firefox/7.0
Flunky
Foobot
FrontPage
Fyrebot
G-i-g-a-b-o-t
Genieo
GetRight
Getintent
Go!Zilla
Grabber
HEADMasterSEO
HTTrack
Haansoft
IDBTE4M
IDBot
IRLbot
Id-search
Image Sucker
Indy Library
InfoTekies
Internet Ninja
Iskanie
IstellaBot
Jbrofuzz
JikeSpider
Joomla
Jorgee
Jyxobot
Kenjin Spider
Kozmosbot
LNSpiderguy
LWP::Simple
Lanshanbot
Leap
LeechFTP
LeechGet
LexiBot
LibWeb
LieBaoFast
Lightspeedsystems
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Lmspider
Ltx71
MJ12bot
MSFrontPage
MSIECrawler
Majestic SEO
Majestic-SEO
Majestic12
Mass Downloader
Masscan
MauiBot
Mb2345Browser
MeanPath Bot
Meanpathbot
Microsoft Data Access
Microsoft URL Control
Moblie Safari
Mojolicious
Mr.4x3
Msrabot
NICErsPRO
Navroad
Needle
Nessus
NetAnts
NetLyzer
NetMechanic
NetSpider
Niki-bot
Nimbostratus
Nuclei
Offline Explorer
OpenVAS
Openfind
OutclicksBot
PECL::HTTP
Page Analyzer
PageAnalyzer
PageScorer
Pandalytics
Papa Foto
PictureFinder
Piepmatz
Probethenet
PxBroker
PyCurl
RankingBot
ReGet
RebelMouse
RedesScrapy
RepoMonkey
SBIder
SEOkicks
SEOlyticsCrawler
SEOstats
SMTBot
SalesIntelligent
ScanAlert
ScoutJet
Scrapy
ScreenerBot
Searchestate
Semrush
SemrushBot
SeobilityBot
Shodan
Site Sucker
SiteExplorer
SiteLockSpider
SiteSucker
SlySearch
SmartDownload
Sociscraper
Sottopop
Sqlworm
Sqworm
SurveyBot
Suzuran
Swiftbot
Szukacz
T0PHackTeam
Telesoft
Telesphoreo
TheNomad
Tracemyfile
Turingos
TurnitinBot
Twice
Typhoeus
URLy.Warning
Vagabondo
VidibleScraper
WPScan
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Wallpapers/3.0
Web Collage
Web Enhancer
Web Sauger
Web Sucker
WebAuto
WebCollage
WebFetch
WebReaper
WebSauger
WebSucker
WebWhacker
Website Quester
WebsiteExtractor
Whack
Widow
WiseGuys Robot
Wonderbot
Wotbox
Zade
Zermelo
ZyBorg
archive.org_bot
arquivo.pt
autoemailspider
backlink-check
crawl.sogou.com
demandbase-bot
domainsproject.org
evc-batch
facebookscraper
internetVista monitor
lwp-request
lwp-trivial
polaris version
scalaj-http
sexsearcher
sogouspider
sysscan
tAkeOut
trendiction.com
webmeup-crawler
x09Mozilla
zgrab