nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-17 22:07:00 +00:00

250 lines
2.6 KiB
Text

360Spider
404enemy
80legs
ADmantX
Aboundex
Acunetix
AhrefsBot
AiHitBot
AllSubmitter
AlphaBot
Anarchy
Anarchy99
Anthill
Aspiegel
Atomseobot
Attach
BBBike
BDFetch
BLEXBot
BackDoorBot
BacklinkCrawler
BatchFTP
Black Hole
Blackboard
Blow
BlowFish
BotALot
BuiltBotTough
BuiltWith
Bullseye
BuzzSumo
Cegbfeieh
CheTeam
Chlooe
Claritybot
Cliqzbot
Cosmos
Craftbot
Crawling at Home Project
Custo
DBLBot
DataCha0s
Deusu
Digincore
Discobot
Discoverybot
Dispatch
DomainCrawler
DomainSigmaCrawler
Domains Project
Dotbot
Download Wonder
ECCP/1.0
EirGrabber
EroCrawler
Exabot
Extreme Picture Finder
FDM
FHscan
FemtosearchBot
Fimap
FlashGet
Flunky
Fuzz
GT::WWW
GalaxyBot
Genieo
Gotit
GrapeshotCrawler
HMView
HTMLparser
HTTP::Lite
Harvest
Heritrix
Hloader
HybridBot
IDBTE4M
IRLbot
Iblog
IlseBot
Image Sucker
IndeedBot
Indy Library
InterGET
Internet Ninja
Iria
IstellaBot
JamesBOT
JetCar
JikeSpider
Joomla
JustView
Jyxobot
Keybot Translation-Search-Machine
Kinza
Kozmosbot
LNSpiderguy
Larbin
LeechFTP
LeechGet
Lightspeedsystems
LinkScan
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
Lmspider
Ltx71
MFC_Tear_Sample
MQQBrowser
MSFrontPage
MTRobot
Magnet
Mail.RU_Bot
Majestic12
MarkMonitor
Mass Downloader
Masscan
MegaIndex.ru
Mojolicious
MolokaiBot
Mozlila
Msrabot
Musobot
NICErsPRO
Name Intelligence
Navroad
NearSite
NetAnts
NetLyzer
Nettrack
NextGenSearchBot
Nibbler
Niki-bot
Nimbostratus
Nuclei
OnCrawl
OutclicksBot
Page Analyzer
PageAnalyzer
Panscient
Papa Foto
Pavuk
Petalbot
Pi-Monster
Picsearch
Pimonster
PleaseCrawl
Probethenet
QueryN Metasearch
Quick-Crawler
RankFlex
RankingBot
Rankivabot
ReGet
RebelMouse
RedesScrapy
RepoMonkey
SBIder
SEOlyticsCrawler
ScanAlert
SemanticJuice
Seomoz
Sitebeam
SlySearch
SmartDownload
SocialRankIOBot
Sogou web spider
Sottopop
SpankBot
SputnikBot
Sqworm
Stripper
Sucuri
SuperHTTP
Surfbot
SurveyBot
Suzuran
Szukacz
TeleportPro
The Intraformant
Titan
Turingos
Turnitin
TurnitinBot
URLy.Warning
UnisterBot
V-BOT
VCI
Vacuum
Vagabondo
Virusdie
Voil
WBSearchBot
WEBDAV
WWW-Mechanize
WWWOFFLE
Wallpapers/3.0
Web Auto
Web Collage
Web Fetch
Web Sauger
Web Sucker
WebBandit
WebCopier
WebFetch
WebPix
WebStripper
WebWhacker
WebZIP
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteExtractor
Whacker
Widow
WinHTTrack
Wonderbot
Xaldon WebSpider
Zade
Zauba
Zermelo
Zitebot
ZmEu
archive.org_bot
arquivo-web-crawler
autoemailspider
clark-crawler
cognitiveseo
com.plumanalytics
crawler.feedback
demandbase-bot
evc-batch
heritrix
instabid
isitwp.com
lwp-trivial
pcBrowser
plumanalytics
polaris version
scalaj-http
scan.lol
seocompany.store
seoscanners
seostar
spyfu
trendiction.de
webpros.com
x09Mozilla
xpymep1.exe