nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-20 22:07:13 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404enemy
ADmantX
ALittle Client
ASPSeek
Abonti
Aboundex
Aboundexbot
AfD-Verbotsverfahren
AhrefsBot
AiHitBot
Aipbot
AlphaBot
Asterias
Attach
AwarioSmartBot
BDFetch
BackDoorBot
BackStreet
Backlink-Ceck
BacklinkCrawler
BetaBot
Bitacle
Blackboard
Blow
BlowFish
Boardreader
Buck
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
BuzzSumo
CATExplorador
CODE87
Calculon
CheeseBot
CherryPicker
Chlooe
Citoid
Cliqzbot
Cloud mapping
Cocolyzebot
CopyRightCheck
Copyscape
Crescent
Curious
DIIbot
Deusu
Digincore
DigitalPebble
Disco
DnBCrawler-Analytics
DomainAppender
DomainSigmaCrawler
DomainStatsBot
Domains Project
Dotbot
Download Wonder
EMail Siphon
Ecxi
EirGrabber
EroCrawler
Express WebPictures
Extractor
Extreme Picture Finder
Ezooms
FDM
Freeuploader
Fuzz
Fyrebot
GT::WWW
GermCrawler
Getintent
GrabNet
Grabber
Grafula
GrapeshotCrawler
HMView
Haansoft
Harvest
Havij
Humanlinks
Iblog
Indy Library
InfoNaviRobot
InfoTekies
Intelliseek
InterGET
Internet Ninja
InternetSeer
Iskanie
IstellaBot
JamesBOT
JustView
Kenjin Spider
Keybot Translation-Search-Machine
LNSpiderguy
LWP::Simple
Lanshanbot
LexiBot
Lftp
LibWeb
Libwhisker
Lightspeedsystems
LinkextractorPro
LinkpadBot
LinqiaScrapeBot
Lmspider
MIIxpc
MSFrontPage
Mag-Net
Mail.RU_Bot
Mass Downloader
Mata Hari
MauiBot
Mb2345Browser
Meanpathbot
MegaIndex.ru
Metauri
Moblie Safari
Mojeek
MolokaiBot
Msrabot
NICErsPRO
NPbot
Navroad
NetAnts
NetMechanic
NetSpider
Netcraft
Nuclei
Octopus
Openfind
OrangeBot
OutclicksBot
POE-Component-Client-HTTP
Pandalytics
Panscient
Papa Foto
Pavuk
PeoplePal
Pi-Monster
Picsearch
Piepmatz
ProWebWalker
Probethenet
Psbot
Pu_iN
QueryN Metasearch
Quick-Crawler
RankActiveLinkBot
RankingBot2
ReGet
RealDownload
RebelMouse
RedesScrapy
RepoMonkey
SBIder
SISTRIX
ScanAlert
Scanbot
ScoutJet
SemanticJuice
SemrushBot
Siphon
SiteExplorer
SiteLockSpider
Sitebeam
Sociscraper
Sottopop
SputnikBot
Steeler
Sucker
Sucuri
Suzuran
Swiftbot
T0PHackTeam
T8Abot
Telesphoreo
The Intraformant
TheNomad
Thumbor
Toata
Trendiction
True_Robot
Turingos
TurnitinBot
Twice
URLy Warning
V-BOT
Vagabondo
VeriCiteCrawler
WASALive-Bot
WBSearchBot
WWW-Collector-E
WWWOFFLE
Wallpapers
WallpapersHD
WeSEE
Web Auto
Web Collage
Web Sauger
WebAuto
WebEnhancer
WebFetch
WebGo IS
WebReaper
Webalta
WebmasterWorldForumBot
Webshag
WebsiteExtractor
Webster
Whack
Whacker
Whatweb
Who.is Bot
Widow
WinHTTrack
Wonderbot
Woobot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Zermelo
ZyBorg
arquivo-web-crawler
cah.io.community
coccocbot
com.plumanalytics
dataforseo.com
eCatch
evc-batch
facebookscraper
gopher
iubenda-radar
linkdexbot
magpie-crawler
page scorer
plumanalytics
probe-image-size
s1z.ru
seobility
seostar
sitechecker.pro
voyagerx.com
webpros.com
x22Mozilla
zgrab