nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-06 22:07:04 +00:00

250 lines
2.5 KiB
Text

404checker
ADmantX
Abonti
Aboundex
AfD-Verbotsverfahren
AiHitBot
Aipbot
Alexibot
Alligator
AlphaBot
Anarchie
Anarchy
Anarchy99
Ankit
Anthill
Apexoo
Aspiegel
Atomseobot
BDFetch
BackWeb
Barkrowler
Black Hole
BlackWidow
Blackboard
BlowFish
Bolt
BotALot
Brandwatch
BuiltWith
BuzzSumo
CODE87
Cegbfeieh
CherryPicker
Chlooe
Citoid
Claritybot
Cloud mapping
Cogentbot
Copyscape
Cosmos
CrazyWebCrawler
Custo
CyotekWebCopy
DSearch
Digincore
Dirbuster
Dispatch
DnyzBot
DomCopBot
DomainAppender
Dotbot
Drip
EasyDL
EirGrabber
EroCrawler
Evil
Express WebPictures
EyeNetIE
Ezooms
FDM
FemtosearchBot
Flunky
Fuzz
FyberSpider
Fyrebot
GT::WWW
GalaxyBot
GetWeb
Gigabot
Go!Zilla
Go-Ahead-Got-It
GrabNet
Grabber
HEADMasterSEO
HMView
Heritrix
Image Fetch
Image Sucker
Iria
JamesBOT
JennyBot
JetCar
Jetty
JustView
Jyxobot
Keyword Density
Kinza
Kozmosbot
LNSpiderguy
Lanshanbot
Leap
LeechFTP
LeechGet
LexiBot
Lftp
Libwhisker
Lightspeedsystems
Likse
LinkScan
LinkextractorPro
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Litemage_walker
Ltx71
MSFrontPage
Magnet
Mail.RU_Bot
MarkWatch
Masscan
MeanPath Bot
Metauri
Minefield
Mister PiX
Moblie Safari
Mojeek
Msrabot
NICErsPRO
Name Intelligence
Nameprotect
Navroad
Needle
NetMechanic
NetSpider
NextGenSearchBot
Nibbler
Ninja
Nmap
Nuclei
OnCrawl
OpenLinkProfiler
OpenVAS
OrangeBot
OrangeSpider
OutfoxBot
PageAnalyzer
PageGrabber
PageThing.com
Petalbot
Pi-Monster
PleaseCrawl
Pockey
PyCurl
RankFlex
RankingBot
Rankivabot
RealDownload
Recorder
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
SEOkicks-Robot
SEOprofiler
SISTRIX
SMTBot
ScanAlert
ScreenerBot
ScrepyBot
SearchmetricsBot
Seekport
SemanticJuice
SemrushBot
Seomoz
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
Sitebeam
SlySearch
SmartDownload
SocialRankIOBot
Sottopop
Spammen
Spbot
Spinn3r
Sqworm
SuperBot
SuperHTTP
Suzuran
Swiftbot
Telesoft
Twice
UnisterBot
Upflow
VB Project
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
Voltron
WEBDAV
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
Wallpapers
WallpapersHD
Web Auto
Web Collage
Web Enhancer
Web Fetch
Web Pix
Web Sucker
WebCollage
WebFetch
WebFuck
WebImageCollector
WebLeacher
WebPix
WebSauger
Webshag
WebsiteExtractor
WebsiteQuester
Whacker
Wotbox
YoudaoBot
Zade
Zitebot
ZmEu
ZoomBot
adscanner
cah.io.community
clark-crawler
com.plumanalytics
domainsproject.org
eCatch
gopher
heritrix
iubenda-radar
magpie-crawler
meanpathbot
netEstate NE Crawler
page scorer
s1z.ru
satoristudio.net
scan.lol
seocompany.store
seostar
serpstatbot
sexsearcher
sitechecker.pro
sp_auditbot
spyfu
sysscan
trendiction.com
trendiction.de
webpros.com
webprosbot
x09Mozilla
zauba.io
zgrab