nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-03 22:07:24 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
AIBOT
ASPSeek
Acunetix
AfD-Verbotsverfahren
Aipbot
AllSubmitter
Anarchie
Anarchy
Anarchy99
Ankit
Aspiegel
Asterias
AwarioRssBot
BDCbot
BDFetch
BackWeb
Badass
Bandit
Barkrowler
BatchFTP
Battleztar Bazinga
Black Hole
Brandprotect
BuiltBotTough
Bullseye
BunnySlippers
CODE87
CazoodleBot
CherryPicker
Chlooe
Claritybot
Cloud mapping
Cocolyzebot
Collector
CopyRightCheck
Cosmos
Crawling at Home Project
DBLBot
DIIbot
DSearch
DataCha0s
DatabaseDriverMysqli
Dirbuster
Disco
Dispatch
DomainAppender
Download Wonder
Dragonfly
EMail Siphon
EasyDL
Ebingbong
Ecxi
EroCrawler
Evil
EyeNetIE
FDM
FHscan
FlashGet
FyberSpider
GetRight
GetWeb
Getintent
Gigabot
Go!Zilla
Go-Ahead-Got-It
GrabNet
Grabber
Grafula
GridBot
HTTrack
Heritrix
Hloader
Iblog
Image Sucker
IndeedBot
Indy Library
Internet Ninja
Iskanie
IstellaBot
JOC Web Spider
JamesBOT
Jbrofuzz
JetCar
Jetty
Joomla
Jorgee
Keyword Density
Kinza
Kozmosbot
LNSpiderguy
LWP::Simple
Lanshanbot
LeechFTP
LibWeb
Libwhisker
LieBaoFast
Lightspeedsystems
LinkScan
Linkbot
Linkdexbot
LinkpadBot
LinqiaScrapeBot
Litemage_walker
MIDown tool
MJ12bot
MSFrontPage
MSIECrawler
Mag-Net
Majestic SEO
Majestic-SEO
MauiBot
MegaIndex.ru
Metauri
Mister PiX
Mojeek
Mojolicious
Morfeus Fucking Scanner
Mozlila
Name Intelligence
Nameprotect
Nessus
NetZIP
Netcraft
Netvibes
Nibbler
Niki-bot
Nikto
Nuclei
Nutch
Offline Explorer
OpenLinkProfiler
OpenVAS
Openfind
OutclicksBot
PageScorer
PageThing.com
PeoplePal
Pimonster
PleaseCrawl
Probethenet
Psbot
Pu_iN
QueryN Metasearch
Quick-Crawler
RankActive
RankActiveLinkBot
RankFlex
Rankivabot
RankurBot
ReGet
Reaper
RebelMouse
RepoMonkey
SEOkicks
SEOlyticsCrawler
SEOprofiler
SEOstats
SMTBot
SalesIntelligent
Scanbot
ScoutJet
Scrapy
Screaming
ScreenerBot
SearchmetricsBot
SemrushBot
SentiBot
SeoSiteCheckup
SeobilityBot
Seomoz
SiteLockSpider
Siteimprove
Snake
Sottopop
SpaceBison
Spinn3r
Sqlmap
SuperHTTP
SurveyBot
Suzuran
Swiftbot
Telesphoreo
Telesphorep
The Intraformant
Titan
Toata
Trendictionbot
Turingos
Turnitin
TurnitinBot
TwengaBot
Twice
Typhoeus
URLy.Warning
VidibleScraper
Virusdie
VoidEYE
Voltron
WISENutbot
WWW-Collector-E
WallpapersHD
WeSEE
Web Collage
WebBandit
WebFetch
WebFuck
WebImageCollector
WebLeacher
WebSauger
WebStripper
WebZIP
Webshag
Webster
Whack
Whacker
Who.is Bot
Woobot
Wotbox
Xaldon WebSpider
YoudaoBot
Zade
Zauba
Zermelo
Zeus
Zitebot
ZmEu
archive.org_bot
arquivo.pt
cognitiveseo
crawler4j
domainsproject.org
facebookscraper
isitwp.com
lwp-request
magpie-crawler
netEstate NE Crawler
oBot
page scorer
plumanalytics
probe-image-size
satoristudio.net
scalaj-http
sysscan
tAkeOut
webmeup-crawler
webpros.com
webprosbot