nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-08-15 10:12:45 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404enemy
80legs
Abonti
Aboundexbot
Acunetix
AfD-Verbotsverfahren
Aipbot
Alexibot
AllSubmitter
AlphaBot
Anarchie
Anarchy99
BBBike
BDCbot
BackStreet
Backlink-Ceck
Barkrowler
Black Hole
Blow
BotALot
BuiltBotTough
Bullseye
BunnySlippers
CATExplorador
CCBot
CODE87
Cegbfeieh
CensysInspect
CheeseBot
Cloud mapping
Cocolyzebot
Cogentbot
Collector
Copyscape
Cosmos
CrunchBot
Curious
CyotekWebCopy
DataCha0s
DatabaseDriverMysqli
Demon
Digincore
DomainAppender
DomainSigmaCrawler
Dotbot
Download Wonder
Dragonfly
Drip
ECCP/1.0
EasyDL
Exabot
ExtLinksBot
Extractor
ExtractorPro
FDM
FHscan
FemtosearchBot
FrontPage
Fuzz
FyberSpider
GalaxyBot
GermCrawler
GetWeb
Getintent
Go!Zilla
Go-Ahead-Got-It
GoZilla
Grabber
HEADMasterSEO
HTTP::Lite
Harvest
Humanlinks
IDBot
Image Fetch
IndeedBot
Intelliseek
InterGET
Iria
JikeSpider
Joomla
Jorgee
JustView
Keyword Density
Kinza
Kozmosbot
LNSpiderguy
Lanshanbot
Leap
LeechFTP
LexiBot
LibWeb
Likse
LinkScan
Linkbot
Linkdexbot
LinksManager
LinqiaMetadataDownloaderBot
Lmspider
MJ12bot
MTRobot
Mail.RU_Bot
Majestic SEO
Majestic12
MarkMonitor
MarkWatch
Mb2345Browser
MeanPath Bot
Metauri
Microsoft Data Access
Moblie Safari
Mojeek
Mojolicious
Mr.4x3
Musobot
Nameprotect
NearSite
Net Vampire
NetAnts
NetLyzer
NetZIP
Nettrack
NextGenSearchBot
Nibbler
Nimbostratus
Nmap
Octopus
Offline Navigator
OpenVAS
OrangeBot
OrangeSpider
POE-Component-Client-HTTP
Page Analyzer
Pandalytics
Pavuk
PeoplePal
Petalbot
Picsearch
PictureFinder
Pixray
ProPowerBot
ProWebWalker
QueryN Metasearch
RankActive
RankFlex
RankingBot
ReGet
RealDownload
RebelMouse
Recorder
RedesScrapy
Ripper
Rogerbot
SEOkicks
SEOprofiler
SEOstats
SalesIntelligent
ScanAlert
Scanbot
ScoutJet
Scrapy
ScreenerBot
ScrepyBot
Searchestate
SearchmetricsBot
SemrushBot
SentiBot
SeobilityBot
Siphon
SiteCheckerBotCrawler
Sitevigil
Snake
Snapbot
Sogou web spider
Sottopop
SpaceBison
Spanner
Spbot
Spinn3r
SputnikBot
Steeler
Sucker
Sucuri
Surfbot
Swiftbot
T0PHackTeam
Telesphoreo
Titan
Toata
Trendiction
Turingos
Twice
VB Project
VCI
VoidEYE
Voltron
WISENutbot
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
WallpapersHD
WeSEE
Web Auto
Web Collage
Web Fuck
WebCollage
WebFetch
WebGo IS
WebImageCollector
WebStripper
WebWhacker
WebZIP
Webalta
Website Quester
WebsiteQuester
Webster
Who.is Bot
Widow
WinHTTrack
Wonderbot
Wotbox
Xaldon_WebSpider
Zermelo
Zeus
Zitebot
ZmEu
arquivo.pt
backlink-check
clark-crawler
coccocbot-web
com.plumanalytics
crawl.sogou.com
crawler.feedback
domainsproject.org
heritrix
internetVista monitor
magpie-crawler
netEstate NE Crawler
page scorer
s1z.ru
satoristudio.net
seobility
siteripz
sogouspider
trendiction.de
ubermetrics-technologies.com
webprosbot
x22Mozilla