nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-10-27 22:09:05 +00:00

250 lines
2.6 KiB
Text

AIBOT
ASPSeek
Abonti
Aboundexbot
AiHitBot
Alexibot
AllSubmitter
Anarchy
Ankit
Apexoo
Attach
AwarioRssBot
AwarioSmartBot
BackStreet
Backlink-Ceck
BacklinkCrawler
Badass
Bandit
Black Hole
BlackWidow
Blackboard
Blow
Boardreader
Brandprotect
Brandwatch
Buck
CATExplorador
CCBot
Calculon
CazoodleBot
Cegbfeieh
CensysInspect
CheeseBot
ChinaClaw
Chlooe
Claritybot
Cocolyzebot
Cogentbot
Collector
Copyscape
Cosmos
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
DBLBot
DIIbot
DTS Agent
DatabaseDriverMysqli
Demon
Devil
DittoSpyder
DomainAppender
Dotbot
Dragonfly
Drip
ECCP/1.0
EMail Siphon
Ebingbong
EroCrawler
Express WebPictures
ExtLinksBot
Extreme Picture Finder
Fimap
Firefox/7.0
Foobot
GT::WWW
GetWeb
Gigabot
GoZilla
Grabber
Grafula
HTMLparser
HTTrack
Haansoft
Heritrix
IDBot
IRLbot
Iblog
Id-search
Image Fetch
Image Sucker
Intelliseek
InterGET
Internet Ninja
InternetSeer
IstellaBot
JOC Web Spider
JamesBOT
Jetty
JikeSpider
JustView
Jyxobot
Kenjin Spider
Kinza
LNSpiderguy
Lanshanbot
LeechFTP
Lftp
Libwhisker
LieBaoFast
Linkdexbot
LinkextractorPro
LinkpadBot
LinksManager
LinqiaScrapeBot
MFC_Tear_Sample
MIIxpc
Majestic12
Masscan
MegaIndex.ru
MicroMessenger
Moblie Safari
Mojolicious
Morfeus Fucking Scanner
NICErsPRO
Nessus
Netcraft
Netvibes
NextGenSearchBot
Nimbostratus
Nmap
Nutch
Octopus
OnCrawl
OpenLinkProfiler
OpenVAS
Openfind
OutclicksBot
OutfoxBot
PHPCrawl
PageAnalyzer
PageScorer
Pavuk
PeoplePal
Petalbot
Pi-Monster
Picscout
PictureFinder
Pimonster
Pockey
Pu_iN
Pump
PyCurl
RankActive
RankActiveLinkBot
RankFlex
ReGet
Reaper
RedesScrapy
RepoMonkey
Ripper
Rogerbot
SEOstats
SISTRIX
SalesIntelligent
ScanAlert
ScoutJet
Scrapy
ScreenerBot
ScrepyBot
Searchestate
SearchmetricsBot
SemrushBot
SeoSiteCheckup
SiteSucker
Siteimprove
Sitevigil
Snoopy
SocialRankIOBot
Sociscraper
Sogou web spider
SpaceBison
SpankBot
Spbot
Sqlworm
Steeler
Stripper
Sucuri
SuperBot
SuperHTTP
Surfbot
T0PHackTeam
Teleport
TeleportPro
The Intraformant
TheNomad
TightTwatBot
Tracemyfile
Trendiction
True_Robot
Turingos
Turnitin
Twice
Typhoeus
V-BOT
Vacuum
VidibleScraper
WEBDAV
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
WallpapersHD
WeSEE
Web Auto
Web Collage
Web Fuck
Web Sauger
WebFetch
WebLeacher
WebWhacker
Webalta
Webster
Whack
Whatweb
WinHTTrack
Wonderbot
Wotbox
Zade
Zeus
ZoomBot
ZoominfoBot
ZumBot
archive.org_bot
arquivo.pt
autoemailspider
cah.io.community
dataforseo.com
demandbase-bot
eCatch
evc-batch
instabid
isitwp.com
meanpathbot
mediawords
netEstate NE Crawler
s1z.ru
seostar
siteripz
spyfu
tAkeOut
trendiction.de
ubermetrics-technologies.com
webmeup-crawler
webprosbot
x09Mozilla
xpymep1.exe