nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-02-23 22:07:12 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404enemy
AIBOT
ALittle Client
AfD-Verbotsverfahren
Aipbot
AllSubmitter
Alligator
Anarchie
Anarchy
Ankit
Aspiegel
BDFetch
BLEXBot
BackWeb
Barkrowler
BatchFTP
Battleztar Bazinga
Bitacle
BlackWidow
Blackboard
Boardreader
BotALot
BuzzSumo
CATExplorador
CCBot
Calculon
CensysInspect
CherryPicker
ChinaClaw
Cloud mapping
Cogentbot
Collector
Copier
Copyscape
Crawling at Home Project
Crescent
CrunchBot
Curious
CyotekWebCopy
DataCha0s
Demon
Deusu
Digincore
Discoverybot
DnBCrawler-Analytics
DomCopBot
DomainStatsBot
Dotbot
Dragonfly
ECCP/1.0
EMail Wolf
EirGrabber
ExtLinksBot
Extractor
ExtractorPro
EyeNetIE
Ezooms
FDM
Fimap
Flunky
Freeuploader
GermCrawler
GetRight
GetWeb
Gigabot
Go-Ahead-Got-It
GoZilla
Grafula
GridBot
Haansoft
Hloader
IDBot
IRLbot
Iblog
Id-search
InfoNaviRobot
InfoTekies
InternetSeer
IstellaBot
Jbrofuzz
JennyBot
JetCar
JustView
LWP::Simple
LexiBot
LibWeb
LieBaoFast
Likse
LinksManager
LinqiaRSSBot
Lipperhey
Lipperhey Spider
Lmspider
MIDown tool
MIIxpc
MJ12bot
MSFrontPage
Magnet
MarkMonitor
Mass Downloader
Mediatoolkitbot
MegaIndex.ru
Microsoft URL Control
Moblie Safari
Mojeek
Mr.4x3
Msrabot
NPbot
Name Intelligence
Navroad
NearSite
Needle
Net Vampire
NetSpider
Nettrack
NimbleCrawler
Nimbostratus
Not
Offline Explorer
OpenLinkProfiler
OpenVAS
Openfind
Openvas
OutclicksBot
OutfoxBot
PageGrabber
PictureFinder
PleaseCrawl
ProWebWalker
Psbot
Pump
RankActive
RankActiveLinkBot
RankFlex
RankingBot
RankingBot2
RealDownload
Reaper
RedesScrapy
RepoMonkey
Ripper
SEOkicks
Screaming
ScrepyBot
SearchmetricsBot
Seekport
SentiBot
SeobilityBot
Seomoz
Site Sucker
SiteExplorer
SiteLockSpider
SlySearch
Snake
Sosospider
SpaceBison
Spanner
SputnikBot
Sqlmap
Sqlworm
Steeler
Sucker
SuperBot
SuperHTTP
Surfbot
SurveyBot
Suzuran
Szukacz
T8Abot
TeleportPro
Telesoft
Telesphoreo
Telesphorep
The Intraformant
TheNomad
Toata
TwengaBot
Typhoeus
URLy Warning
URLy.Warning
VB Project
VCI
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Virusdie
VoidEYE
Voltron
WASALive-Bot
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
WallpapersHD
Web Auto
Web Fuck
Web Pix
WebCopier
WebEnhancer
WebFetch
WebStripper
WebSucker
WebZIP
Webshag
Webster
Whatweb
WiseGuys Robot
Woobot
Wprecon
Xenu
Zauba
Zitebot
ZmEu
ZoominfoBot
ZyBorg
adscanner
arquivo-web-crawler
arquivo.pt
clark-crawler
coccocbot
crawl.sogou.com
crawler4j
dataforseo.com
demandbase-bot
isitwp.com
iubenda-radar
lwp-trivial
pcBrowser
plumanalytics
probe-image-size
ripz
s1z.ru
satoristudio.net
scan.lol
seostar
sexsearcher
sitechecker.pro
siteripz
sogouspider
sp_auditbot
spyfu
trendiction.de
ubermetrics-technologies.com
webgains-bot
webprosbot
zgrab