nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-01-28 22:07:42 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
80legs
AIBOT
ALittle Client
Aboundexbot
Acunetix
Anarchie
Anarchy
Anarchy99
Aspiegel
Asterias
BDFetch
BackDoorBot
BackStreet
BackWeb
BacklinkCrawler
Barkrowler
Battleztar Bazinga
Bitacle
BlackWidow
Blackboard
Blow
BotALot
BuiltWith
BuzzSumo
CATExplorador
Cegbfeieh
CheeseBot
ChinaClaw
Cliqzbot
CopyRightCheck
Copyscape
Crawling at Home Project
CrunchBot
Custo
CyotekWebCopy
DBLBot
DIIbot
DSearch
Demon
DigitalPebble
Dirbuster
Discobot
DnyzBot
DomainAppender
DomainStatsBot
Domains Project
Dragonfly
ECCP/1.0
EMail Siphon
EMail Wolf
EasyDL
Ebingbong
Ecxi
EirGrabber
Evil
Exabot
Ezooms
FDM
FHscan
Fimap
Flunky
Freeuploader
Fyrebot
GT::WWW
GermCrawler
GetWeb
Getintent
Go-Ahead-Got-It
HEADMasterSEO
HaosouSpider
Havij
Heritrix
Hloader
HonoluluBot
IDBTE4M
IRLbot
Image Fetch
Image Sucker
InfoNaviRobot
InterGET
Internet Ninja
IstellaBot
JOC Web Spider
Jetty
Jorgee
Kinza
LNSpiderguy
LWP::Simple
Larbin
Leap
LeechFTP
LeechGet
LexiBot
Lftp
Libwhisker
Lightspeedsystems
Linkbot
Linkdexbot
LinkextractorPro
LinksManager
LinqiaMetadataDownloaderBot
LinqiaRSSBot
Lipperhey
Lmspider
Ltx71
MJ12bot
MQQBrowser
MSFrontPage
Mag-Net
Mail.RU_Bot
Majestic-SEO
Majestic12
MarkMonitor
MauiBot
MegaIndex.ru
MolokaiBot
Mr.4x3
Msrabot
NICErsPRO
Nessus
NetLyzer
NetSpider
Nettrack
Netvibes
NimbleCrawler
Openvas
OutclicksBot
OutfoxBot
PECL::HTTP
Page Analyzer
PageGrabber
PageThing.com
Papa Foto
Petalbot
Picscout
Psbot
Pu_iN
PxBroker
QueryN Metasearch
RankActive
RankActiveLinkBot
RankingBot
Rankivabot
Re-re
Reaper
Ripper
RocketCrawler
Rogerbot
SBIder
SEOkicks
SEOkicks-Robot
ScreenerBot
SearchmetricsBot
SemrushBot
Site Sucker
SiteExplorer
SiteSnagger
Sitebeam
Sitevigil
SmartDownload
Snoopy
Sociscraper
Sosospider
Sottopop
Spanner
Spbot
Sqworm
Steeler
Stripper
Sucker
Sucuri
SuperBot
SuperHTTP
Swiftbot
Teleport
TeleportPro
Telesoft
Telesphoreo
Telesphorep
TightTwatBot
Toata
Toweyabot
Tracemyfile
Turnitin
TurnitinBot
Typhoeus
UnisterBot
VCI
VelenPublicWebCrawler
VidibleScraper
Voil
WBSearchBot
WISENutbot
WWW-Collector-E
WWW::Mechanize
WallpapersHD
Web Collage
Web Enhancer
Web Sauger
Web Sucker
WebAuto
WebBandit
WebCollage
WebEnhancer
WebImageCollector
WebLeacher
WebStripper
WebSucker
WebZIP
Webalta
WebmasterWorldForumBot
WebsiteExtractor
Whacker
WiseGuys Robot
Wprecon
YoudaoBot
Zeus
ZmEu
adscanner
arquivo.pt
cah.io.community
clark-crawler
cognitiveseo
com.plumanalytics
crawl.sogou.com
demandbase-bot
domainsproject.org
gopher
heritrix
isitwp.com
lwp-trivial
magpie-crawler
meanpathbot
mediawords
netEstate NE Crawler
plumanalytics
probe-image-size
scalaj-http
scan.lol
seoscanners
seostar
serpstatbot
siteripz
sogouspider
sp_auditbot
ubermetrics-technologies.com
x22Mozilla
zgrab