nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-11-17 10:09:24 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
ADmantX
ALittle Client
ASPSeek
Aboundex
Aboundexbot
Acunetix
AfD-Verbotsverfahren
Alligator
Anarchie
Anarchy
Aspiegel
Atomseobot
AwarioSmartBot
BDCbot
BDFetch
BackDoorBot
BackWeb
Backlink-Ceck
Badass
BetaBot
Blow
BlowFish
BotALot
Buck
BuiltBotTough
BuiltWith
BunnySlippers
CATExplorador
CCBot
Cegbfeieh
CherryPicker
Citoid
Claritybot
Cliqzbot
Cloud mapping
Copier
CopyRightCheck
Copyscape
Crawling at Home Project
CrazyWebCrawler
Curious
CyotekWebCopy
DIIbot
DSearch
DTS Agent
DataCha0s
DatabaseDriverMysqli
Demon
Devil
Disco
Discobot
DnBCrawler-Analytics
DnyzBot
DomainAppender
Dotbot
Drip
ECCP/1.0
EMail Siphon
EirGrabber
EroCrawler
Evil
Express WebPictures
Firefox/7.0
FlashGet
Foobot
Fuzz
Fyrebot
GalaxyBot
Genieo
Gigabot
Go!Zilla
GrabNet
Grabber
Grafula
GrapeFX
GrapeshotCrawler
GridBot
HTMLparser
HaosouSpider
Humanlinks
IDBTE4M
IDBot
IRLbot
Image Fetch
InfoNaviRobot
InfoTekies
Iskanie
IstellaBot
JamesBOT
JennyBot
Keybot Translation-Search-Machine
Kinza
LNSpiderguy
Leap
Lftp
Libwhisker
Lightspeedsystems
LinkScan
LinkWalker
LinkpadBot
LinqiaRSSBot
Lmspider
MJ12bot
MQQBrowser
MSIECrawler
Mag-Net
Magnet
Majestic12
Mass Downloader
Mata Hari
MauiBot
Meanpathbot
Mediatoolkitbot
MicroMessenger
Mr.4x3
Msrabot
Musobot
NICErsPRO
Needle
Net Vampire
NetZIP
Niki-bot
Nmap
Not
Nuclei
Nutch
Octopus
OpenLinkProfiler
OpenVAS
Openfind
OrangeBot
OutfoxBot
PHPCrawl
POE-Component-Client-HTTP
PageGrabber
PageScorer
PageThing.com
Pandalytics
Panscient
PeoplePal
Piepmatz
Psbot
Pu_iN
PxBroker
PyCurl
QueryN Metasearch
RSSingBot
RankFlex
RankingBot2
Rankivabot
RealDownload
Reaper
Recorder
RedesScrapy
SEOlyticsCrawler
SISTRIX
SMTBot
ScanAlert
Scanbot
ScoutJet
Seekport
SemrushBot
SentiBot
SeoSiteCheckup
Seomoz
Shodan
Site Sucker
SiteLockSpider
Sitebeam
Snapbot
SocialRankIOBot
Sogou web spider
Sottopop
SpaceBison
Spbot
Sqworm
Steeler
Sucker
SuperBot
SurveyBot
Suzuran
Teleport
Telesphoreo
TheNomad
Thumbor
Toweyabot
Tracemyfile
Trendictionbot
TurnitinBot
UnisterBot
Upflow
VB Project
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Voil
WWWOFFLE
Wallpapers/3.0
Web Auto
Web Sauger
WebBandit
WebCopier
WebEnhancer
WebGo IS
WebImageCollector
WebLeacher
WebPix
WebSauger
WebSucker
WebWhacker
Webalta
Website Quester
WebsiteQuester
Whatweb
Who.is Bot
WinHTTrack
WiseGuys Robot
Wonderbot
Wotbox
Xenu
Zade
Zauba
ZumBot
arquivo-web-crawler
arquivo.pt
autoemailspider
clark-crawler
cognitiveseo
crawler4j
dataforseo.com
domainsproject.org
evc-batch
heritrix
instabid
lwp-request
mediawords
probe-image-size
s1z.ru
scalaj-http
seobility
seostar
serpstatbot
trendiction.de
voyagerx.com
webprosbot
x09Mozilla
zauba.io