nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-01-03 22:07:13 +00:00

250 lines
2.6 KiB
Text

404enemy
80legs
ALittle Client
Aboundexbot
Aipbot
Alexibot
Anthill
Atomseobot
AwarioRssBot
AwarioSmartBot
BBBike
BDFetch
BackDoorBot
BatchFTP
Battleztar Bazinga
BetaBot
Bitacle
Blackboard
Blow
Boardreader
BotALot
Brandwatch
Buck
Buddy
BuzzSumo
CATExplorador
CCBot
CODE87
CensysInspect
CheTeam
CherryPicker
ChinaClaw
Cliqzbot
Cocolyzebot
CopyRightCheck
Craftbot
CrazyWebCrawler
Crescent
Curious
DBLBot
DSearch
DTS Agent
DatabaseDriverMysqli
DigitalPebble
Dirbuster
DnyzBot
Domains Project
EMail Wolf
Ebingbong
Ecxi
EroCrawler
Express WebPictures
ExtLinksBot
Extractor
FemtosearchBot
Fimap
Freeuploader
FyberSpider
G-i-g-a-b-o-t
Genieo
GetWeb
Getintent
GoZilla
GrabNet
Grafula
GrapeFX
HMView
HTMLparser
HonoluluBot
IDBTE4M
Image Fetch
IndeedBot
Intelliseek
JamesBOT
JennyBot
Jetty
Joomla
Jorgee
JustView
Kenjin Spider
Kozmosbot
Lanshanbot
Larbin
Leap
LibWeb
LieBaoFast
Lightspeedsystems
Likse
LinkextractorPro
LinksManager
LinqiaRSSBot
Lipperhey
Lipperhey Spider
Litemage_walker
Lmspider
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
Majestic SEO
MarkMonitor
Mass Downloader
Masscan
Mata Hari
MauiBot
Mb2345Browser
MeanPath Bot
Meanpathbot
Metauri
Microsoft URL Control
Mister PiX
Mojolicious
Morfeus Fucking Scanner
Mozlila
Mr.4x3
Musobot
NPbot
Navroad
NearSite
Needle
Net Vampire
NetZIP
Netvibes
Nibbler
Niki-bot
Nimbostratus
Openvas
OrangeBot
OutfoxBot
PageAnalyzer
PageGrabber
PageScorer
PageThing.com
Papa Foto
PeoplePal
Petalbot
Picsearch
Piepmatz
Pimonster
Pixray
Pockey
PyCurl
QueryN Metasearch
Rankivabot
Re-re
Reaper
RebelMouse
Recorder
RepoMonkey
RocketCrawler
Rogerbot
SEOkicks-Robot
SEOlyticsCrawler
SEOstats
SISTRIX
ScanAlert
Scanbot
ScoutJet
Scrapy
Screaming
ScreenerBot
ScrepyBot
Semrush
SemrushBot
SentiBot
SeoSiteCheckup
SeobilityBot
Siphon
SiteSnagger
SmartDownload
Snoopy
SocialRankIOBot
Sociscraper
SpaceBison
Spammen
SpankBot
Sqlmap
Sqlworm
Steeler
Stripper
Surfbot
Szukacz
T8Abot
TeleportPro
Toata
Toweyabot
TurnitinBot
TwengaBot
URLy Warning
Upflow
VeriCiteCrawler
VidibleScraper
Virusdie
Voil
Voltron
WWW-Collector-E
WWWOFFLE
Wallpapers
WeSEE
Web Auto
Web Collage
Web Enhancer
Web Sucker
WebCopier
WebWhacker
Webalta
WebmasterWorldForumBot
WebsiteQuester
Whatweb
WiseGuys Robot
Wotbox
YoudaoBot
Zade
Zauba
Zermelo
Zitebot
ZmEu
ZoominfoBot
backlink-check
cah.io.community
check1.exe
clark-crawler
cognitiveseo
dataforseo.com
demandbase-bot
domainsproject.org
heritrix
instabid
ips-agent
isitwp.com
iubenda-radar
lwp-trivial
meanpathbot
oBot
page scorer
plumanalytics
s1z.ru
satoristudio.net
scan.lol
seobility
seocompany.store
spyfu
sysscan
tAkeOut
trendiction.com
trendiction.de
webgains-bot
webmeup-crawler
x09Mozilla
x22Mozilla