nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-02-02 22:07:28 +00:00

250 lines
2.6 KiB
Text

01h4x.com
ADmantX
ALittle Client
Acunetix
Aipbot
AlphaBot
Ankit
Attach
AwarioSmartBot
BDCbot
BackDoorBot
BacklinkCrawler
BatchFTP
Battleztar Bazinga
Bigfoot
Blackboard
BlowFish
Buck
BuiltBotTough
BuiltWith
BuzzSumo
Cegbfeieh
CheTeam
CheeseBot
ChinaClaw
Chlooe
Cliqzbot
Cloud mapping
Cogentbot
CopyRightCheck
Crawling at Home Project
CrazyWebCrawler
Curious
DIIbot
Devil
Digincore
Dirbuster
Disco
DittoSpyder
DnyzBot
DomainAppender
Domains Project
Download Wonder
Dragonfly
EMail Wolf
EasyDL
Ebingbong
ExtLinksBot
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms
FDM
Fimap
Firefox/7.0
Flunky
FyberSpider
GT::WWW
Genieo
GermCrawler
Getintent
Go!Zilla
Go-Ahead-Got-It
Grafula
GrapeFX
GrapeshotCrawler
HTMLparser
Haansoft
Harvest
Heritrix
Hloader
HybridBot
IDBTE4M
Id-search
IlseBot
Image Fetch
IndeedBot
Indy Library
InternetSeer
Iria
Iskanie
IstellaBot
JamesBOT
JennyBot
Jetty
JikeSpider
Kenjin Spider
LeechGet
LibWeb
Lightspeedsystems
Likse
LinkScan
LinkWalker
LinkpadBot
LinqiaRSSBot
Lmspider
MFC_Tear_Sample
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
Mail.RU_Bot
Majestic12
MarkMonitor
MarkWatch
Masscan
MauiBot
MeanPath Bot
Meanpathbot
MegaIndex.ru
Minefield
Mister PiX
Mojeek
Mojolicious
Msrabot
NICErsPRO
Name Intelligence
Nameprotect
Net Vampire
NetAnts
NetLyzer
NetSpider
Nettrack
Niki-bot
NimbleCrawler
Nimbostratus
Ninja
Offline Navigator
OpenLinkProfiler
OutfoxBot
PHPCrawl
Panscient
Pavuk
Pixray
Probethenet
Pump
PxBroker
PyCurl
QueryN Metasearch
RSSingBot
RankActive
RankingBot2
RankurBot
Reaper
RepoMonkey
Ripper
SEOlyticsCrawler
SISTRIX
SMTBot
ScanAlert
Scanbot
ScoutJet
Scrapy
ScrepyBot
Seekport
SemanticJuice
SemrushBot
Shodan
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SlySearch
SmartDownload
Sogou web spider
Sottopop
Spammen
Spbot
Sqlworm
Sqworm
Steeler
SurveyBot
Suzuran
Teleport
Telesphoreo
Telesphorep
The Intraformant
Thumbor
TightTwatBot
Toata
Trendiction
Trendictionbot
TurnitinBot
Upflow
V-BOT
VB Project
Voil
Voltron
WEBDAV
WISENutbot
WPScan
WWW-Collector-E
WWW-Mechanize
WWWOFFLE
Wallpapers
Wallpapers/3.0
WallpapersHD
Web Auto
Web Collage
Web Sucker
WebBandit
WebFetch
WebFuck
WebPix
WebSauger
WebStripper
WebSucker
Webalta
Whack
Widow
Wonderbot
Woobot
Wprecon
Xaldon WebSpider
Zitebot
ZmEu
ZyBorg
arquivo-web-crawler
arquivo.pt
backlink-check
clark-crawler
dataforseo.com
domainsproject.org
eCatch
facebookscraper
gopher
heritrix
ips-agent
iubenda-radar
lwp-request
lwp-trivial
muhstik-scan
netEstate NE Crawler
page scorer
probe-image-size
ripz
scalaj-http
scan.lol
seocompany.store
seostar
serpstatbot
sexsearcher
sitechecker.pro
sogouspider
tAkeOut
trendiction.com
trendiction.de
webpros.com
x09Mozilla
xpymep1.exe