nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-05 22:07:14 +00:00

250 lines
2.6 KiB
Text

AIBOT
ALittle Client
Aboundex
AfD-Verbotsverfahren
Aipbot
Alexibot
Alligator
AlphaBot
Anarchie
Anthill
AwarioSmartBot
BBBike
BDFetch
BackWeb
BetaBot
Bigfoot
BlackWidow
BlowFish
Boardreader
Bolt
BotALot
BuiltBotTough
CODE87
CSHttp
CazoodleBot
Chlooe
Citoid
Claritybot
Cogentbot
Collector
Copier
CopyRightCheck
Copyscape
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
CrunchBot
Curious
Custo
DBLBot
DIIbot
DSearch
DTS Agent
DataCha0s
DatabaseDriverMysqli
Deusu
Dirbuster
DittoSpyder
DomainCrawler
DomainSigmaCrawler
Download Wonder
Dragonfly
ECCP/1.0
EasyDL
Ebingbong
EirGrabber
Evil
Express WebPictures
Extractor
Extreme Picture Finder
FDM
FemtosearchBot
FlashGet
Flunky
FrontPage
Fuzz
FyberSpider
G-i-g-a-b-o-t
GetRight
GetWeb
Go!Zilla
GoZilla
GrabNet
Grabber
HEADMasterSEO
HMView
HaosouSpider
Havij
Heritrix
Humanlinks
IDBTE4M
Iblog
Id-search
Image Sucker
InternetSeer
JOC Web Spider
JamesBOT
Jbrofuzz
JikeSpider
Jyxobot
Kenjin Spider
Kinza
Kozmosbot
Larbin
Libwhisker
LinkScan
LinksManager
LinqiaRSSBot
Lipperhey
Ltx71
MSFrontPage
Magnet
Mail.RU_Bot
Majestic SEO
Majestic12
MauiBot
Mb2345Browser
Mediatoolkitbot
MegaIndex.ru
Metauri
Minefield
Mister PiX
Mojeek
Mozlila
Mr.4x3
Name Intelligence
Needle
Net Vampire
Netcraft
Nettrack
Netvibes
Nibbler
Niki-bot
Nikto
Ninja
Octopus
Offline Explorer
Offline Navigator
OnCrawl
OrangeBot
PECL::HTTP
PHPCrawl
PageScorer
Pandalytics
Picsearch
PleaseCrawl
ProWebWalker
Probethenet
Psbot
Pu_iN
PxBroker
RSSingBot
RankActive
RankActiveLinkBot
RankingBot2
Re-re
ReGet
Recorder
RocketCrawler
SEOkicks
SEOlyticsCrawler
SalesIntelligent
Scrapy
ScrepyBot
Seekport
SemanticJuice
SemrushBot
SeoSiteCheckup
SeobilityBot
Siphon
SiteCheckerBotCrawler
Snapbot
Snoopy
SocialRankIOBot
Sogou web spider
Sosospider
Spammen
SpankBot
Spinn3r
SputnikBot
Sqworm
Sucker
Sucuri
SuperBot
Surfbot
SurveyBot
T8Abot
Teleport
TheNomad
Thumbor
Toweyabot
Tracemyfile
Trendiction
Trendictionbot
True_Robot
TurnitinBot
TwengaBot
Typhoeus
V-BOT
VCI
Vacuum
VelenPublicWebCrawler
Voil
WBSearchBot
WISENutbot
WWWOFFLE
WallpapersHD
WeSEE
Web Collage
Web Enhancer
Web Fuck
Web Sauger
WebAuto
WebBandit
WebCollage
WebFetch
WebLeacher
WebPix
WebReaper
WebSauger
WebStripper
WebSucker
Whack
Whatweb
Who.is Bot
Widow
Wonderbot
Wotbox
Xaldon_WebSpider
Zade
Zauba
Zitebot
ZoomBot
arquivo-web-crawler
autoemailspider
backlink-check
cah.io.community
cognitiveseo
dataforseo.com
eCatch
heritrix
instabid
isitwp.com
lwp-trivial
muhstik-scan
oBot
page scorer
pcBrowser
polaris version
probe-image-size
seoscanners
serpstatbot
sitechecker.pro
siteripz
webgains-bot
webmeup-crawler
webprosbot
x09Mozilla
xpymep1.exe