nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-09-12 22:07:13 +00:00

250 lines
2.6 KiB
Text

360Spider
404checker
404enemy
ALittle Client
ASPSeek
Aboundexbot
Acunetix
Alligator
Anarchy
Ankit
Anthill
Asterias
Attach
BDFetch
BackStreet
Backlink-Ceck
Battleztar Bazinga
BetaBot
Bitacle
Boardreader
Brandprotect
Buddy
BuiltBotTough
BuiltWith
BunnySlippers
BuzzSumo
CATExplorador
CSHttp
Cegbfeieh
CherryPicker
Chlooe
Cliqzbot
Cogentbot
Collector
Craftbot
Crawling at Home Project
CrazyWebCrawler
Crescent
Custo
DIIbot
DatabaseDriverMysqli
Deusu
Digincore
DigitalPebble
DittoSpyder
DnBCrawler-Analytics
DomainStatsBot
Domains Project
Drip
ECCP/1.0
EMail Siphon
EMail Wolf
EasyDL
Exabot
ExtLinksBot
EyeNetIE
Fimap
FlashGet
FyberSpider
G-i-g-a-b-o-t
GalaxyBot
Gigabot
Go!Zilla
Go-Ahead-Got-It
GrabNet
GridBot
HTTrack
Haansoft
Harvest
Hloader
Humanlinks
IDBot
IlseBot
Image Fetch
Image Sucker
InfoTekies
JamesBOT
JennyBot
Jorgee
Jyxobot
Keybot Translation-Search-Machine
Kinza
Kozmosbot
Leap
LeechFTP
LeechGet
LibWeb
Libwhisker
LieBaoFast
Lightspeedsystems
LinkScan
LinkWalker
LinkpadBot
LinqiaMetadataDownloaderBot
Litemage_walker
Lmspider
Ltx71
MFC_Tear_Sample
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
Mag-Net
Majestic SEO
Majestic12
MarkWatch
Masscan
MauiBot
Metauri
MicroMessenger
Minefield
Mister PiX
Mojeek
Morfeus Fucking Scanner
Msrabot
Musobot
Name Intelligence
NearSite
Nessus
Net Vampire
NetAnts
Netcraft
NextGenSearchBot
Nmap
Nuclei
Nutch
Octopus
Offline Navigator
OnCrawl
Openfind
OrangeBot
PHPCrawl
Papa Foto
Pavuk
Petalbot
Picsearch
PictureFinder
Pockey
ProWebWalker
Pu_iN
QueryN Metasearch
Quick-Crawler
RSSingBot
RankFlex
RankingBot2
Re-re
ReGet
RealDownload
Reaper
RedesScrapy
Ripper
RocketCrawler
Rogerbot
SEOlyticsCrawler
SalesIntelligent
Scanbot
Scrapy
Screaming
ScreenerBot
ScrepyBot
SemanticJuice
SeoSiteCheckup
Seomoz
SiteExplorer
SiteLockSpider
SiteSnagger
Sitebeam
SlySearch
Sottopop
Spbot
Spinn3r
Sqlworm
Sqworm
Stripper
Sucker
SuperBot
SurveyBot
T8Abot
Teleport
TeleportPro
Telesoft
The Intraformant
Titan
Toata
Trendiction
Trendictionbot
True_Robot
TurnitinBot
TwengaBot
Twice
UnisterBot
VeriCiteCrawler
Voil
WASALive-Bot
WBSearchBot
WEBDAV
WISENutbot
WPScan
Wallpapers
WallpapersHD
WeSEE
Web Sauger
WebAuto
WebImageCollector
WebLeacher
WebReaper
WebStripper
WebSucker
WebZIP
Webalta
WebmasterWorldForumBot
Webshag
Webster
Whatweb
WinHTTrack
Woobot
Wprecon
Xaldon_WebSpider
Xenu
YoudaoBot
Zermelo
Zitebot
ZyBorg
arquivo-web-crawler
autoemailspider
cognitiveseo
crawler.feedback
crawler4j
dataforseo.com
demandbase-bot
evc-batch
instabid
ips-agent
isitwp.com
iubenda-radar
linkdexbot
lwp-request
magpie-crawler
muhstik-scan
oBot
page scorer
plumanalytics
polaris version
probe-image-size
satoristudio.net
seostar
sitechecker.pro
webmeup-crawler
webprosbot
xpymep1.exe