nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-04 22:07:09 +00:00

250 lines
2.6 KiB
Text

404checker
ADmantX
ALittle Client
Abonti
Aboundexbot
AiHitBot
Alexibot
Alligator
AlphaBot
Anarchy
Apexoo
Attach
AwarioRssBot
AwarioSmartBot
BDFetch
BLEXBot
BackWeb
BacklinkCrawler
Badass
Bandit
BatchFTP
BetaBot
Black Hole
BlowFish
Bolt
BotALot
Brandprotect
Buck
BunnySlippers
BuzzSumo
Cegbfeieh
CheTeam
ChinaClaw
Citoid
Cocolyzebot
Cogentbot
Cosmos
Craftbot
Crawling at Home Project
Curious
Custo
DatabaseDriverMysqli
Discobot
DomainAppender
DomainSigmaCrawler
Dotbot
Dragonfly
EMail Wolf
EirGrabber
EroCrawler
Exabot
Express WebPictures
ExtLinksBot
ExtractorPro
EyeNetIE
FHscan
FemtosearchBot
Fimap
FlashGet
Fuzz
GT::WWW
GrabNet
GrapeFX
GridBot
HTMLparser
HTTrack
Haansoft
HaosouSpider
Heritrix
Hloader
HonoluluBot
Humanlinks
IlseBot
Image Fetch
Image Sucker
Intelliseek
InterGET
Iria
IstellaBot
JOC Web Spider
JamesBOT
JennyBot
JikeSpider
Joomla
Jorgee
JustView
Keybot Translation-Search-Machine
Keyword Density
LWP::Simple
LexiBot
Likse
LinkScan
Linkbot
Lipperhey
Lmspider
Ltx71
MIDown tool
MIIxpc
MQQBrowser
MSFrontPage
MSIECrawler
MTRobot
Mail.RU_Bot
Majestic-SEO
Majestic12
Mass Downloader
Mata Hari
Meanpathbot
MicroMessenger
Microsoft Data Access
Microsoft URL Control
Minefield
Mister PiX
Moblie Safari
Mr.4x3
Musobot
NPbot
Needle
NetLyzer
NetZIP
Nettrack
Nikto
Nimbostratus
Ninja
Offline Explorer
OnCrawl
Openvas
OutclicksBot
PECL::HTTP
Page Analyzer
PageAnalyzer
PageThing.com
Panscient
Papa Foto
Pavuk
PeoplePal
Picscout
Picsearch
PictureFinder
Pimonster
Psbot
Pu_iN
Pump
PxBroker
QueryN Metasearch
RankActive
RankActiveLinkBot
RankingBot
Rankivabot
Re-re
Reaper
Recorder
Rogerbot
SEOkicks-Robot
SISTRIX
SearchmetricsBot
Seekport
SemanticJuice
SemrushBot
SeoSiteCheckup
SiteExplorer
SiteSnagger
SiteSucker
Sitebeam
Snoopy
Sociscraper
Sottopop
SpaceBison
Spammen
SpankBot
Sqworm
Steeler
Sucker
Swiftbot
Szukacz
T8Abot
Teleport
TeleportPro
Telesoft
Telesphorep
The Intraformant
TheNomad
TightTwatBot
Trendiction
True_Robot
Turingos
Turnitin
Twice
Upflow
V-BOT
VB Project
VCI
VeriCiteCrawler
Virusdie
VoidEYE
Voltron
WPScan
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Wallpapers/3.0
Web Enhancer
Web Fetch
Web Sauger
WebAuto
WebCollage
WebCopier
WebEnhancer
WebFetch
WebImageCollector
WebLeacher
WebPix
WebZIP
Webster
Who.is Bot
Wonderbot
Xaldon WebSpider
YoudaoBot
Zermelo
Zitebot
ZoomBot
ZoominfoBot
ZyBorg
arquivo-web-crawler
arquivo.pt
check1.exe
clark-crawler
coccocbot
com.plumanalytics
crawler.feedback
dataforseo.com
demandbase-bot
facebookscraper
heritrix
instabid
iubenda-radar
magpie-crawler
meanpathbot
probe-image-size
satoristudio.net
scan.lol
seobility
sitechecker.pro
siteripz
spyfu
trendiction.com
trendiction.de
xpymep1.exe
zauba.io
zgrab