nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-04-03 10:09:33 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
ADmantX
AIBOT
ASPSeek
Abonti
Acunetix
AiHitBot
Aipbot
Alexibot
AllSubmitter
AlphaBot
Anarchy99
Apexoo
Aspiegel
AwarioRssBot
AwarioSmartBot
BBBike
BDCbot
BackStreet
BackWeb
Backlink-Ceck
BacklinkCrawler
Badass
Bandit
BlackWidow
Blackboard
Blow
Bolt
BotALot
BuiltBotTough
BunnySlippers
CATExplorador
CSHttp
Calculon
Cegbfeieh
CensysInspect
ChinaClaw
Chlooe
Cloud mapping
Cocolyzebot
Collector
CopyRightCheck
Cosmos
Craftbot
Crescent
DTS Agent
DatabaseDriverMysqli
Demon
DnyzBot
DomainStatsBot
Download Wonder
EMail Siphon
EasyDL
Exabot
Express WebPictures
FlashGet
FrontPage
Fuzz
Genieo
GermCrawler
GetWeb
Go!Zilla
HEADMasterSEO
HMView
HTMLparser
HTTP::Lite
Haansoft
HaosouSpider
Harvest
Humanlinks
IDBTE4M
IDBot
Iblog
IlseBot
Image Fetch
InterGET
Internet Ninja
JetCar
Joomla
JustView
Kenjin Spider
Keyword Density
LeechFTP
Lftp
Libwhisker
Lightspeedsystems
Linkdexbot
LinqiaMetadataDownloaderBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
MFC_Tear_Sample
MIDown tool
MIIxpc
MJ12bot
MQQBrowser
MSFrontPage
MSIECrawler
MTRobot
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Mass Downloader
Mata Hari
MauiBot
Mb2345Browser
Meanpathbot
Moblie Safari
Mr.4x3
NICErsPRO
NPbot
Nessus
Net Vampire
NetMechanic
NetSpider
NetZIP
Netvibes
NextGenSearchBot
Nibbler
Ninja
Nmap
Nutch
Offline Navigator
OnCrawl
OpenLinkProfiler
OrangeBot
OutfoxBot
PECL::HTTP
PHPCrawl
Page Analyzer
PageAnalyzer
Panscient
Papa Foto
Pavuk
PictureFinder
Pimonster
Pockey
ProPowerBot
Probethenet
PxBroker
PyCurl
Quick-Crawler
RankingBot
RankurBot
ReGet
RealDownload
Reaper
RebelMouse
Recorder
RedesScrapy
Ripper
SBIder
ScanAlert
Scrapy
SemanticJuice
SeoSiteCheckup
SeobilityBot
Site Sucker
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
Siteimprove
SlySearch
Snake
Snapbot
Snoopy
Sociscraper
Sosospider
SputnikBot
Sucuri
Surfbot
Swiftbot
T0PHackTeam
T8Abot
Telesoft
TightTwatBot
Titan
Toata
Trendiction
Turnitin
TwengaBot
URLy Warning
UnisterBot
Upflow
VB Project
Vacuum
Vagabondo
WWW-Mechanize
Wallpapers
WallpapersHD
WeSEE
Web Collage
Web Enhancer
Web Fetch
Web Fuck
Web Sucker
WebCollage
WebCopier
WebFetch
WebFuck
WebGo IS
WebLeacher
WebPix
WebWhacker
Webalta
WebmasterWorldForumBot
WebsiteExtractor
Whacker
Whatweb
Who.is Bot
Wotbox
Wprecon
Zade
Zitebot
ZyBorg
archive.org_bot
arquivo-web-crawler
arquivo.pt
backlink-check
clark-crawler
coccocbot
com.plumanalytics
crawler4j
demandbase-bot
eCatch
gopher
iubenda-radar
lwp-request
magpie-crawler
meanpathbot
page scorer
plumanalytics
polaris version
s1z.ru
satoristudio.net
scalaj-http
seocompany.store
serpstatbot
sitechecker.pro
sogouspider
spyfu
tAkeOut
trendiction.de
voyagerx.com
webmeup-crawler
webprosbot
x09Mozilla
x22Mozilla