nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-12 22:07:17 +00:00

250 lines
2.7 KiB
Text

404checker
AIBOT
AiHitBot
AlphaBot
Anarchy99
Ankit
Apexoo
AwarioSmartBot
BBBike
BackDoorBot
BackWeb
BacklinkCrawler
Barkrowler
BatchFTP
Battleztar Bazinga
Bitacle
BlackWidow
Blow
BuiltWith
BunnySlippers
CATExplorador
CensysInspect
CheTeam
CheeseBot
CherryPicker
Citoid
Cloud mapping
Cocolyzebot
Cogentbot
Copier
CopyRightCheck
Cosmos
Craftbot
CrunchBot
Custo
DIIbot
DataCha0s
DatabaseDriverMysqli
Demon
Devil
Disco
Discobot
Discoverybot
DnBCrawler-Analytics
DomainAppender
Dragonfly
Drip
Ebingbong
Ecxi
Evil
Express WebPictures
Extractor
ExtractorPro
Extreme Picture Finder
EyeNetIE
Ezooms
FDM
FemtosearchBot
FrontPage
FyberSpider
Fyrebot
G-i-g-a-b-o-t
GetWeb
Getintent
GoZilla
GrapeshotCrawler
HEADMasterSEO
HTMLparser
HaosouSpider
Heritrix
Humanlinks
IRLbot
IlseBot
Image Fetch
Indy Library
InfoTekies
Intelliseek
InternetSeer
IstellaBot
Jbrofuzz
JetCar
Jorgee
Jyxobot
Kinza
Lanshanbot
Larbin
LeechFTP
Libwhisker
Lightspeedsystems
Likse
LinkScan
Linkbot
Linkdexbot
LinkextractorPro
LinksManager
LinqiaScrapeBot
Lipperhey Spider
Ltx71
MFC_Tear_Sample
MIDown tool
MQQBrowser
MSFrontPage
MSIECrawler
Mag-Net
Magnet
Mail.RU_Bot
Majestic-SEO
MarkWatch
Mass Downloader
Mediatoolkitbot
MicroMessenger
Mr.4x3
NPbot
Name Intelligence
Netvibes
Niki-bot
Nimbostratus
Nmap
Offline Explorer
OpenVAS
OutfoxBot
PECL::HTTP
POE-Component-Client-HTTP
Page Analyzer
Pandalytics
Panscient
Petalbot
Picscout
Picsearch
PictureFinder
Pimonster
Pockey
ProWebWalker
Pu_iN
Pump
RankActive
RankFlex
Re-re
Reaper
Recorder
RedesScrapy
RocketCrawler
Rogerbot
SBIder
SEOkicks
SEOkicks-Robot
SEOprofiler
SEOstats
SISTRIX
SalesIntelligent
ScanAlert
ScoutJet
Scrapy
Screaming
ScreenerBot
ScrepyBot
Searchestate
SentiBot
SeoSiteCheckup
Shodan
SiteCheckerBotCrawler
SiteExplorer
Siteimprove
Sitevigil
SlySearch
SmartDownload
Snapbot
Snoopy
SocialRankIOBot
Sociscraper
SpaceBison
Spammen
SpankBot
Stripper
Teleport
The Intraformant
Tracemyfile
Trendiction
True_Robot
Turingos
Turnitin
URLy Warning
Upflow
Vacuum
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
VidibleScraper
Virusdie
Voil
WISENutbot
WWW-Collector-E
WWW::Mechanize
WWWOFFLE
WeSEE
Web Collage
Web Enhancer
Web Fetch
WebCollage
WebEnhancer
WebGo IS
WebReaper
WebSauger
WebSucker
Webshag
Website Quester
WebsiteExtractor
WebsiteQuester
Whack
Whacker
Whatweb
Who.is Bot
Widow
WinHTTrack
Wonderbot
Woobot
Xaldon WebSpider
Xenu
YoudaoBot
Zade
ZyBorg
backlink-check
clark-crawler
coccocbot-web
demandbase-bot
domainsproject.org
evc-batch
facebookscraper
gopher
instabid
ips-agent
isitwp.com
lwp-trivial
magpie-crawler
meanpathbot
mediawords
muhstik-scan
pcBrowser
scalaj-http
scan.lol
seobility
seoscanners
sogouspider
sp_auditbot
sysscan
tAkeOut
webgains-bot
webpros.com
webprosbot
xpymep1.exe