nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-12-26 10:09:43 +00:00

250 lines
2.6 KiB
Text

01h4x.com
ALittle Client
Aboundex
Acunetix
AiHitBot
AllSubmitter
Alligator
Anarchy
Anthill
Aspiegel
Asterias
AwarioRssBot
BBBike
BackDoorBot
BacklinkCrawler
Badass
Bandit
Barkrowler
BetaBot
Bitacle
BlackWidow
Blow
Boardreader
BotALot
Brandprotect
Brandwatch
Buddy
BuiltWith
BunnySlippers
BuzzSumo
CATExplorador
CCBot
CODE87
Calculon
CensysInspect
CheTeam
ChinaClaw
Claritybot
Cloud mapping
Cocolyzebot
Copier
Copyscape
Cosmos
CyotekWebCopy
DTS Agent
Deusu
Devil
Digincore
DigitalPebble
Dirbuster
Dispatch
DomainCrawler
Download Wonder
ECCP/1.0
EasyDL
Ebingbong
Exabot
ExtLinksBot
FemtosearchBot
Firefox/7.0
FlashGet
Fuzz
FyberSpider
Gigabot
GoZilla
Gotit
Grafula
GrapeshotCrawler
Harvest
Havij
IRLbot
Iblog
Id-search
Image Sucker
InfoTekies
Intelliseek
InternetSeer
Iskanie
IstellaBot
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
JetCar
Joomla
Jorgee
Jyxobot
Kinza
LNSpiderguy
LWP::Simple
Larbin
Libwhisker
LieBaoFast
Lightspeedsystems
Likse
LinkScan
Linkbot
LinqiaMetadataDownloaderBot
Ltx71
MFC_Tear_Sample
MIDown tool
MIIxpc
MQQBrowser
Mag-Net
Majestic12
MarkMonitor
Masscan
MauiBot
Mb2345Browser
Meanpathbot
Mediatoolkitbot
Microsoft Data Access
Microsoft URL Control
Minefield
Mojeek
Mojolicious
Morfeus Fucking Scanner
Musobot
NPbot
Needle
Net Vampire
NetSpider
Netcraft
Nettrack
Netvibes
NextGenSearchBot
Nibbler
Ninja
Nuclei
Nutch
Offline Explorer
Openvas
OutclicksBot
PHPCrawl
PageGrabber
Papa Foto
Pavuk
Petalbot
Pi-Monster
Picscout
PictureFinder
Piepmatz
Pixray
PleaseCrawl
Pockey
ProPowerBot
Psbot
Pump
QueryN Metasearch
Quick-Crawler
RSSingBot
RankingBot
Rankivabot
RankurBot
ReGet
Reaper
RebelMouse
RepoMonkey
Ripper
Rogerbot
SBIder
SEOkicks
SEOlyticsCrawler
SEOprofiler
SMTBot
ScanAlert
Scanbot
Scrapy
Screaming
SemrushBot
Seomoz
Siphon
SiteCheckerBotCrawler
SiteExplorer
Sitevigil
SlySearch
SmartDownload
Snake
Snoopy
Sogou web spider
SpankBot
Spbot
Sqlmap
Sqworm
Steeler
Stripper
Sucuri
Surfbot
Suzuran
T0PHackTeam
Telesoft
TightTwatBot
Toata
Tracemyfile
TwengaBot
Twice
URLy Warning
Upflow
Vacuum
VelenPublicWebCrawler
VoidEYE
WWW-Collector-E
WWW::Mechanize
Wallpapers
Web Collage
Web Fuck
Web Pix
Web Sucker
WebAuto
WebBandit
WebCollage
WebCopier
WebEnhancer
WebFetch
WebFuck
WebGo IS
WebReaper
WebsiteExtractor
Whack
Whacker
Widow
WiseGuys Robot
Xaldon WebSpider
YoudaoBot
Zauba
ZmEu
adscanner
coccocbot-web
crawl.sogou.com
crawler.feedback
demandbase-bot
facebookscraper
heritrix
internetVista monitor
isitwp.com
lwp-request
magpie-crawler
meanpathbot
pcBrowser
polaris version
scalaj-http
seocompany.store
seostar
siteripz
sogouspider
trendiction.de
voyagerx.com
webgains-bot
webprosbot
zgrab