nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-19 22:07:14 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
ASPSeek
Abonti
Aboundex
Acunetix
Aipbot
Alligator
AlphaBot
Anarchie
Anarchy
Aspiegel
Asterias
Atomseobot
AwarioSmartBot
BackDoorBot
Backlink-Ceck
Barkrowler
Battleztar Bazinga
Blackboard
BlowFish
BotALot
Buck
CATExplorador
CSHttp
CheTeam
Chlooe
Citoid
Claritybot
Collector
Craftbot
Curious
DBLBot
DIIbot
DTS Agent
Digincore
DigitalPebble
Disco
Discobot
Discoverybot
Dispatch
DomCopBot
DomainSigmaCrawler
Download Wonder
ECCP/1.0
EMail Wolf
EasyDL
Ebingbong
Evil
Ezooms
FDM
FemtosearchBot
Fimap
FlashGet
FrontPage
G-i-g-a-b-o-t
GT::WWW
GetRight
Gigabot
GoZilla
GrabNet
Grabber
GrapeFX
GrapeshotCrawler
HTMLparser
Harvest
Heritrix
Hloader
HonoluluBot
IDBot
IlseBot
Image Fetch
Image Sucker
Indy Library
InfoNaviRobot
Intelliseek
JOC Web Spider
JamesBOT
Jbrofuzz
Joomla
JustView
Kenjin Spider
Kinza
LWP::Simple
Larbin
Leap
Libwhisker
LieBaoFast
Lightspeedsystems
Linkbot
LinkpadBot
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
Ltx71
MFC_Tear_Sample
MJ12bot
MTRobot
Mag-Net
Mass Downloader
Mata Hari
Mb2345Browser
Meanpathbot
MegaIndex.ru
Mojeek
Morfeus Fucking Scanner
Musobot
NPbot
Nameprotect
NetAnts
NetMechanic
NextGenSearchBot
Nibbler
Niki-bot
NimbleCrawler
Nmap
Nutch
OpenLinkProfiler
OpenVAS
Openvas
OutclicksBot
PECL::HTTP
PHPCrawl
POE-Component-Client-HTTP
PageGrabber
Panscient
Pavuk
PeoplePal
Pi-Monster
PictureFinder
Pimonster
Pixray
PleaseCrawl
Pockey
ProWebWalker
PxBroker
Quick-Crawler
RankActive
Rankivabot
ReGet
RealDownload
RedesScrapy
Ripper
SEOkicks
SEOkicks-Robot
SEOstats
SISTRIX
SMTBot
Scanbot
ScoutJet
Searchestate
Semrush
SemrushBot
SentiBot
SeobilityBot
Shodan
Siphon
Site Sucker
SiteLockSpider
SiteSnagger
Siteimprove
Sitevigil
SlySearch
Snake
SocialRankIOBot
Sogou web spider
Sottopop
SpaceBison
Spammen
SpankBot
Spbot
Spinn3r
SputnikBot
SuperBot
Suzuran
Swiftbot
Szukacz
T8Abot
Teleport
Telesphoreo
Telesphorep
Thumbor
Tracemyfile
True_Robot
Turingos
Typhoeus
URLy.Warning
VB Project
VCI
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
VoidEYE
Voil
Voltron
WWW-Mechanize
WWWOFFLE
WeSEE
Web Auto
Web Collage
Web Pix
WebBandit
WebEnhancer
WebGo IS
WebPix
WebSucker
WebZIP
Webshag
Website Quester
WebsiteExtractor
WebsiteQuester
Whatweb
Who.is Bot
WinHTTrack
WiseGuys Robot
Zauba
Zitebot
ZoomBot
ZoominfoBot
ZumBot
arquivo-web-crawler
arquivo.pt
cah.io.community
cognitiveseo
com.plumanalytics
crawler.feedback
crawler4j
demandbase-bot
eCatch
evc-batch
heritrix
internetVista monitor
ips-agent
lwp-trivial
muhstik-scan
netEstate NE Crawler
oBot
page scorer
plumanalytics
polaris version
probe-image-size
satoristudio.net
scalaj-http
seobility
trendiction.de
webgains-bot
x09Mozilla
zgrab