nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-09-14 10:09:14 +00:00

250 lines
2.6 KiB
Text

01h4x.com
360Spider
404checker
80legs
ADmantX
ALittle Client
Abonti
Aboundex
Acunetix
AiHitBot
Alexibot
AllSubmitter
Alligator
AlphaBot
Aspiegel
Asterias
Atomseobot
AwarioSmartBot
BDCbot
BLEXBot
Backlink-Ceck
BacklinkCrawler
Battleztar Bazinga
Black Hole
Blow
Bolt
Brandwatch
BuiltBotTough
BuiltWith
BunnySlippers
CATExplorador
CODE87
CensysInspect
CheeseBot
Chlooe
Cloud mapping
Cocolyzebot
Cogentbot
CrunchBot
Custo
CyotekWebCopy
DBLBot
DSearch
DTS Agent
Deusu
Digincore
Dirbuster
Discobot
Dispatch
DittoSpyder
DnyzBot
DomCopBot
Download Wonder
Dragonfly
Drip
Ecxi
Exabot
ExtLinksBot
Extreme Picture Finder
FDM
FHscan
FyberSpider
Genieo
GermCrawler
Gigabot
GoZilla
Gotit
Grabber
Grafula
GrapeFX
HEADMasterSEO
HMView
HTMLparser
HTTP::Lite
HTTrack
Haansoft
HaosouSpider
Havij
Hloader
HonoluluBot
IlseBot
InterGET
InternetSeer
Iskanie
JOC Web Spider
JetCar
JikeSpider
JustView
Keyword Density
Kinza
Kozmosbot
LNSpiderguy
LeechFTP
LibWeb
Linkbot
LinkpadBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
Ltx71
MFC_Tear_Sample
MQQBrowser
MSFrontPage
MTRobot
Mag-Net
Mail.RU_Bot
Majestic SEO
MarkMonitor
MarkWatch
Mass Downloader
MeanPath Bot
Meanpathbot
MegaIndex.ru
MicroMessenger
Microsoft Data Access
Minefield
Mister PiX
MolokaiBot
Mozlila
Musobot
Name Intelligence
NearSite
Needle
NetLyzer
NetZIP
Netcraft
Nettrack
NextGenSearchBot
Niki-bot
Nimbostratus
Ninja
Nuclei
Nutch
Offline Navigator
Openfind
Openvas
OrangeBot
OrangeSpider
OutclicksBot
OutfoxBot
PECL::HTTP
PageGrabber
PageThing.com
Pandalytics
PeoplePal
Picscout
PictureFinder
Pixray
Pockey
PxBroker
QueryN Metasearch
RankActive
RankActiveLinkBot
RankingBot
RankingBot2
Rankivabot
ReGet
RedesScrapy
RepoMonkey
SEOkicks-Robot
SEOstats
ScanAlert
Scrapy
ScreenerBot
SearchmetricsBot
SentiBot
SeobilityBot
Site Sucker
SiteCheckerBotCrawler
Sitevigil
SmartDownload
Snake
Snoopy
Sogou web spider
SpaceBison
Spammen
SpankBot
Spbot
Sqlmap
Sqworm
Surfbot
Swiftbot
T8Abot
TeleportPro
TurnitinBot
Twice
Typhoeus
URLy.Warning
UnisterBot
VB Project
Vagabondo
VelenPublicWebCrawler
VeriCiteCrawler
Voltron
WEBDAV
WISENutbot
WWW-Collector-E
WWW-Mechanize
WWW::Mechanize
Web Collage
Web Fuck
WebAuto
WebBandit
WebFetch
WebGo IS
WebPix
WebStripper
WebSucker
Website Quester
WebsiteExtractor
Whack
Whacker
Whatweb
Who.is Bot
Woobot
Wotbox
Xaldon WebSpider
Zade
Zauba
ZumBot
arquivo.pt
autoemailspider
backlink-check
check1.exe
com.plumanalytics
crawler4j
domainsproject.org
evc-batch
facebookscraper
gopher
mediawords
muhstik-scan
netEstate NE Crawler
oBot
polaris version
ripz
s1z.ru
scalaj-http
seobility
sexsearcher
sitechecker.pro
sogouspider
sysscan
trendiction.com
webmeup-crawler
webprosbot
x22Mozilla
xpymep1.exe
zauba.io
zgrab