nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-09-27 22:07:14 +00:00

250 lines
2.7 KiB
Text

01h4x.com
404enemy
80legs
ALittle Client
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Alexibot
AlphaBot
Anarchie
Ankit
Asterias
Attach
AwarioSmartBot
BackDoorBot
Backlink-Ceck
BacklinkCrawler
Badass
Bandit
Barkrowler
Bigfoot
Blackboard
BlowFish
Boardreader
BuiltBotTough
BuiltWith
BunnySlippers
CSHttp
ChinaClaw
Cliqzbot
Cogentbot
CopyRightCheck
CyotekWebCopy
DIIbot
Devil
Dirbuster
Disco
Discobot
Discoverybot
Dispatch
DomCopBot
Download Wonder
Drip
ECCP/1.0
EMail Siphon
EirGrabber
Exabot
Express WebPictures
Ezooms
FDM
FHscan
FemtosearchBot
FlashGet
Foobot
Freeuploader
FyberSpider
Fyrebot
G-i-g-a-b-o-t
Genieo
GermCrawler
GetRight
GetWeb
Getintent
GoZilla
GrabNet
Grafula
GrapeFX
GrapeshotCrawler
HMView
HTTP::Lite
HTTrack
HaosouSpider
Harvest
Humanlinks
HybridBot
IDBTE4M
IRLbot
Image Sucker
IndeedBot
InfoTekies
Iria
IstellaBot
JOC Web Spider
Jbrofuzz
Joomla
Jorgee
Jyxobot
Keyword Density
Kozmosbot
Larbin
LeechFTP
LexiBot
Lftp
LibWeb
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
Lipperhey
Litemage_walker
Ltx71
MIIxpc
MQQBrowser
MSFrontPage
MSIECrawler
Mail.RU_Bot
Majestic12
MarkWatch
Mata Hari
MeanPath Bot
Mediatoolkitbot
MegaIndex.ru
MicroMessenger
Microsoft URL Control
Moblie Safari
Morfeus Fucking Scanner
Msrabot
Nessus
Netvibes
NextGenSearchBot
Niki-bot
Nikto
Nuclei
Nutch
Offline Explorer
Offline Navigator
OpenLinkProfiler
OpenVAS
Openvas
OrangeBot
OutfoxBot
PECL::HTTP
PageAnalyzer
PageGrabber
PageThing.com
Picscout
Piepmatz
Pimonster
PleaseCrawl
Pockey
Psbot
PxBroker
QueryN Metasearch
RankingBot2
Rankivabot
RankurBot
Re-re
RealDownload
Recorder
RedesScrapy
SEOkicks-Robot
SEOlyticsCrawler
SMTBot
SalesIntelligent
ScanAlert
ScoutJet
SearchmetricsBot
SeoSiteCheckup
SeobilityBot
Seomoz
Siphon
SiteCheckerBotCrawler
SiteExplorer
SiteSucker
Sitebeam
Siteimprove
Sitevigil
SmartDownload
SocialRankIOBot
SpankBot
Spanner
Sqlworm
Steeler
Stripper
Szukacz
Telesphoreo
Telesphorep
The Intraformant
TheNomad
Thumbor
Titan
Toata
Trendictionbot
True_Robot
Turingos
Turnitin
TurnitinBot
VB Project
Vacuum
VelenPublicWebCrawler
VeriCiteCrawler
Voil
Voltron
WEBDAV
WISENutbot
WWW-Mechanize
Wallpapers
Web Collage
Web Fetch
Web Fuck
WebCollage
WebFuck
WebSucker
Webalta
Webshag
Website Quester
WebsiteExtractor
Webster
Who.is Bot
Widow
Wonderbot
Woobot
Wotbox
Xaldon WebSpider
Xaldon_WebSpider
Zade
Zauba
Zitebot
ZmEu
ZoomBot
arquivo-web-crawler
arquivo.pt
cah.io.community
check1.exe
clark-crawler
coccocbot-web
cognitiveseo
com.plumanalytics
crawler4j
domainsproject.org
eCatch
evc-batch
gopher
internetVista monitor
ips-agent
isitwp.com
lwp-trivial
magpie-crawler
meanpathbot
muhstik-scan
pcBrowser
polaris version
probe-image-size
scalaj-http
serpstatbot
sitechecker.pro
ubermetrics-technologies.com
webprosbot
x09Mozilla
x22Mozilla