nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-07-20 14:22:54 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
404enemy
ADmantX
ASPSeek
Aboundex
Acunetix
AfD-Verbotsverfahren
AhrefsBot
Aipbot
Alexibot
Anarchy99
Ankit
Anthill
Apexoo
Aspiegel
Attach
AwarioSmartBot
BackStreet
Badass
Battleztar Bazinga
Bitacle
BlackWidow
Blackboard
Blow
BlowFish
Boardreader
Brandwatch
BuiltBotTough
BuiltWith
Bullseye
BunnySlippers
CCBot
CSHttp
CheeseBot
Chlooe
Claritybot
Cocolyzebot
Cogentbot
Collector
Copier
CopyRightCheck
Copyscape
Craftbot
CrazyWebCrawler
CyotekWebCopy
DBLBot
DSearch
DTS Agent
DataCha0s
DigitalPebble
Dirbuster
Dispatch
DittoSpyder
DomCopBot
DomainCrawler
Domains Project
Dotbot
Download Wonder
Dragonfly
Drip
ECCP/1.0
EMail Wolf
EasyDL
EirGrabber
Evil
Exabot
ExtractorPro
FHscan
Firefox/7.0
Freeuploader
FyberSpider
GT::WWW
Genieo
GetWeb
Getintent
Gigabot
Gotit
Grafula
GrapeshotCrawler
GridBot
HEADMasterSEO
HTTrack
Heritrix
IDBTE4M
IRLbot
IlseBot
Image Sucker
InfoTekies
Intelliseek
InternetSeer
Iskanie
IstellaBot
JOC Web Spider
JamesBOT
Jbrofuzz
JennyBot
Jorgee
Jyxobot
Kenjin Spider
Keyword Density
Kinza
LNSpiderguy
Lanshanbot
LeechFTP
LeechGet
LibWeb
Libwhisker
LinkScan
LinkextractorPro
LinkpadBot
LinksManager
LinqiaMetadataDownloaderBot
LinqiaScrapeBot
MFC_Tear_Sample
MJ12bot
MQQBrowser
Magnet
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Majestic12
MarkWatch
Masscan
MicroMessenger
Moblie Safari
Msrabot
Musobot
NPbot
Name Intelligence
NearSite
Needle
Net Vampire
NetMechanic
Netcraft
Niki-bot
Nikto
Nmap
Nuclei
Octopus
OutclicksBot
POE-Component-Client-HTTP
Pandalytics
Panscient
Pi-Monster
PictureFinder
PleaseCrawl
Probethenet
PxBroker
QueryN Metasearch
Quick-Crawler
RankingBot2
Rankivabot
RankurBot
Re-re
ReGet
RealDownload
Reaper
RebelMouse
Recorder
Ripper
SEOkicks
SEOlyticsCrawler
SMTBot
SalesIntelligent
ScoutJet
Scrapy
Screaming
Searchestate
SearchmetricsBot
SeoSiteCheckup
Siphon
Site Sucker
Sitevigil
SocialRankIOBot
Sociscraper
SpankBot
Steeler
Sucuri
TeleportPro
TheNomad
Thumbor
Titan
Toata
Tracemyfile
Turingos
TwengaBot
UnisterBot
Upflow
V-BOT
VB Project
Vacuum
Vagabondo
VeriCiteCrawler
WPScan
WWW-Mechanize
WWW::Mechanize
Wallpapers/3.0
WallpapersHD
WebCollage
WebCopier
WebImageCollector
WebLeacher
WebPix
WebReaper
WebWhacker
WebZIP
WebmasterWorldForumBot
Webshag
Website Quester
WebsiteExtractor
WebsiteQuester
Whack
Whacker
Whatweb
Widow
Wonderbot
Woobot
Wotbox
Xaldon WebSpider
YoudaoBot
ZmEu
ZoominfoBot
ZyBorg
arquivo-web-crawler
backlink-check
coccocbot-web
crawler.feedback
crawler4j
domainsproject.org
eCatch
evc-batch
instabid
isitwp.com
lwp-request
lwp-trivial
mediawords
muhstik-scan
probe-image-size
s1z.ru
scalaj-http
seostar
sexsearcher
siteripz
spyfu
tAkeOut
trendiction.com
trendiction.de
x09Mozilla
zgrab