nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2021-11-07 10:09:10 +00:00

250 lines
2.6 KiB
Text

01h4x.com
ASPSeek
Abonti
Acunetix
AfD-Verbotsverfahren
Anarchy
Ankit
Apexoo
Aspiegel
Asterias
Attach
BBBike
BDCbot
Badass
Bandit
Barkrowler
BetaBot
Bigfoot
Bitacle
Blackboard
Boardreader
Buck
CODE87
Calculon
CazoodleBot
CheeseBot
CherryPicker
Claritybot
Cloud mapping
Copier
CopyRightCheck
Copyscape
Cosmos
Crawling at Home Project
CrazyWebCrawler
Crescent
Custo
DSearch
DataCha0s
DatabaseDriverMysqli
Discobot
Discoverybot
Dispatch
DnBCrawler-Analytics
DnyzBot
DomCopBot
DomainStatsBot
Domains Project
Dotbot
Drip
EMail Siphon
EMail Wolf
Exabot
Express WebPictures
Extractor
ExtractorPro
EyeNetIE
FHscan
FemtosearchBot
Fimap
FlashGet
Foobot
Freeuploader
FrontPage
Fuzz
FyberSpider
Fyrebot
GT::WWW
GermCrawler
GetWeb
Getintent
Gigabot
Go-Ahead-Got-It
GoZilla
GrabNet
Grafula
HEADMasterSEO
HTMLparser
HTTP::Lite
Haansoft
Heritrix
HybridBot
IDBTE4M
Id-search
Image Fetch
IndeedBot
Indy Library
InfoTekies
Intelliseek
Internet Ninja
Iria
IstellaBot
JamesBOT
Jorgee
Kinza
Kozmosbot
LWP::Simple
LeechFTP
LeechGet
Likse
LinkScan
Linkbot
Linkdexbot
LinkextractorPro
LinkpadBot
LinqiaRSSBot
LinqiaScrapeBot
Lipperhey
Lipperhey Spider
MIIxpc
MJ12bot
MSIECrawler
MTRobot
Mag-Net
Magnet
Mail.RU_Bot
MauiBot
Moblie Safari
Mozlila
Mr.4x3
Musobot
NearSite
Nessus
Net Vampire
NetLyzer
Nettrack
NextGenSearchBot
Nibbler
Niki-bot
Nikto
NimbleCrawler
Ninja
Nutch
OpenLinkProfiler
OutfoxBot
PHPCrawl
Page Analyzer
Pandalytics
Panscient
Papa Foto
Pavuk
PeoplePal
Pi-Monster
Picscout
ProWebWalker
Psbot
Pu_iN
PxBroker
PyCurl
RSSingBot
RankActiveLinkBot
RankingBot
RankurBot
RedesScrapy
SBIder
SEOkicks
SEOprofiler
SISTRIX
ScanAlert
ScoutJet
Scrapy
ScreenerBot
ScrepyBot
SeoSiteCheckup
SeobilityBot
Seomoz
Site Sucker
SiteLockSpider
Siteimprove
Snapbot
Sociscraper
Sottopop
Spanner
Spinn3r
SputnikBot
Steeler
Stripper
Sucker
SuperHTTP
Suzuran
T0PHackTeam
Teleport
TeleportPro
Telesphorep
TheNomad
Titan
Tracemyfile
Trendiction
Trendictionbot
URLy Warning
Upflow
V-BOT
VelenPublicWebCrawler
VidibleScraper
Voil
WBSearchBot
WWW::Mechanize
Web Auto
Web Fuck
Web Pix
WebCollage
WebCopier
WebFetch
WebFuck
WebGo IS
WebImageCollector
WebPix
WebSauger
WebWhacker
WebZIP
Webalta
WebsiteExtractor
Webster
Whacker
Whatweb
Wonderbot
Wotbox
Wprecon
Xaldon_WebSpider
Zade
ZoomBot
ZumBot
arquivo.pt
autoemailspider
coccocbot-web
cognitiveseo
com.plumanalytics
crawler4j
evc-batch
heritrix
instabid
isitwp.com
lwp-trivial
magpie-crawler
page scorer
plumanalytics
polaris version
probe-image-size
satoristudio.net
scalaj-http
seoscanners
siteripz
sp_auditbot
trendiction.de
ubermetrics-technologies.com
webpros.com
x09Mozilla
x22Mozilla
xpymep1.exe
zgrab