nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-20 10:09:39 +00:00

250 lines
2.7 KiB
Text

01h4x.com
AIBOT
ALittle Client
ASPSeek
Abonti
Aboundex
AfD-Verbotsverfahren
AiHitBot
AllSubmitter
AlphaBot
Anthill
Asterias
Atomseobot
AwarioSmartBot
BBBike
BackWeb
Badass
Bandit
Barkrowler
Bigfoot
Boardreader
Bullseye
BunnySlippers
CATExplorador
CazoodleBot
ChinaClaw
Claritybot
Cliqzbot
Cocolyzebot
Cogentbot
Collector
Copyscape
Crawling at Home Project
CrunchBot
Curious
Custo
CyotekWebCopy
DTS Agent
DataCha0s
DatabaseDriverMysqli
Devil
DigitalPebble
Dirbuster
Disco
Discobot
Discoverybot
Dispatch
DittoSpyder
DnBCrawler-Analytics
DomainStatsBot
EMail Wolf
EasyDL
Ecxi
EroCrawler
Evil
Express WebPictures
EyeNetIE
Ezooms
FHscan
Foobot
Fuzz
FyberSpider
GalaxyBot
Genieo
Go-Ahead-Got-It
Gotit
HMView
HTTP::Lite
Haansoft
Havij
Heritrix
Humanlinks
IDBot
IRLbot
Id-search
IlseBot
Image Fetch
Indy Library
Intelliseek
InternetSeer
IstellaBot
JetCar
JikeSpider
Jorgee
JustView
Kenjin Spider
Kinza
LNSpiderguy
Lanshanbot
Leap
LexiBot
Libwhisker
LinkScan
LinkextractorPro
LinkpadBot
LinqiaMetadataDownloaderBot
Lipperhey
Litemage_walker
Lmspider
Ltx71
MJ12bot
MQQBrowser
Mag-Net
Magnet
Mail.RU_Bot
Majestic SEO
Majestic-SEO
Majestic12
Mata Hari
Mb2345Browser
Meanpathbot
MegaIndex.ru
MicroMessenger
Mojeek
Mojolicious
MolokaiBot
Name Intelligence
Nameprotect
NearSite
Nessus
Net Vampire
NetAnts
NetMechanic
NetSpider
Netcraft
Nikto
NimbleCrawler
Nuclei
Nutch
Offline Explorer
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
OrangeBot
OutfoxBot
Page Analyzer
PageAnalyzer
PageThing.com
Papa Foto
PeoplePal
Picscout
PictureFinder
Piepmatz
Pimonster
PleaseCrawl
PxBroker
RankActive
RankFlex
Rankivabot
Re-re
Reaper
RebelMouse
RedesScrapy
RepoMonkey
RocketCrawler
Scanbot
ScoutJet
ScrepyBot
SearchmetricsBot
Seekport
SentiBot
Siphon
Site Sucker
SiteExplorer
SiteSnagger
SiteSucker
Snapbot
SocialRankIOBot
Sogou web spider
SpaceBison
Spammen
Spanner
Spinn3r
Sqworm
Steeler
Sucker
SuperHTTP
SurveyBot
Suzuran
Telesphorep
Thumbor
Toata
URLy.Warning
UnisterBot
Upflow
VB Project
VelenPublicWebCrawler
Virusdie
Voltron
WASALive-Bot
WEBDAV
WISENutbot
WWW-Collector-E
Wallpapers
WallpapersHD
WeSEE
Web Collage
Web Fetch
WebBandit
WebFetch
WebImageCollector
WebLeacher
WebReaper
WebStripper
WebmasterWorldForumBot
Webshag
Website Quester
Webster
Whack
WiseGuys Robot
Wotbox
Wprecon
Zade
Zauba
Zermelo
Zeus
Zitebot
ZmEu
ZoominfoBot
adscanner
archive.org_bot
arquivo.pt
backlink-check
cah.io.community
clark-crawler
cognitiveseo
com.plumanalytics
crawler.feedback
crawler4j
domainsproject.org
evc-batch
gopher
ips-agent
isitwp.com
lwp-trivial
muhstik-scan
netEstate NE Crawler
pcBrowser
probe-image-size
seoscanners
serpstatbot
sogouspider
sp_auditbot
spyfu
ubermetrics-technologies.com
voyagerx.com
webprosbot
x22Mozilla
xpymep1.exe