nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-10-13 10:10:11 +00:00

250 lines
2.5 KiB
Text

01h4x.com
404checker
404enemy
ALittle Client
ASPSeek
Aboundex
Aboundexbot
Anarchie
Anarchy
Anthill
Apexoo
Asterias
AwarioSmartBot
BBBike
BDFetch
Barkrowler
BatchFTP
BetaBot
Bigfoot
Bolt
Brandwatch
Buck
Buddy
Bullseye
CODE87
Cegbfeieh
CensysInspect
CheeseBot
CherryPicker
ChinaClaw
Citoid
Cloud mapping
Cocolyzebot
Cosmos
CrunchBot
Curious
Custo
Demon
Digincore
Disco
Discobot
Discoverybot
Dispatch
DnBCrawler-Analytics
DomainAppender
DomainStatsBot
Domains Project
Dragonfly
EMail Wolf
EasyDL
Ebingbong
EirGrabber
Exabot
Extractor
Ezooms
Fimap
Foobot
Freeuploader
GermCrawler
GetWeb
Getintent
Gigabot
GoZilla
Grafula
GridBot
HMView
HTTP::Lite
Haansoft
Harvest
Hloader
HybridBot
IDBot
IlseBot
Indy Library
InfoNaviRobot
Iria
JennyBot
Jetty
Jorgee
Keyword Density
Lanshanbot
Larbin
Leap
LeechGet
Libwhisker
Likse
Linkbot
LinkextractorPro
LinkpadBot
LinksManager
LinqiaRSSBot
Lipperhey Spider
MFC_Tear_Sample
MIIxpc
MQQBrowser
Mail.RU_Bot
Majestic-SEO
MauiBot
Mb2345Browser
Meanpathbot
Mediatoolkitbot
MicroMessenger
Moblie Safari
Mojeek
Msrabot
Nameprotect
NearSite
NetMechanic
Nettrack
Nibbler
Nikto
Not
Octopus
OrangeBot
PHPCrawl
PageThing.com
Pandalytics
Pavuk
Petalbot
PictureFinder
Piepmatz
Pixray
Pockey
ProPowerBot
ProWebWalker
Probethenet
Psbot
PyCurl
QueryN Metasearch
RankActive
RankActiveLinkBot
Rankivabot
Re-re
ReGet
Recorder
RedesScrapy
RepoMonkey
Ripper
RocketCrawler
Rogerbot
SEOkicks
SEOkicks-Robot
SEOlyticsCrawler
SEOprofiler
SEOstats
SISTRIX
Screaming
SearchmetricsBot
SemanticJuice
SentiBot
SeoSiteCheckup
Siphon
SiteCheckerBotCrawler
SiteExplorer
SiteLockSpider
Sitebeam
Sitevigil
SmartDownload
Snapbot
SocialRankIOBot
Sociscraper
Sosospider
Sottopop
SputnikBot
Sqlmap
Sqlworm
Steeler
Sucuri
SuperBot
SurveyBot
Szukacz
T0PHackTeam
T8Abot
Telesphoreo
Telesphorep
The Intraformant
TheNomad
TightTwatBot
Toata
Toweyabot
Trendictionbot
TwengaBot
Twice
Typhoeus
URLy Warning
Upflow
V-BOT
VB Project
VCI
VeriCiteCrawler
VoidEYE
Voltron
WEBDAV
WISENutbot
WWWOFFLE
Wallpapers/3.0
WallpapersHD
Web Enhancer
Web Pix
Web Sauger
WebFetch
WebGo IS
WebLeacher
WebReaper
WebStripper
WebmasterWorldForumBot
Webshag
Website Quester
Webster
Whack
Whacker
Who.is Bot
Woobot
Wprecon
Xaldon_WebSpider
Zade
Zitebot
ZoomBot
ZumBot
ZyBorg
archive.org_bot
arquivo-web-crawler
autoemailspider
backlink-check
cah.io.community
clark-crawler
cognitiveseo
crawler.feedback
dataforseo.com
demandbase-bot
eCatch
facebookscraper
heritrix
ips-agent
isitwp.com
lwp-request
magpie-crawler
oBot
page scorer
polaris version
probe-image-size
ripz
satoristudio.net
scalaj-http
seobility
seoscanners
seostar
spyfu
sysscan
zgrab