nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-07-01 10:09:07 +00:00

250 lines
2.5 KiB
Text

01h4x.com
80legs
AIBOT
Abonti
Alligator
AlphaBot
Anarchy99
Ankit
Attach
AwarioSmartBot
BBBike
BLEXBot
BackWeb
BacklinkCrawler
Badass
Barkrowler
BetaBot
Bitacle
Blow
BlowFish
Brandwatch
Buddy
BuiltBotTough
BuiltWith
BuzzSumo
CATExplorador
CCBot
CODE87
CheTeam
Chlooe
Citoid
Claritybot
Cliqzbot
Cloud mapping
Crescent
Curious
Custo
CyotekWebCopy
DBLBot
DIIbot
DSearch
DataCha0s
DatabaseDriverMysqli
Demon
Digincore
Dirbuster
DittoSpyder
DomainAppender
DomainCrawler
DomainSigmaCrawler
DomainStatsBot
Download Wonder
Drip
ECCP/1.0
EasyDL
Ebingbong
Evil
Exabot
Extractor
ExtractorPro
Extreme Picture Finder
Ezooms
FHscan
FemtosearchBot
Fimap
FlashGet
Foobot
GalaxyBot
GermCrawler
GetWeb
Getintent
Go!Zilla
GrabNet
Grabber
Grafula
GrapeFX
Heritrix
IDBTE4M
IRLbot
Iblog
Id-search
Image Fetch
Intelliseek
InterGET
Iria
Jbrofuzz
JetCar
Jetty
JustView
Jyxobot
Kozmosbot
LNSpiderguy
Larbin
LeechFTP
LeechGet
LibWeb
LieBaoFast
LinkScan
Linkbot
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
MQQBrowser
MTRobot
Magnet
Majestic SEO
Majestic-SEO
MarkMonitor
Mass Downloader
Mata Hari
MauiBot
Meanpathbot
Metauri
Minefield
Mister PiX
NPbot
Nameprotect
Navroad
Needle
NetAnts
NetLyzer
NextGenSearchBot
Niki-bot
Nikto
NimbleCrawler
Nimbostratus
Not
Nuclei
Octopus
Offline Navigator
OnCrawl
OpenLinkProfiler
OpenVAS
Openvas
OrangeSpider
PageGrabber
PageScorer
Panscient
Papa Foto
PleaseCrawl
ProWebWalker
RSSingBot
RankFlex
RankingBot2
Re-re
ReGet
Reaper
Recorder
RedesScrapy
Rogerbot
SEOkicks-Robot
SEOstats
SMTBot
SalesIntelligent
ScanAlert
ScoutJet
Screaming
ScreenerBot
ScrepyBot
SearchmetricsBot
SemanticJuice
SentiBot
SeoSiteCheckup
SeobilityBot
Seomoz
Shodan
SiteCheckerBotCrawler
SiteLockSpider
SiteSnagger
Siteimprove
Sitevigil
SlySearch
SmartDownload
Snoopy
SocialRankIOBot
Sogou web spider
SpaceBison
SpankBot
Spbot
SputnikBot
Sqlmap
SuperBot
Suzuran
T0PHackTeam
TeleportPro
Telesoft
TheNomad
TightTwatBot
Titan
Toata
Tracemyfile
Trendictionbot
True_Robot
Turingos
Turnitin
TurnitinBot
Vacuum
VelenPublicWebCrawler
VidibleScraper
Virusdie
VoidEYE
WASALive-Bot
WEBDAV
WISENutbot
WWWOFFLE
Wallpapers
Web Collage
Web Fetch
Web Sucker
WebBandit
WebEnhancer
WebFetch
WebImageCollector
WebLeacher
WebSauger
WebSucker
WebmasterWorldForumBot
Webshag
WebsiteExtractor
WebsiteQuester
Whacker
Widow
Wotbox
Wprecon
Xaldon_WebSpider
YoudaoBot
Zermelo
ZoominfoBot
backlink-check
demandbase-bot
domainsproject.org
eCatch
evc-batch
facebookscraper
gopher
isitwp.com
muhstik-scan
pcBrowser
plumanalytics
probe-image-size
s1z.ru
satoristudio.net
seocompany.store
spyfu
sysscan
trendiction.de
voyagerx.com
webpros.com
x09Mozilla
zgrab