nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-02-14 22:07:55 +00:00

100 lines
1 KiB
Text

ASPSeek
Ankit
AwarioSmartBot
BuiltBotTough
BuiltWith
Calculon
CheeseBot
Collector
Crescent
Custo
Demon
Deusu
DnBCrawler-Analytics
DomainCrawler
Dotbot
EasyDL
Ebingbong
EirGrabber
Exabot
Express WebPictures
Foobot
FrontPage
GoZilla
HMView
HTTrack
IDBTE4M
IndeedBot
Indy Library
Iria
JennyBot
Jetty
Kenjin Spider
Keyword Density
LinkpadBot
MIDown tool
Magnet
Majestic12
MarkWatch
MegaIndex.ru
Metauri
Moblie Safari
Nmap
POE-Component-Client-HTTP
PageGrabber
Panscient
Pavuk
Petalbot
Picsearch
Psbot
RankingBot
SBIder
SISTRIX
ScanAlert
ScrepyBot
SearchmetricsBot
SemrushBot
SemrushBot-FT
Shodan
SiteLockSpider
Sitevigil
Snapbot
Sogou web spider
SpankBot
Spider_Bot
Spinn3r
SputnikBot
TeleportPro
Thumbor
TinyTestBot
Vacuum
VeriCiteCrawler
Virusdie
WPScan
Wallpapers/3.0
Web Fetch
WebFetch
WebImageCollector
WebSauger
WebZIP
Webalta
Whatweb
WiseGuys Robot
Zade
ZoominfoBot
ZyBorg
arquivo.pt
autoemailspider
cognitiveseo
crawler4j
dataforseobot
eCatch
heritrix
magpie-crawler
oBot
pcBrowser
sexsearcher
siteripz
spyfu
sysscan
ubermetrics-technologies.com