nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-10-21 10:07:08 +00:00

100 lines
1.1 KiB
Text

ADmantX
AIBOT
ALittle Client
Asterias
BLEXBot
Black Hole
BuiltBotTough
Bullseye
BuzzSumo
CATExplorador
ChinaClaw
Copier
Curious
Deusu
Devil
Digincore
Disco
DnyzBot
DomainStatsBot
Domains Project
Dragonfly
Ebingbong
EroCrawler
FHscan
FyberSpider
GalaxyBot
Grabber
Jetty
Kinza
LWP::Simple
Larbin
LexiBot
Libwhisker
LinqiaScrapeBot
Lipperhey Spider
Litemage_walker
MIIxpc
MSIECrawler
Mag-Net
MarkMonitor
Mass Downloader
Mata Hari
Metauri
Microsoft Data Access
Minefield
Name Intelligence
Netcraft
Nibbler
Nmap
Nuclei
Nutch
Octopus
OpenLinkProfiler
Page Analyzer
PageThing.com
Picsearch
RSSingBot
RankActiveLinkBot
Re-re
RealDownload
Reaper
Ripper
SISTRIX
Scanbot
ScreenerBot
Seekport
Site Sucker
SpankBot
Spanner
SputnikBot
Sqworm
SuperHTTP
Szukacz
Teleport
Tracemyfile
Turingos
Typhoeus
UnisterBot
Upflow
VB Project
VidibleScraper
WBSearchBot
Web Sauger
WebEnhancer
WebLeacher
WebmasterWorldForumBot
Website Quester
WinHTTrack
Xaldon WebSpider
check1.exe
clark-crawler
com.plumanalytics
dataforseobot
mediawords
muhstik-scan
page scorer
sexsearcher
webprosbot
x22Mozilla
zauba.io