nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2022-05-27 22:07:24 +00:00

250 lines
2.6 KiB
Text

01h4x.com
404checker
80legs
ASPSeek
Aboundexbot
Acunetix
AfD-Verbotsverfahren
Aipbot
Alexibot
AllSubmitter
Anarchy
Anarchy99
Atomseobot
BackWeb
Badass
Bandit
Barkrowler
BatchFTP
Boardreader
Bolt
Brandprotect
Brandwatch
BuiltBotTough
CheeseBot
ChinaClaw
Chlooe
Claritybot
Cliqzbot
Collector
CopyRightCheck
Copyscape
Crawling at Home Project
Crescent
CrunchBot
DSearch
DataCha0s
DatabaseDriverMysqli
Disco
Dispatch
DittoSpyder
DnBCrawler-Analytics
DnyzBot
Dotbot
Download Wonder
Dragonfly
EirGrabber
Express WebPictures
ExtractorPro
FlashGet
Fuzz
Fyrebot
GT::WWW
GalaxyBot
GetRight
GetWeb
Gigabot
GoZilla
Grafula
HEADMasterSEO
HMView
Havij
Hloader
HybridBot
Iblog
Internet Ninja
IstellaBot
JamesBOT
Jbrofuzz
JennyBot
JetCar
Joomla
Jorgee
JustView
Kenjin Spider
Keyword Density
Kinza
LNSpiderguy
Larbin
LeechGet
Lftp
LibWeb
Libwhisker
LieBaoFast
Lightspeedsystems
Linkbot
LinqiaMetadataDownloaderBot
Lipperhey Spider
Lmspider
MIIxpc
MJ12bot
MSFrontPage
MTRobot
Majestic SEO
Majestic-SEO
Majestic12
Mata Hari
Mb2345Browser
Metauri
MicroMessenger
Microsoft Data Access
Minefield
Mister PiX
Mojeek
MolokaiBot
Mozlila
NICErsPRO
Name Intelligence
NearSite
Needle
Nessus
NetAnts
NetLyzer
NetMechanic
NetZIP
Nettrack
Niki-bot
NimbleCrawler
Nimbostratus
Ninja
Not
Nuclei
Offline Navigator
OnCrawl
OpenLinkProfiler
OrangeSpider
OutclicksBot
OutfoxBot
PHPCrawl
PageGrabber
PageThing.com
Panscient
Pavuk
Pi-Monster
Piepmatz
Pixray
PyCurl
RSSingBot
RankActive
RankFlex
RealDownload
RepoMonkey
Ripper
SBIder
ScoutJet
Scrapy
ScreenerBot
ScrepyBot
Searchestate
Seekport
SemanticJuice
SentiBot
SeobilityBot
Shodan
Siphon
Site Sucker
SiteCheckerBotCrawler
SiteLockSpider
SiteSucker
Snapbot
Snoopy
Sociscraper
Sosospider
SpaceBison
Spinn3r
SputnikBot
Sqlmap
Steeler
Sucker
SurveyBot
Suzuran
Swiftbot
Szukacz
T0PHackTeam
T8Abot
Teleport
Telesoft
The Intraformant
TheNomad
TightTwatBot
Titan
Toata
Toweyabot
Tracemyfile
Trendiction
True_Robot
Turingos
Turnitin
TwengaBot
Twice
UnisterBot
Upflow
V-BOT
VB Project
Vacuum
Virusdie
WEBDAV
WWW-Collector-E
WWW-Mechanize
Wallpapers
Wallpapers/3.0
WeSEE
Web Sauger
WebFetch
WebFuck
WebImageCollector
WebLeacher
WebPix
WebReaper
WebStripper
WebSucker
Webshag
WebsiteQuester
Whack
Whatweb
WiseGuys Robot
Xaldon_WebSpider
Xenu
Zauba
Zeus
ZoominfoBot
ZyBorg
adscanner
arquivo-web-crawler
autoemailspider
cah.io.community
cognitiveseo
com.plumanalytics
crawl.sogou.com
dataforseo.com
evc-batch
instabid
internetVista monitor
iubenda-radar
magpie-crawler
netEstate NE Crawler
oBot
page scorer
plumanalytics
polaris version
satoristudio.net
scan.lol
siteripz
sogouspider
spyfu
tAkeOut
trendiction.com
trendiction.de
x22Mozilla
xpymep1.exe
zauba.io