nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-10-25 10:07:52 +00:00

100 lines
1.1 KiB
Text

ASPSeek
Acunetix
AfD-Verbotsverfahren
AhrefsBot
AwarioSmartBot
BatchFTP
Brandprotect
Buddy
CODE87
Cocolyzebot
Cogentbot
Collector
Crawling at Home Project
CrazyWebCrawler
CyotekWebCopy
DBLBot
DatabaseDriverMysqli
Dispatch
Download Wonder
ECCP/1.0
EasyDL
Ezooms
Flunky
Fuzz
Go-Ahead-Got-It
HMView
HaosouSpider
HonoluluBot
IlseBot
Image Fetch
Image Sucker
ImagesiftBot
JamesBOT
Jorgee
JustView
Keybot Translation-Search-Machine
LWP::Simple
LeechGet
LexiBot
Lftp
Lightspeedsystems
Likse
LinkpadBot
LinqiaScrapeBot
Lipperhey Spider
Mass Downloader
Morfeus Fucking Scanner
NetMechanic
Nibbler
Niki-bot
NimbleCrawler
Nimbostratus
OpenLinkProfiler
OutfoxBot
Page Analyzer
Probethenet
Pu_iN
RankActive
ReGet
Reaper
RedesScrapy
SEOstats
SMTBot
ScoutJet
SeekportBot
SemrushBot
Shodan
SiteCheckerBotCrawler
Sitebeam
SlySearch
Snoopy
Sucker
T8Abot
TeleportPro
Telesphoreo
Turingos
Typhoeus
VelenPublicWebCrawler
VoidEYE
WASALive-Bot
WBSearchBot
WWW::Mechanize
Web Fetch
WebGo IS
Wonderbot
Xaldon WebSpider
Xaldon_WebSpider
Zitebot
ZmEu
anthropic-ai
backlink-check
check1.exe
eCatch
mediawords
page scorer
sogouspider
spyfu
tAkeOut
trendiction.com
webmeup-crawler