nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-06-08 22:08:46 +00:00

100 lines
1 KiB
Text

360Spider
Acunetix
AdsTxtCrawlerTP
BDFetch
Backlink-Ceck
Barkrowler
Battleztar Bazinga
BetaBot
BlackWidow
Blow
Boardreader
Bolt
BuzzSumo
Bytespider
CSHttp
CazoodleBot
CheTeam
CherryPicker
ClaudeBot
CyotekWebCopy
DIIbot
DSearch
DataCha0s
Discobot
DomainAppender
EMail Siphon
Ebingbong
EroCrawler
Exabot
ExtLinksBot
EyeNetIE
Foobot
Freeuploader
Fuzz
GPTBot
Gigabot
GridBot
HTTrack
Hloader
Id-search
Image Fetch
Image Sucker
Jbrofuzz
Jetty
LibWeb
Lightspeedsystems
Likse
Linkbot
LinqiaMetadataDownloaderBot
Litemage_walker
MIIxpc
MJ12bot
Majestic SEO
Masscan
Mediatoolkitbot
Minefield
Mojeek
Msrabot
NICErsPRO
Name Intelligence
Octopus
OpenVAS
Probethenet
RealDownload
Recorder
Ripper
SEOlyticsCrawler
SEOprofiler
SEOstats
ScoutJet
SeoCherryBot
SiteSucker
Siteimprove
Spanner
Sucuri
SuperBot
SuperHTTP
Swiftbot
The Intraformant
VCI
WEBDAV
WISENutbot
WWW-Collector-E
Web Fetch
WebBandit
WebStripper
WebZIP
Wprecon
Xenu
YaK
Zermelo
cah.io.community
crawler4j
ips-agent
lwp-trivial
openai
seobility
seoscanners
sp_auditbot
webmeup-crawler