nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-12-19 22:04:45 +00:00

100 lines
1 KiB
Text

360Spider
404checker
404enemy
AhrefsBot
Ankit
BackWeb
BacklinkCrawler
Bandit
BetaBot
BlackWidow
Blackboard
BotALot
Calculon
CheTeam
Curious
CyotekWebCopy
DSearch
DataCha0s
Discobot
DomainCrawler
DomainSigmaCrawler
Domains Project
Drip
EasyDL
Ebingbong
Ecxi
Evil
ExtractorPro
FHscan
Flunky
Fyrebot
Hloader
IDBTE4M
IndeedBot
Indy Library
JikeSpider
Kinza
Likse
LinkextractorPro
Ltx71
MIDown tool
MJ12bot
MQQBrowser
Mail.RU_Bot
Majestic SEO
Masscan
Microsoft URL Control
Mr.4x3
Nessus
NetAnts
NetLyzer
OpenLinkProfiler
Openvas
ProPowerBot
Rainbot
RankActive
SBIder
SEOprofiler
SMTBot
Searchestate
Seomoz
Shodan
SmartDownload
SpankBot
Sucuri
SuperBot
Telesphorep
TheNomad
TinyTestBot
VeriCiteCrawler
Voltron
WPScan
WallpapersHD
Web Fuck
WebLeacher
WebSauger
WebSucker
WebZIP
Webster
Whatweb
WinHTTrack
Wprecon
Zitebot
ZoominfoBot
clark-crawler
evc-batch
facebookscraper
isitwp.com
iubenda-radar
magpie-crawler
openai
probe-image-size
seoscanners
sexsearcher
sitechecker.pro
siteripz
sogouspider
sp_auditbot
trendiction.de
voyagerx.com