nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-09-01 22:05:06 +00:00

100 lines
1 KiB
Text

360Spider
80legs
Aipbot
Anthill
Atomseobot
BLEXBot
Backlink-Ceck
BuzzSumo
CCBot
CensysInspect
CherryPicker
Chlooe
CopyRightCheck
Curious
Custo
Deusu
Devil
Dirbuster
DomainAppender
EMail Siphon
Ecxi
EroCrawler
Ezooms
FDM
FHscan
FlashGet
FyberSpider
G-i-g-a-b-o-t
HEADMasterSEO
Heritrix
IDBTE4M
IlseBot
Indy Library
Iskanie
Jetty
Joomla
Keybot Translation-Search-Machine
Keyword Density
Kinza
Lanshanbot
Mag-Net
Magnet
MeanPath Bot
Meanpathbot
Metauri
Nameprotect
Nessus
NetAnts
Netcraft
NimbleCrawler
Nimbostratus
OutclicksBot
PHPCrawl
POE-Component-Client-HTTP
PageAnalyzer
PageScorer
Petalbot
Picscout
PictureFinder
PleaseCrawl
Pu_iN
Pump
Reaper
RepoMonkey
Ripper
ScanAlert
ScoutJet
Seekport
Site Sucker
Siteimprove
Snoopy
Sucker
Trendictionbot
VCI
Voltron
WeSEE
Web Fuck
WebImageCollector
WebPix
WebSauger
WebWhacker
Webster
Widow
Wprecon
Xenu
ZmEu
ZoominfoBot
archive.org_bot
autoemailspider
backlink-check
clark-crawler
com.plumanalytics
eCatch
openai.com
plumanalytics
probe-image-size
seobility
x09Mozilla
x22Mozilla
zauba.io