nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-03-19 10:06:58 +00:00

100 lines
1 KiB
Text

Abonti
Aipbot
Anthill
AwarioSmartBot
Barkrowler
BuzzSumo
Bytespider
CCBot
CheTeam
Chlooe
Cocolyzebot
Cogentbot
Copyscape
DomainSigmaCrawler
Dragonfly
Drip
Ebingbong
EyeNetIE
G-i-g-a-b-o-t
GPTBot
GT::WWW
Genieo
Grabber
Grafula
HTMLparser
IDBTE4M
InfoTekies
InterGET
JOC Web Spider
JetCar
Jyxobot
LeechFTP
Likse
Linkbot
LinkextractorPro
LinqiaMetadataDownloaderBot
MIIxpc
MQQBrowser
Mag-Net
Mediatoolkitbot
NetAnts
NetLyzer
NextGenSearchBot
Nibbler
Nikto
OnCrawl
OpenLinkProfiler
Openfind
Openvas
OutclicksBot
POE-Component-Client-HTTP
PageAnalyzer
PageThing.com
Papa Foto
Petalbot
Pimonster
Rainbot
RocketCrawler
SMTBot
Screaming
ScreenerBot
Site Sucker
SiteSnagger
Siteimprove
SlySearch
Spanner
Spbot
Spinn3r
Sqlmap
Steeler
Sucker
Sucuri
SuperBot
Toweyabot
V-BOT
Vacuum
WWWOFFLE
Wallpapers
Web Fuck
WebGo IS
WebSauger
Whack
Whatweb
Zermelo
autoemailspider
clark-crawler
eCatch
evc-batch
facebookscraper
gopher
magpie-crawler
muhstik-scan
oBot
pcBrowser
scalaj-http
seoscanners
seostar
sogouspider
webmeup-crawler
webprosbot