nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-07-09 10:07:20 +00:00

100 lines
949 B
Text

AhrefsBot
Aipbot
Anarchy
BackWeb
BatchFTP
Blow
Buddy
Cloud mapping
Cosmos
Crawling at Home Project
Devil
DnyzBot
DomCopBot
DomainAppender
EMail Wolf
EroCrawler
Extractor
Fuzz
FyberSpider
GoZilla
Grafula
Havij
HybridBot
IDBot
Id-search
IlseBot
JOC Web Spider
Jbrofuzz
Joomla
Jyxobot
Kozmosbot
Lftp
LinkextractorPro
LinksManager
MTRobot
MegaIndex.ru
MicroMessenger
Mr.4x3
Nessus
NetAnts
NetLyzer
NetZIP
Nettrack
Nibbler
Nuclei
Nutch
Openvas
Page Analyzer
Picsearch
PleaseCrawl
Probethenet
Proximic
Pu_iN
Pump
Re-re
Recorder
SBIder
ScreenerBot
Seekport
SenutoBot
Shodan
Siphon
Siteimprove
Snapbot
Snoopy
Sosospider
Spammen
Spbot
Sqlworm
Sucker
SuperBot
Szukacz
Telesoft
Trendictionbot
True_Robot
TurnitinBot
Twice
Typhoeus
Voltron
Wallpapers
Web Pix
WebBandit
WebGo IS
WebLeacher
WebPix
Website Quester
Widow
Xaldon_WebSpider
Xenu
Zitebot
ZyBorg
arquivo.pt
check1.exe
clark-crawler
com.plumanalytics
eCatch
facebookscraper
pcBrowser
scan.lol
seobility