mirror of
https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git
synced 2025-09-02 18:50:13 +00:00
100 lines
1 KiB
Text
100 lines
1 KiB
Text
404checker
|
|
Alexibot
|
|
Aspiegel
|
|
Attach
|
|
BLEXBot
|
|
BacklinkCrawler
|
|
BetaBot
|
|
Blackboard
|
|
BlowFish
|
|
Boardreader
|
|
Bullseye
|
|
Cogentbot
|
|
Copier
|
|
Custo
|
|
CyotekWebCopy
|
|
DTS Agent
|
|
DnBCrawler-Analytics
|
|
DomCopBot
|
|
EMail Wolf
|
|
Ecxi
|
|
EroCrawler
|
|
Extractor
|
|
FDM
|
|
Fyrebot
|
|
Genieo
|
|
GermCrawler
|
|
GrapeFX
|
|
HMView
|
|
Haansoft
|
|
Havij
|
|
Id-search
|
|
IlseBot
|
|
Intelliseek
|
|
JamesBOT
|
|
Lanshanbot
|
|
Lftp
|
|
LieBaoFast
|
|
LinkScan
|
|
LinqiaScrapeBot
|
|
MIIxpc
|
|
MSIECrawler
|
|
Mag-Net
|
|
Mass Downloader
|
|
Meanpathbot
|
|
Mediatoolkitbot
|
|
Microsoft URL Control
|
|
Minefield
|
|
NetAnts
|
|
NimbleCrawler
|
|
Nutch
|
|
Openvas
|
|
Page Analyzer
|
|
PageGrabber
|
|
Pandalytics
|
|
QueryN Metasearch
|
|
Quick-Crawler
|
|
RankingBot
|
|
SBIder
|
|
SMTBot
|
|
ScrepyBot
|
|
Semrush
|
|
SemrushBot
|
|
SenutoBot
|
|
Siteimprove
|
|
Sociscraper
|
|
Swiftbot
|
|
Teleport
|
|
Titan
|
|
Vacuum
|
|
VidibleScraper
|
|
VoidEYE
|
|
WeSEE
|
|
WebCopier
|
|
WebImageCollector
|
|
WebLeacher
|
|
Website Quester
|
|
Whack
|
|
Widow
|
|
WiseGuys Robot
|
|
Wonderbot
|
|
Woobot
|
|
Wprecon
|
|
Xaldon_WebSpider
|
|
YoudaoBot
|
|
Zade
|
|
Zitebot
|
|
ZyBorg
|
|
arquivo-web-crawler
|
|
crawl.sogou.com
|
|
domainsproject.org
|
|
eCatch
|
|
lwp-request
|
|
magpie-crawler
|
|
oBot
|
|
plumanalytics
|
|
seocompany.store
|
|
serpstatbot
|
|
siteripz
|
|
trendiction.de
|
|
xpymep1.exe
|