mirror of
https://github.com/mitchellkrogza/nginx-ultimate-bad-bot-blocker.git
synced 2025-09-02 02:29:58 +00:00
100 lines
1.1 KiB
Text
100 lines
1.1 KiB
Text
AdsTxtCrawlerTP
|
|
AllSubmitter
|
|
Bandit
|
|
Battleztar Bazinga
|
|
BetaBot
|
|
CODE87
|
|
Cegbfeieh
|
|
Chlooe
|
|
Copier
|
|
Craftbot
|
|
CyotekWebCopy
|
|
Dotbot
|
|
Download Wonder
|
|
FemtosearchBot
|
|
Genieo
|
|
GetWeb
|
|
Getintent
|
|
HaosouSpider
|
|
Havij
|
|
IDBot
|
|
IRLbot
|
|
ImagesiftBot
|
|
Indy Library
|
|
InterGET
|
|
InternetSeer
|
|
JamesBOT
|
|
Jetty
|
|
Keybot Translation-Search-Machine
|
|
Leap
|
|
LieBaoFast
|
|
Linkbot
|
|
Lipperhey
|
|
Lipperhey Spider
|
|
MIDown tool
|
|
Mag-Net
|
|
Mediatoolkitbot
|
|
MegaIndex.ru
|
|
Microsoft URL Control
|
|
Musobot
|
|
Navroad
|
|
NearSite
|
|
NetMechanic
|
|
NetSpider
|
|
Nibbler
|
|
Offline Navigator
|
|
Openfind
|
|
OrangeBot
|
|
PageGrabber
|
|
PeoplePal
|
|
Pi-Monster
|
|
PleaseCrawl
|
|
Proximic
|
|
PyCurl
|
|
ReGet
|
|
RealDownload
|
|
SEOkicks-Robot
|
|
ScanAlert
|
|
Scrapy
|
|
Searchestate
|
|
SemrushBot-BA
|
|
SemrushBot-SI
|
|
Shodan
|
|
Siphon
|
|
Site Sucker
|
|
SiteLockSpider
|
|
SlySearch
|
|
SpankBot
|
|
Spider_Bot/3.0
|
|
SputnikBot
|
|
SuperBot
|
|
Szukacz
|
|
True_Robot
|
|
Turingos
|
|
Twice
|
|
URLy Warning
|
|
Vacuum
|
|
VidibleScraper
|
|
Voltron
|
|
WWW-Collector-E
|
|
WWW-Mechanize
|
|
WallpapersHD
|
|
Web Sauger
|
|
WebFetch
|
|
Website Quester
|
|
WebsiteExtractor
|
|
WebsiteQuester
|
|
Who.is Bot
|
|
WiseGuys Robot
|
|
Wonderbot
|
|
YaK
|
|
coccocbot
|
|
dataforseo.com
|
|
internetVista monitor
|
|
lwp-trivial
|
|
meanpathbot
|
|
pcBrowser
|
|
seocompany.store
|
|
sexsearcher
|
|
sogouspider
|
|
voyagerx.com
|