nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2023-07-25 22:05:01 +00:00

100 lines
1,009 B
Text

01h4x.com
80legs
Abonti
AfD-Verbotsverfahren
AlphaBot
AwarioRssBot
BlackWidow
Boardreader
Bullseye
BuzzSumo
CSHttp
CheTeam
Cogentbot
Craftbot
Curious
Custo
Dispatch
DnBCrawler-Analytics
DnyzBot
Dotbot
EasyDL
Ebingbong
EirGrabber
EyeNetIE
Foobot
FyberSpider
Fyrebot
GT::WWW
GalaxyBot
GermCrawler
GetRight
GetWeb
Gigabot
Grafula
HybridBot
InternetSeer
Iria
Jorgee
Kenjin Spider
LNSpiderguy
LieBaoFast
Likse
LinkScan
Linkbot
LinqiaScrapeBot
MIIxpc
MQQBrowser
MTRobot
Mail.RU_Bot
Majestic12
MarkWatch
Masscan
Minefield
Mr.4x3
NPbot
Name Intelligence
Nameprotect
NetAnts
Nuclei
PECL::HTTP
Pi-Monster
Pimonster
Proximic
QueryN Metasearch
RankFlex
RepoMonkey
SEOprofiler
Shodan
SpankBot
Spanner
Spbot
Suzuran
Twice
Upflow
V-BOT
VB Project
VeriCiteCrawler
WWW-Collector-E
Web Fuck
WebBandit
WebImageCollector
WebStripper
Webalta
WinHTTrack
Wprecon
Zeus
ZmEu
arquivo.pt
clark-crawler
crawl.sogou.com
dataforseo.com
demandbase-bot
lwp-request
netEstate NE Crawler
scan.lol
spyfu
voyagerx.com
webpros.com
zauba.io
zgrab