nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-07-14 22:04:53 +00:00

100 lines
1 KiB
Text

01h4x.com
404checker
ALittle Client
Aboundex
AfD-Verbotsverfahren
BBBike
Battleztar Bazinga
Bitacle
BotALot
Bullseye
Bytespider
Cegbfeieh
ChinaClaw
Citoid
Copyscape
Crawling at Home Project
DIIbot
DTS Agent
Dirbuster
ECCP/1.0
Extreme Picture Finder
FemtosearchBot
FlashGet
GPTBot
Getintent
Gigabot
HEADMasterSEO
HTMLparser
IDBTE4M
Id-search
Image Fetch
Intelliseek
Iskanie
JamesBOT
JennyBot
Lanshanbot
LexiBot
Lftp
Linkbot
Lmspider
MIDown tool
MSIECrawler
Majestic12
Mass Downloader
Mb2345Browser
Mediatoolkitbot
Microsoft URL Control
Moblie Safari
Mr.4x3
Musobot
Navroad
Needle
Nessus
Nettrack
OpenLinkProfiler
Pavuk
PictureFinder
ProWebWalker
Probethenet
RSSingBot
RankingBot
Re-re
RedesScrapy
SMTBot
SalesIntelligent
ScoutJet
SemanticJuice
SentiBot
Siphon
SmartDownload
Snake
TeleportPro
Titan
Toata
V-BOT
VCI
Vacuum
VoidEYE
WWW::Mechanize
Wallpapers
Web Pix
WebBandit
WebCopier
WebWhacker
WebZIP
Website Quester
WinHTTrack
Zeus
awario.com
facebookscraper
lwp-trivial
netEstate NE Crawler
oBot
seobility
seostar
spyfu
sysscan
voyagerx.com
webmeup-crawler
x09Mozilla