nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-03-24 12:13:40 +00:00

100 lines
1,004 B
Text

Aipbot
BBBike
Bigfoot
Black Hole
Blackboard
Boardreader
Bolt
Bullseye
BuzzSumo
ChinaClaw
CrazyWebCrawler
Crescent
CyotekWebCopy
DBLBot
DTS Agent
Demon
Digincore
Dispatch
ECCP/1.0
Ecxi
Exabot
EyeNetIE
Ezooms
FDM
FyberSpider
HTTP::Lite
HTTrack
HaosouSpider
Havij
IDBTE4M
Image Fetch
Iria
Jbrofuzz
JetCar
JustView
LeechGet
Linkbot
Lipperhey
Lmspider
MSFrontPage
Magnet
Mass Downloader
MauiBot
Metauri
MicroMessenger
Minefield
Mojeek
Msrabot
Nameprotect
Navroad
NimbleCrawler
Ninja
PageAnalyzer
PictureFinder
Pimonster
Pu_iN
QueryN Metasearch
RSSingBot
RankActive
SentiBot
Site Sucker
Siteimprove
Sqlworm
Sqworm
SurveyBot
Swiftbot
T0PHackTeam
T8Abot
Thumbor
Toata
Toweyabot
Trendictionbot
Turnitin
TurnitinBot
TwengaBot
Typhoeus
V-BOT
Voltron
WISENutbot
WWW-Mechanize
Web Sauger
WebAuto
WebSauger
WebWhacker
WebmasterWorldForumBot
WebsiteExtractor
Zade
backlink-check
coccocbot
ips-agent
isitwp.com
magpie-crawler
omgili
probe-image-size
seostar
sogouspider
sysscan
trendiction.com
voyagerx.com
webgains-bot