nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-04-01 22:08:14 +00:00

100 lines
1.1 KiB
Text

404checker
ASPSeek
Aboundex
AhrefsBot
Anarchy
Apexoo
Aspiegel
Attach
BDCbot
BacklinkCrawler
BlackWidow
BlowFish
BotALot
BuiltBotTough
BuiltWith
Bullseye
Cegbfeieh
CensysInspect
Cogentbot
Collector
CopyRightCheck
Crawling at Home Project
Crescent
EMail Siphon
EasyDL
Evil
FDM
Firefox/7.0
GT::WWW
Grabber
Grafula
GrapeFX
GrapeshotCrawler
HEADMasterSEO
HMView
HTMLparser
Iblog
Indy Library
InfoNaviRobot
InfoTekies
InternetMeasurement
JamesBOT
Jetty
LinqiaRSSBot
MSIECrawler
Mass Downloader
Mediatoolkitbot
MicroMessenger
Net Vampire
NimbleCrawler
OnCrawl
OutfoxBot
PageThing.com
Pandalytics
Picsearch
Piepmatz
Pockey
ProPowerBot
SBIder
SEOlyt
ScanAlert
ScrepyBot
SemrushBot-OCOB
Shodan
SiteSnagger
Sociscraper
Spider_Bot
SputnikBot
Sucuri
T0PHackTeam
TightTwatBot
Titan
Toweyabot
Trendiction
TwengaBot
Virusdie
WEBDAV
WWW-Collector-E
Web Collage
WebBandit
WebReaper
WebSauger
Webshag
Website Quester
Zade
ZoominfoBot
archive.org_bot
arquivo.pt
cah.io.community
crawl.sogou.com
evc-batch
isitwp.com
netEstate NE Crawler
page scorer
ripz
scalaj-http
siteripz
sysscan
trendiction.com
voyagerx.com