nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-08-15 10:13:07 +00:00

100 lines
1 KiB
Text

80legs
ALittle Client
AhrefsBot
Aipbot
AliyunSecBot
Aspiegel
Attach
AwarioBot
BacklinkCrawler
Blow
Brandprotect
Buck
Buddy
Bullseye
CheeseBot
Crawling at Home Project
DIIbot
Disco
EirGrabber
ExtractorPro
FHscan
Fimap
Firefox/7.0
FrontPage
FyberSpider
Fyrebot
GalaxyBot
GoZilla
Grabber
HTTrack
HonoluluBot
Iblog
Image Sucker
InfoNaviRobot
InfraSec Scanner
InterGET
Iskanie
Jetty
LinkScan
Litemage_walker
Lmspider
MQQBrowser
MSFrontPage
Majestic SEO
MarkMonitor
MarkWatch
Moblie Safari
Morfeus Fucking Scanner
Mr.4x3
NPbot
Navroad
Net Vampire
NetAnts
Nimbostratus
OrangeBot
Panscient
Picscout
Piepmatz
Psbot
Pump
Ripper
Scrapy
Semrush
SemrushBot-SI
SeobilityBot
Seomoz
Sitevigil
SlySearch
SmartDownload
Snake
SputnikBot
Teleport
TeleportPro
Telesoft
Toweyabot
Trendiction
URLy.Warning
Upflow
V-BOT
Wallpapers/3.0
WebAuto
WebGo IS
WebImageCollector
WebLeacher
Webster
Whacker
Whatweb
Xaldon WebSpider
Zermelo
adscanner
backlink-check
cah.io.community
clark-crawler
crawler.feedback
lwp-trivial
mediawords
openai
seostar
trendiction.com
webprosbot