nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2025-06-23 22:08:11 +00:00

100 lines
1 KiB
Text

404enemy
ADmantX
BackWeb
Bigfoot
BlackWidow
Buck
BuiltWith
CODE87
Cliqzbot
Crescent
Curious
DSearch
DataCha0s
DatabaseDriverMysqli
DigitalPebble
Dotbot
Dragonfly
EMail Siphon
Ecxi
Evil
Exabot
ExtLinksBot
FHscan
Freeuploader
GoZilla
GrapeshotCrawler
GridBot
HMView
Heritrix
Humanlinks
Image Fetch
Image Sucker
ImagesiftBot
InfraSec Scanner
InterGET
JOC Web Spider
JamesBOT
Jetty
Kozmosbot
LNSpiderguy
LWP::Simple
Lightspeedsystems
LinkpadBot
LinqiaMetadataDownloaderBot
MQQBrowser
MSFrontPage
Mag-Net
Magnet
Mail.RU_Bot
MarkMonitor
Mass Downloader
Meanpathbot
Microsoft URL Control
Mr.4x3
Name Intelligence
Nutch
OrangeBot
PageScorer
PageThing.com
Papa Foto
Petalbot
PictureFinder
Psbot
RankFlex
Rankivabot
Re-re
ReGet
RealDownload
SMTBot
SearchmetricsBot
SemrushBot-FT
SiteAuditBot
Snake
Sqworm
Sucuri
SuperBot
Surfbot
Titan
Toweyabot
Upflow
VB Project
Voltron
WASALive-Bot
Wallpapers
Web Fuck
WebEnhancer
WebGo IS
WebsiteQuester
Whatweb
Woobot
Wotbox
Xaldon WebSpider
Zade
arquivo.pt
crawler.feedback
everyfeed-spider
lwp-request
muhstik-scan
oBot
seobility