nginx-ultimate-bad-bot-blocker/dev-tools/test_units/random-bots-for-whitelist-test.list
2024-11-02 22:04:53 +00:00

100 lines
1.1 KiB
Text

80legs
ADmantX
ALittle Client
AfD-Verbotsverfahren
AhrefsBot
AwarioRssBot
BBBike
BDFetch
BackWeb
Backlink-Ceck
Battleztar Bazinga
Blow
Bolt
BuiltBotTough
BuiltWith
CODE87
CherryPicker
ClaudeBot
Copier
Crawling at Home Project
Dirbuster
EMail Siphon
EroCrawler
Extractor
Ezooms
FDM
FacebookBot
Fimap
FlashGet
Flunky
FyberSpider
Haansoft
Hloader
Humanlinks
Iblog
IlseBot
ImagesiftBot
JetCar
LibWeb
LinkScan
LinqiaMetadataDownloaderBot
Lipperhey Spider
Litemage_walker
MSFrontPage
Majestic SEO
MarkMonitor
Mass Downloader
Mata Hari
Mb2345Browser
Meanpathbot
MegaIndex.ru
Moblie Safari
Needle
NetZIP
Netvibes
Octopus
Offline Explorer
PageScorer
Pavuk
ProPowerBot
ProWebWalker
Rainbot
ReGet
RebelMouse
RocketCrawler
SBIder
SalesIntelligent
Scanbot
SemanticJuice
SemrushBot
SenutoBot
SeoCherryBot
SiteLockSpider
Snapbot
Spammen
Spbot
Sqlworm
Toweyabot
Upflow
Web Sauger
WebLeacher
WebStripper
Webalta
WebmasterWorldForumBot
Webshag
Widow
Xaldon_WebSpider
Zermelo
archive.org_bot
arquivo.pt
awario.com
clark-crawler
cognitiveseo
crawl.sogou.com
internetVista monitor
netEstate NE Crawler
seoscanners
sitechecker.pro
xpymep1.exe
zgrab