chore: remove tiktoken dependency and replace with character-based token estimation

This commit is contained in:
tanzhenxin 2026-01-17 22:39:18 +08:00
parent ff5ea3c6d7
commit 35c865968f
22 changed files with 329 additions and 595 deletions

View file

@ -202,7 +202,7 @@ This is the most critical stage where files are moved and transformed into their
- Copies README.md and LICENSE to dist/
- Copies locales folder for internationalization
- Creates a clean package.json for distribution with only necessary dependencies
- Includes runtime dependencies like tiktoken
- Keeps distribution dependencies minimal (no bundled runtime deps)
- Maintains optional dependencies for node-pty
2. The JavaScript Bundle is Created: