mirror of
https://github.com/vegu-ai/talemate.git
synced 2025-09-04 19:39:14 +00:00
bb1cf6941b
* move memory agent to directory structure * chromadb settings rework * memory agent improvements embedding presets support switching embeddings without restart support custom sentence transformer embeddings * toggle to hide / show disabled clients * add memory debug tools * chromadb no longer needs its dedicated config entry * add missing emits * fix initial value * hidden disabled clients no longer cause enumeration issues with client actions * improve memory agent error handling and hot reloading * more memory agent error handling * DEBUG_MEMORY_REQUESTS off * relock * sim suite: fix issue with removing or changing characters * relock * fix issue where actor dialogue editor would break with multiple characters in the scene * remove cruft * implement interrupt function * margin adjustments * fix rubber banding issue in world editor when editing certain text fields * status notification when re-importing vectorb due to embeddings change * properly open new client context on agent actions * move jiggle apply to the end of prompt tune stack * narrator agent length limit and jiggle settings added - also improve post generation cleanup * progress story prompt improvements * narrator prompt and cleanup tweaks * prompt tweak * revert * autocomplete dialogue improvements * Unified process (#141) * progress to unified process * --dev arg * use gunicorn to serve built frontend * gunicorn config adjustments * remove dist from gitignore * revert * uvicorn instead * save decode * graceful shutdown * refactor unified process * clean up frontend log messages * more logging fixes * 0.27.0 * startup message * clean up scripts a bit * fixes to update.bat * fixes to install.bat * sim suite supports generation cancellation * debug * simplify narrator prompts * prompt tweaks * unified docker file * update docker compose config for unified docker file * cruft * fix startup in linux docker * download punkt so its available * prompt tweaks * fix bug when editing scene outline would wipe message history * add o1 models * add sampler, scheduler and cfg config to a1111 visualizer * update installation docs * visualizer configurable timeout * memory agent docs * docs * relock * relock * fix issue where changing embeddings on immutable scene would hang * remove debug message * take torch install out of poetry since conditionals don't work. * torch gets installed through some dependency so put it back into poetry, but reinstall with cuda if cuda support exists * fix install syntax * no need for torchvision * torch cuda install added to linux install script * add torch cuda install to update.bat * docs * docs * relock * fix install.sh * handle torch+cuda install in docker * docs * typo
23 lines
No EOL
1.1 KiB
Markdown
23 lines
No EOL
1.1 KiB
Markdown
# Testing Embeddings
|
|
|
|
You can test the performance of the selected embedding, by using talemate normally and then inspecting the memory request in the debug tools view.
|
|
|
|
|
|
|
|
Once the debug tools are open, select the :material-processor: Memory tab.
|
|
|
|
Then wait for the next talemate generation (for example conversation) and all the memory requests will be shown in the list.
|
|
|
|
|
|
|
|
In this particular example we are asking Kaira when we first met, and the expectation is for the memory agent to find and return the memory of the first meeting.
|
|
|
|
Click the memory request to see the details.
|
|
|
|
|
|
|
|
Up to 10 results are shown, however only those that fall within the acceptable distance are included in the context.
|
|
|
|
Selected entries will have their distance function colored green, while the others will be going from yellow to red.
|
|
|
|
If you find that accuracy is lacking you may need to tweak the [Embedding settings](/talemate/user-guide/agents/memory/embeddings). |