浏览代码

Fix DisposedError during slow batch embedding (#41)

Christopher Jones 3 月之前
父节点
当前提交
6d9871d2f5
共有 1 个文件被更改,包括 1 次插入0 次删除
  1. 1 0
      src/llm.ts

+ 1 - 0
src/llm.ts

@@ -567,6 +567,7 @@ export class LlamaCpp implements LLM {
         texts.map(async (text) => {
           try {
             const embedding = await context.getEmbeddingFor(text);
+            this.touchActivity();  // Keep-alive during slow batches
             return {
               embedding: Array.from(embedding.vector),
               model: this.embedModelUri,