Skip to content

fix: Llama.embed crashes when n_batch > 512#2332

Closed
lxcxjxhx wants to merge 3 commits into
abetlen:mainfrom
lxcxjxhx:fix-issue-1762
Closed

fix: Llama.embed crashes when n_batch > 512#2332
lxcxjxhx wants to merge 3 commits into
abetlen:mainfrom
lxcxjxhx:fix-issue-1762

fix: respect user-specified n_ubatch when > 512

0de6dba
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs