Add `prefill` method support without generation - #183

Open

craftingmod wants to merge 9 commits into

JamePeng:mainfrom

craftingmod:prefill-feature

Commits on Sep 26, 2026

feat(mtmd): support `prefill` mode
craftingmod
committed
6277c21
feat(mtmd): add `create_chat_prefill` public API with immutable result
craftingmod
committed
8ba5579
chore: add `chat completion handler` method in test
craftingmod
committed
d967725
feat: support prefill both MTMD and text.
craftingmod
committed
803f448
feat(chat): add `chat_template_kwargs` option to chat completion & prefill
craftingmod
committed
3c3cab2
chore(prefill): add example for prefill feature
craftingmod
committed
5712f67
test: add `chat_template_kwargs` override test
craftingmod
committed
dc5f528
chore: fix `chat_template_kwargs` parameter error
craftingmod
committed
33d0d2c

Commits on Sep 27, 2026

chore(prefill): add `n_tokens` field again
craftingmod
committed
399fbb1