Appgithub-com-aphrodite-engine-aphrodite-engine

Download Pinokio

Sign in Create accountJoin

Sign in Create accountJoin

aphrodite-engine

github.com/aphrodite-engine/aphrodite-engineUpdated 9mo ago

Large-scale LLM inference engine

Loading community details…

Loading project owner…

Loading launchers…

Loading check-ins…

Community

Sort byCreate post

Ask or share about aphrodite-engine…

Loading...

Loading references…

Loading project activity…

Pinokio

0

Projects using this repository

No references listed yet.

Check-ins (0)

Recent commits

fix: mark GLM-4 MoE Lite as an MLA model (#1621)

AlpinDale9 months agof0f652a

[models] add support for GLM-4.7 Flash (#1620)

AlpinDale9 months ago79a8216

fix: tokenizer server init (#1617)

AlpinDale10 months ago212cb10

[cli] add CLI arg for selecting attention backend (#1612)

AlpinDale11 months ago82f869f

[fix] log message killing compilation

AlpinDale11 months ago19dddde

[logger][metrics] log number of cache hits in the request-level logger (#1611)

AlpinDale11 months ago1aef37b

[cli][diffusion] only import diffusion backend when it is called (#1610)

AlpinDale11 months ago163bfb2

[diffusion] `aphrodite diffusion` backend (#1607)

AlpinDale12 months agocb753df

[engine] add API for concurrency rate and kv cache token limit (#1608)

AlpinDale12 months ago56ea41d

[readme] update installation guide in readme

AlpinDale12 months ago5b12d09