Is it also missing the "bos" in the chunked prefill figure, at the "second prefill split" part?
Kyle H
kylehh
·
AI & ML interests
None yet
Recent Activity
commented on
an
article
11 days ago
Continuous batching from first principles