"The Synergy of Speculative Decoding and Batching in Serving Large Language ..."

Qidong Su, Christina Giannoula, Gennady Pekhimenko (2023)

Details and statistics

DOI: 10.48550/ARXIV.2310.18813

access: open

type: Informal or Other Publication

metadata version: 2023-11-02

a service of  Schloss Dagstuhl - Leibniz Center for Informatics