Benchmarking Pocket-Scale Inference

发生了什么

Benchmarking of language model inference on mobile phones. We measure output speed, latency and memory use across local models.

摘要按规则整理自下方来源原文

来源