Use case for Web API accessing LLMs data
by Chunhui Mo, Huawei.
Large Language Models (LLMs) are being distributed across many devices and platforms; having these models available on-device can help reduce the need for sending private data to cloud-hosted systems. Chunhui Mo (Huawei) explores what it would take to expose these LLMs to web applications through a Web API and the advantages it could bring in terms of privacy, security and performance.