#llm-serving

[ follow ]
Growth hacking
fromInfoQ
1 week ago

Scaling Large Language Model Serving Infrastructure at Meta

LLM serving is evolving into a foundational technology similar to an operating system.
[ Load more ]