Capabilities
No field note has been filed yet.
Catalog matches
library
Redis-based distributed queue for Node.js, Python, Rust, Elixir, .NET, and PHP.
service
Run LLM inference at maximum throughput This example demonstrates some techniques for running LLM inference at the highest possible throughput on Modal.