ServiceActive

Modal Queues

Distributed FIFO queues for Modal Apps with partitioned keys and sync/async access.

Open source page

Product features

Product features

Addenda

Configuring vLLM for maximum throughput

Deploying vLLM on Modal

Loading filings from the SEC EDGAR Feed

Organizing a batch job on Modal

Run LLM inference at maximum throughput

Serving tokens at maximum throughput

Transforming SEC filings for batch processing

Utilities for loading filings from the SEC EDGAR Feed

Utilities for transforming SEC Filings