Free to list, always.No paid rankings. Every recommendation explains its trade-offs.
OpenSourceChoice
Submit a project
OpenSourceChoice

Open-source projects tagged “Inference”.

Inspect repositories, licenses, activity, and alternatives across the Inference ecosystem.

2 projects connectedTag matches come from repository topics and catalog metadata.
LMCache
Apache-2.0

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

AI & Machine LearningOpen-source projects grouped in this category for discovery and comparison.2 projects#PythonProjects tagged with this topic in the verified catalog.1 projectamdProjects tagged with this topic in the verified catalog.1 projectcudaProjects tagged with this topic in the verified catalog.1 projectAI-nativeThis project includes AI-native capability signals in the catalog metadata.2 AI-native projectsCloudflare AI GatewayProprietary product with documented open-source alternatives cataloged on OpenSourceChoice. Compare licenses, reposit…1 alternative
Metrics syncingMetrics syncingStar momentum for this project has not landed in the latest GitHub metrics sync yet. Check trending for repositories with recorded momentum.Browse trending →
FreePricingFree and open sourceFree10.6K1.6K27 hours ago
Alternatives toCloudflare AI GatewayCloudflare AI GatewayProprietary product with documented open-source alternatives cataloged on OpenSourceChoice. Compare licenses, reposit…1 alternative+2
Envoy AI Gateway
Apache-2.0

Manages Unified Access to Generative AI Services built on Envoy Gateway

AI & Machine LearningOpen-source projects grouped in this category for discovery and comparison.2 projects#GoProjects tagged with this topic in the verified catalog.1 projectGithub ActionsProjects tagged with this topic in the verified catalog.1 projectJavaScriptProjects tagged with this topic in the verified catalog.1 projectAI-nativeThis project includes AI-native capability signals in the catalog metadata.2 AI-native projectsVercel AI GatewayProprietary product with documented open-source alternatives cataloged on OpenSourceChoice. Compare licenses, reposit…1 alternative
Metrics syncingMetrics syncingStar momentum for this project has not landed in the latest GitHub metrics sync yet. Check trending for repositories with recorded momentum.Browse trending →
FreePricingFree and open sourceFree1.8K30729 hours ago
Alternatives toVercel AI GatewayVercel AI GatewayProprietary product with documented open-source alternatives cataloged on OpenSourceChoice. Compare licenses, reposit…1 alternative+3
Showing 2 of 2