Open-source projects tagged “Llmops”.

LI

LiteLLM

License not declared

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, Huggin

AI & Machine LearningOpen-source projects grouped in this category for discovery and comparison.6 projects#PythonProjects tagged with this topic in the verified catalog.2 projectsGithub ActionsProjects tagged with this topic in the verified catalog.6 projectsJavaScriptProjects tagged with this topic in the verified catalog.5 projectsAI-nativeThis project includes AI-native capability signals in the catalog metadata.6 AI-native projectsLangChainProprietary product with documented open-source alternatives cataloged on OpenSourceChoice. Compare licenses, reposit…2 alternatives

Alternatives toLLangChainLLangChainProprietary product with documented open-source alternatives cataloged on OpenSourceChoice. Compare licenses, reposit…2 alternatives+4

PO

Portkey AI Gateway

MIT

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

AI & Machine LearningOpen-source projects grouped in this category for discovery and comparison.6 projects#TypeScriptProjects tagged with this topic in the verified catalog.3 projectsGithub ActionsProjects tagged with this topic in the verified catalog.6 projectsJavaScriptProjects tagged with this topic in the verified catalog.5 projectsAI-nativeThis project includes AI-native capability signals in the catalog metadata.6 AI-native projectsVercel AI GatewayProprietary product with documented open-source alternatives cataloged on OpenSourceChoice. Compare licenses, reposit…4 alternatives

AR

Arize Phoenix

License not declared

AI Observability & Evaluation

AI & Machine LearningOpen-source projects grouped in this category for discovery and comparison.6 projects#PythonProjects tagged with this topic in the verified catalog.2 projectsGithub ActionsProjects tagged with this topic in the verified catalog.6 projectsJavaScriptProjects tagged with this topic in the verified catalog.5 projectsAI-nativeThis project includes AI-native capability signals in the catalog metadata.6 AI-native projectsLangSmithProprietary product with documented open-source alternatives cataloged on OpenSourceChoice. Compare licenses, reposit…2 alternatives

BI

Bifrost

Apache-2.0

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

AI & Machine LearningOpen-source projects grouped in this category for discovery and comparison.6 projects#GoProjects tagged with this topic in the verified catalog.1 projectGithub ActionsProjects tagged with this topic in the verified catalog.6 projectsJavaScriptProjects tagged with this topic in the verified catalog.5 projectsAI-nativeThis project includes AI-native capability signals in the catalog metadata.6 AI-native projectsOpenRouterProprietary product with documented open-source alternatives cataloged on OpenSourceChoice. Compare licenses, reposit…2 alternatives

Alternatives toOOpenRouterOOpenRouterProprietary product with documented open-source alternatives cataloged on OpenSourceChoice. Compare licenses, reposit…2 alternatives+4

AG

Agenta

License not declared

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

AI & Machine LearningOpen-source projects grouped in this category for discovery and comparison.6 projects#TypeScriptProjects tagged with this topic in the verified catalog.3 projectsGithub ActionsProjects tagged with this topic in the verified catalog.6 projectsJavaScriptProjects tagged with this topic in the verified catalog.5 projectsAI-nativeThis project includes AI-native capability signals in the catalog metadata.6 AI-native projectsLangSmithProprietary product with documented open-source alternatives cataloged on OpenSourceChoice. Compare licenses, reposit…2 alternatives

GR

Grepture

AGPL-3.0

Drop-in proxy for OpenAI, Anthropic, and other LLM APIs. Logging, PII redaction, prompt versioning, and evals out of the box.

AI & Machine LearningOpen-source projects grouped in this category for discovery and comparison.6 projects#TypeScriptProjects tagged with this topic in the verified catalog.3 projectsGithub ActionsProjects tagged with this topic in the verified catalog.6 projectsNodeJSProjects tagged with this topic in the verified catalog.6 projectsSelf-hostedThis project carries a self-hosting or local-deployment signal. Verify the official install guide before production use.1 self-hosted optionAI-nativeThis project includes AI-native capability signals in the catalog metadata.6 AI-native projectsVercel AI GatewayProprietary product with documented open-source alternatives cataloged on OpenSourceChoice. Compare licenses, reposit…4 alternatives