StarRankExplorer
Back to rankings

Arize-ai/openinference

Pythonarize-ai.github.io/openinference/

OpenTelemetry Instrumentation for AI Observability

llmopstelemetryaiopsllmsopentelemetrytracinghacktoberfesthaystacklangchainlangraphllamaindexopenai
Star Growth
Stars
1.1k
Forks
274
Weekly Growth
—
Issues
154
5001k
Jan 2024Nov 2024Sep 2025Jul 2026
ArtifactsPyPIpip install openinference
README

OpenInference

OpenInference is a set of conventions and plugins that is complimentary to OpenTelemetry to enable tracing of AI applications. OpenInference is natively supported by Arize Phoenix and Arize AX, but can be used with any OpenTelemetry-compatible backend as well.

Specification

The OpenInference specification is edited in markdown files found in the spec directory. It's designed to provide insight into the invocation of LLMs and the surrounding application context such as retrieval from vector stores and the usage of external tools such as search engines or APIs. The specification is transport and file-format agnostic, and is intended to be used in conjunction with other specifications such as JSON, ProtoBuf, and DataFrames.

Instrumentation

OpenInference provides a set of instrumentations for popular machine learning SDKs and frameworks in a variety of languages.

Python

Libraries

Package Description Version
openinference-semantic-conventions Semantic conventions for tracing of LLM Apps. PyPI Version
openinference-instrumentation Reusable utilities, decorators, configurations, and helpers for instrumentation. PyPI Version
openinference-instrumentation-agno OpenInference Instrumentation for Agno Agents. PyPI Version
openinference-instrumentation-openai OpenInference Instrumentation for OpenAI SDK. PyPI Version
openinference-instrumentation-openai-agents OpenInference Instrumentation for OpenAI Agents SDK. PyPI Version
openinference-instrumentation-claude-agent-sdk OpenInference Instrumentation for Claude Agent SDK. PyPI Version
openinference-instrumentation-llama-index OpenInference Instrumentation for LlamaIndex. PyPI Version
openinference-instrumentation-dspy OpenInference Instrumentation for DSPy. PyPI Version
openinference-instrumentation-bedrock OpenInference Instrumentation for AWS Bedrock. PyPI Version
openinference-instrumentation-langchain OpenInference Instrumentation for LangChain. PyPI Version
openinference-instrumentation-mcp OpenInference Instrumentation for MCP. PyPI Version
openinference-instrumentation-mistralai OpenInference Instrumentation for MistralAI. PyPI Version
openinference-instrumentation-portkey OpenInference Instrumentation for Portkey. PyPI Version
openinference-instrumentation-guardrails OpenInference Instrumentation for Guardrails. PyPI Version
openinference-instrumentation-vertexai OpenInference Instrumentation for VertexAI. PyPI Version
openinference-instrumentation-crewai OpenInference Instrumentation for CrewAI. PyPI Version
openinference-instrumentation-haystack OpenInference Instrumentation for Haystack. PyPI Version
openinference-instrumentation-litellm OpenInference Instrumentation for liteLLM. PyPI Version
openinference-instrumentation-groq OpenInference Instrumentation for Groq. PyPI Version
openinference-instrumentation-instructor OpenInference Instrumentation for Instructor. PyPI Version
openinference-instrumentation-anthropic OpenInference Instrumentation for Anthropic. PyPI Version
openinference-instrumentation-beeai OpenInference Instrumentation for BeeAI. PyPI Version
openinference-instrumentation-google-genai OpenInference Instrumentation for Google GenAI. PyPI Version
openinference-instrumentation-google-adk OpenInference Instrumentation for Google ADK. PyPI Version
openinference-instrumentation-autogen-agentchat OpenInference Instrumentation for Microsoft Autogen AgentChat. PyPI Version
openinference-instrumentation-pydantic-ai OpenInference Instrumentation for PydanticAI. PyPI Version
openinference-instrumentation-smolagents OpenInference Instrumentation for smolagents. PyPI Version
openinference-instrumentation-pipecat OpenInference Instrumentation for Pipecat. PyPI Version
openinference-instrumentation-agentspec OpenInference Instrumentation for Open Agent Specification. PyPI Version
openinference-instrumentation-strands-agents OpenInference Instrumentation for Strands Agents. PyPI Version

Span Processors

Normalize and convert data across other instrumentation libraries by adding span processors that unify data.

Package Description Version
openinference-instrumentation-openlit OpenInference Span Processor for OpenLIT traces. PyPI Version
openinference-instrumentation-openllmetry OpenInference Span Processor for OpenLLMetry (Traceloop) traces. PyPI Version

Examples

Name Description Complexity Level
Agno Agno agent examples Beginner
OpenAI SDK OpenAI Python SDK, including chat completions and embeddings Beginner
Claude Agent SDK Claude Agent SDK Beginner
MistralAI SDK MistralAI Python SDK Beginner
VertexAI SDK VertexAI Python SDK Beginner
LlamaIndex LlamaIndex query engines Beginner
DSPy DSPy primitives and custom RAG modules Beginner
Boto3 Bedrock Client Boto3 Bedrock client Beginner
LangChain LangChain primitives and simple chains Beginner
LiteLLM A lightweight LiteLLM framework Beginner
LiteLLM Proxy LiteLLM Proxy to log OpenAI, Azure, Vertex, Bedrock Beginner
Groq Groq and AsyncGroq chat completions Beginner
Anthropic Anthropic Messages client Beginner
BeeAI Agentic instrumentation in the BeeAI framework Beginner
Haystack A Haystack QA RAG application Intermediate
OpenAI Agents OpenAI Agents with handoffs Intermediate
Autogen AgentChat Microsoft Autogen Assistant Agent and Team Chat Intermediate
PydanticAI PydanticAI agent examples Intermediate
Pipecat Pipecat application examples Intermediate

JavaScript

Libraries

Package Description Version
@arizeai/openinference-semantic-conventions Semantic conventions for tracing of LLM Apps. NPM Version
@arizeai/openinference-core Reusable utilities, configuration, and helpers for instrumentation. NPM Version
@arizeai/openinference-instrumentation-bedrock OpenInference Instrumentation for AWS Bedrock. NPM Version
@arizeai/openinference-instrumentation-bedrock-agent-runtime OpenInference Instrumentation for AWS Bedrock Agent Runtime. NPM Version
@arizeai/openinference-instrumentation-beeai OpenInference Instrumentation for BeeAI. NPM Version
@arizeai/openinference-instrumentation-langchain OpenInference Instrumentation for LangChain.js. NPM Version
@arizeai/openinference-instrumentation-mcp OpenInference Instrumentation for MCP. NPM Version
@arizeai/openinference-instrumentation-openai OpenInference Instrumentation for OpenAI SDK. NPM Version
@arizeai/openinference-instrumentation-anthropic OpenInference Instrumentation for the Anthropic SDK. NPM Version
@arizeai/openinference-instrumentation-claude-agent-sdk OpenInference Instrumentation for Claude Agent SDK. NPM Version
@arizeai/openinference-vercel OpenInference Support for Vercel AI SDK. NPM Version
@arizeai/openinference-tanstack-ai OpenInference middleware for TanStack AI. NPM Version
@arizeai/openinference-genai OpenInference Support for GenAI conventions NPM Version

Java

Libraries

Package Description Version
openinference-semantic-conventions Semantic conventions for tracing of LLM Apps. Maven Central Version
openinference-instrumentation Base instrumentation utilities. Maven Central Version
openinference-instrumentation-langchain4j OpenInference Instrumentation for LangChain4j. Maven Central Version
openinference-instrumentation-springAI OpenInference Instrumentation for Spring AI. Maven Central Version
openinference-instrumentation-annotation Annotation-based manual tracing with ByteBuddy. Maven Central Version

Examples

Name Description Complexity Level
LangChain4j Example Simple example using LangChain4j with OpenAI Beginner
Spring AI Example Spring AI example with OpenAI and tool calling Beginner
Annotation Example Annotation-based tracing with @Chain, @LLM, @Tool, @Agent Beginner
Programmatic Example Manual tracing with typed span classes (LLMSpan, AgentSpan, etc.) Beginner

Go

Libraries

Package Description Version
openinference-semantic-conventions Semantic conventions for tracing of LLM Apps. go get github.com/Arize-ai/openinference/go/openinference-semantic-conventions
openinference-instrumentation Suppression, context attribute propagation, and TraceConfig masking. Honors OPENINFERENCE_HIDE_* env vars. go get github.com/Arize-ai/openinference/go/openinference-instrumentation
openinference-instrumentation-anthropic-sdk-go OpenInference Instrumentation for the Anthropic Go SDK (anthropics/anthropic-sdk-go). go get github.com/Arize-ai/openinference/go/openinference-instrumentation-anthropic-sdk-go
openinference-instrumentation-openai-go OpenInference Instrumentation for the official OpenAI Go SDK (openai/openai-go). go get github.com/Arize-ai/openinference/go/openinference-instrumentation-openai-go

Requires Go 1.25+. Pair with arize-otel-go for the one-line OTLP/HTTP setup to Arize AX, or wire up any OTel exporter (e.g. Phoenix at http://localhost:6006/v1/traces).

Supported Destinations

OpenInference supports the following destinations as span collectors.

Community

Join our community to connect with thousands of machine learning practitioners and LLM observability enthusiasts!

  • 🌍 Join our Slack community.
  • 💡 Ask questions and provide feedback in the #phoenix-support channel.
  • 🌟 Leave a star on our GitHub.
  • 🐞 Report bugs with GitHub Issues.
  • 𝕏 Follow us on X.
  • 🗺️ Check out our roadmap to see where we're heading next.
Related repositories
pathwaycom/llm-app

Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.

Jupyter NotebookMIT Licensechatbothugging-face
pathway.com/developers/templates/
59k1.4k
BerriAI/litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

PythonPyPIOtheranthropiclangchain
docs.litellm.ai/docs/
54.3k10k
langfuse/langfuse

🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

TypeScriptnpmOtheranalyticsllm
langfuse.com
31.6k3.3k
ComposioHQ/composio

Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.

TypeScriptnpmMIT Licenseaipython
docs.composio.dev
29.3k4.7k
mlflow/mlflow

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

PythonPyPIApache License 2.0machine-learningai
mlflow.org
27.1k6k
liguodongiot/llm-action

本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

HTMLApache License 2.0llmllm-inference
zhihu.com/column/c_1456193767213043713
24.8k2.8k
promptfoo/promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

TypeScriptnpmMIT Licensellmprompt-engineering
promptfoo.dev
23.5k2.1k
jina-ai/serve

☁️ Build multimodal AI applications with cloud-native stack

PythonPyPIApache License 2.0neural-searchcloud-native
jina.ai/serve
21.9k2.2k
comet-ml/opik

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

PythonPyPIApache License 2.0open-sourcelangchain
comet.com/docs/opik/
20.8k1.6k
TransformerOptimus/SuperAGI

<⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.

PythonPyPIMIT Licenseagiai
superagi.com
17.6k2.2k
raga-ai-hub/RagaAI-Catalyst

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view

PythonPyPIApache License 2.0agentneoagents
catalyst.raga.ai
16.1k3.6k
vibrantlabsai/ragas

Supercharge Your LLM Application Evaluations 🚀

PythonPyPIApache License 2.0llmllmops
docs.ragas.io
14.9k1.6k