What is Langfuse?

Langfuse is an open-source LLM engineering platform that empowers teams to collaboratively debug, analyze, and iterate on their LLM applications.

It accelerates the development workflow by providing tools for observability, tracing, prompt management, evaluation, and analytics.

Key Features

Observability and Tracing

  • Insights: Gain a granular understanding of your LLM's behavior with detailed tracing capabilities.
  • Integrations: Seamlessly integrate with popular frameworks like LangChain, Llama Index, and OpenAI.

Prompt Management

  • Linked Tracing: Connect prompt versions with tracing data for a holistic view of interactions.
  • Zero Latency: Experience prompt management without added latency in your applications.
  • Efficient Management: Organize and version your prompts to optimize model performance.

Evaluation and Analytics

  • Model-Based Evaluations: Utilize built-in tools or integrate external pipelines like UpTrain and Ragas.
  • Custom Metrics: Define and track custom scores and annotations to measure performance.
  • Analytics Dashboard: Access visualizations and reports to monitor usage, costs, and model effectiveness.

Get Started

Upgrade to Langfuse 4

New services use Langfuse 4.80.0. An existing service keeps its image until you change it in Configuration > General > Edit Compose File.

Langfuse 4 needs ClickHouse 25.12 or later, PostgreSQL 15 or later, and Redis 7 or later. It uses the events_only write mode by default. The Python SDK v2 and the JS SDK v3 do not work with Langfuse 4.

  1. Upgrade ClickHouse, PostgreSQL, and Redis to the minimum versions.
  2. Set LANGFUSE_MIGRATION_V4_WRITE_MODE=dual in the environment variables.
  3. Change the image to Langfuse 4, then do the 3-step migration of the official guide.
  4. Update your SDK clients.

See the official upgrade guide.

On this page