Engineering Resources
In-depth, engineering-focused articles on LLM observability, evaluation, and tooling. These guides compare Langfuse with other platforms and walk through migrations so you can choose the right setup for your stack.
Comparisons
- Arize AX Alternative? Langfuse vs. Arize AI and Arize Phoenix for LLM Observability
August 2026 comparison of Langfuse, Arize AX, and Arize Phoenix for LLM observability, evaluations, self-hosting, and pricing.
Last updated Aug 19, 2026
- Braintrust Data Alternatives? The best LLMOps platform?
his article compares Langfuse and Braintrust for LLM observability, analytics, evaluations, and engineering workflows.
Last updated Jul 7, 2026
- Galileo AI Alternatives? The best LLMOps platform?
This article compares Langfuse and Galileo AI for LLM observability, analytics, evaluations, testing, and annotation.
Last updated Jun 23, 2026
- Langfuse vs. Datadog for LLM Observability & Agent Tracing
Compare Langfuse and Datadog LLM Observability: tracing, evals, prompt management, pricing, self-hosting, and how teams run both together via OpenTelemetry.
Last updated Jul 15, 2026
- LangSmith Alternative? Langfuse vs. LangSmith for LLM Observability
Langfuse is the open-source LangSmith alternative. Updated July 2026 comparison of open source, self-hosting, storage architecture, evals, alerting, and pricing.
Last updated Aug 10, 2026
Migrations
- How to Migrate from Helicone to Langfuse
Step-by-step guide to migrate your prompt management and observability from Helicone to Langfuse, covering prompt templates, variables, versioning, and tracing.
Last updated Jul 22, 2026
- Migrate a Promptfoo eval suite to Langfuse
Step-by-step guide to migrate a Promptfoo eval suite to Langfuse: turn tests into dataset items, port assertions to evaluators, and keep failing CI on regressions.
Last updated Jul 16, 2026
- Migrate from Arize AX to Langfuse
Migrate from Arize AX to Langfuse: keep OpenInference, switch the exporter, export datasets, and re-run experiments without importing old scores.
Last updated Aug 19, 2026
- Migrate from Arize Phoenix to Langfuse
Step-by-step guide to migrating from Arize Phoenix to Langfuse: keep OpenInference instrumentation, replace phoenix.otel.register(), and recreate datasets, prompts, and experiments.
Last updated Aug 19, 2026
- Migrate from Braintrust to Langfuse
Step-by-step guide to migrate from Braintrust to Langfuse: swap SDK instrumentation, export datasets via API, keep autoevals scorers, and re-run experiments.
Last updated Jul 15, 2026
Articles
- 🪢 Knot emoji: meaning, Unicode, and why it's the Langfuse logo
What the 🪢 knot emoji means, its Unicode codepoint, how to copy and use it, and why an LLM engineering platform picked it as a logo.
Last updated Jul 24, 2026
- 10 code evaluator examples for AI application evaluation
Ten copy-paste code evaluators for LLM applications: output validation, PII screening, RAG citation checks, numeric tolerance, refusal detection, and more.
Last updated Jul 6, 2026
- AI agent evaluation: trajectory, tool calls, and task completion
AI agent evaluation explained: how to measure trajectory, tool use, task completion, and multi-turn quality, with offline and online evaluation patterns.
Last updated Jul 24, 2026
- Answer relevance evaluation for LLM applications
Answer relevance evaluation for LLM apps: what the metric measures, judge prompt design, a runnable Langfuse experiment, and how Ragas answer relevancy fits.
Last updated Jul 16, 2026
- Chatbot analytics: analyzing what users ask your AI chatbot
Four working patterns for chatbot analytics on LLM traces: offline intent classification, LLM-as-a-judge detection, score dashboards, and agent-driven analysis.
Last updated Aug 12, 2026
- Evaluation of RAG pipelines with Ragas
Use RAGAS to evaluate your RAG pipelines traced with Langfuse to measure the quality of your retrieval and sythesis.
Last updated Aug 12, 2026
- Golden dataset evaluation: build and maintain LLM test sets
Golden dataset evaluation for LLM apps: build test sets from production traces, keep them fresh, and compare prompt versions over time with experiments.
Last updated Aug 12, 2026
- Hallucination detection for LLM apps
Hallucination detection for LLM apps: taxonomy, LLM-as-a-judge evaluators on production traces, offline experiments with references, and code pre-screens.
Last updated Jul 31, 2026
- How Langfuse runs ClickHouse at agent scale
Why Langfuse stores agent traces in ClickHouse and how we operate it at scale: the data model, the write path, read isolation, and the trade-offs we engineer around.
Last updated Jul 24, 2026
- How to build an LLM evaluation strategy
How to build an LLM evaluation strategy: quality dimensions from failure modes, evaluator selection, CI release gates, production monitoring, and human review.
Last updated Aug 10, 2026
- How to evaluate RAG faithfulness with LLM-as-a-judge
RAG faithfulness evaluation explained: what the faithfulness metric measures, how to design an LLM-as-a-judge for it, and runnable Langfuse Python SDK code.
Last updated Jul 16, 2026
- How to evaluate sessions and conversations
How to evaluate entire sessions in Langfuse rather than individual traces: session scores, LLM-as-a-judge on conversations, annotation, and SDK patterns.
Last updated Aug 17, 2026
- Langfuse for product teams: review conversations without code
How product teams use Langfuse without writing code: session replay, annotation queues, user feedback, dashboards, and natural language questions over traces.
Last updated Jul 24, 2026
- Langfuse SDK Performance Test
Benchmark of the latency impact of the Langfuse Python SDK and its OpenAI, Langchain, and LlamaIndex integrations.
Last updated Aug 10, 2026
- LLM cost management: how to track, attribute, and control spend
LLM cost management: track token spend accurately, attribute it to users and features, and control it with alerts. Pitfalls and how to solve them in Langfuse.
Last updated Aug 10, 2026
- LLM regression testing: fail CI before regressions ship
Set up LLM regression testing that fails CI: golden datasets, experiment thresholds, RegressionError, and GitHub Actions via langfuse/experiment-action.
Last updated Aug 10, 2026
- PII masking patterns for LLM applications
Where to mask PII in an LLM application: client-side SDK masking, server-side ingestion masking, gateway-level filtering, and detection with evaluators. Patterns and trade-offs.
Last updated Jul 6, 2026
- Prompt CI/CD: version, gate, and roll out prompts like code
Learn how to build a prompt CI/CD pipeline: version prompts with labels, validate on datasets, gate promotion in CI, roll out gradually, and roll back fast.
Last updated Aug 10, 2026
- Prompt Management Performance Benchmark
Performance benchmark on Langfuse Prompt Management measuring latency of retrieving and compiling prompts.
Last updated Aug 10, 2026
- Tracing coding agents: Claude Code, Codex, Copilot & more
How to trace AI coding agents with Langfuse: Claude Code, OpenAI Codex, GitHub Copilot, Cursor, and five more. Setup patterns, cost tracking, and team governance.
Last updated Jul 3, 2026
- Use Langfuse from Go, Java, C#, and Ruby via OpenTelemetry
Langfuse works from any language with an OpenTelemetry SDK: point the OTLP exporter at the Langfuse endpoint. Setup for Go, Java, C#/.NET, and Ruby.
Last updated Jul 22, 2026
- Using DeepEval with Langfuse: LLM evaluation guide
Use DeepEval with Langfuse to evaluate LLM applications: run DeepEval metrics in your Python pipeline and store results as scores on traces and experiments.
Last updated Aug 12, 2026
- Webinar: Traceability and Observability in Multi-Step LLM Systems
In this session, we talked about advanced techniques and best practices for implementing traceability and observability in multi-step LLM systems.
Last updated Aug 10, 2026
- What is an LLM gateway? When you need one (and when you don't)
An LLM gateway is a proxy layer between your application and model providers: one API, failover, caching, cost controls. How gateways work and how to pick one.
Last updated Jul 24, 2026
Last edited
