Pricing Docs Blog Resources Changelog Roadmap Community GitHub Slack X / Twitter LinkedIn
Book a demo Get started
All blogs Mahmoud Mabrouk

Mahmoud Mabrouk

Co-Founder Agenta & LLM Engineering Expert

Blogs from the author

The latest updates and insights from Agenta

View all blogs
Introducing Agenta 2.0Article

Introducing Agenta 2.0

Agenta 2.0 is the open-source workspace for building and running agents: build them through chat, improve them with feedback, share them with your team.

Jul 22, 2026
CI/CD for LLM Prompts: How to Build a Prompt Deployment PipelineEngineering

CI/CD for LLM Prompts: How to Build a Prompt Deployment Pipeline

How to build a CI/CD pipeline for LLM prompts. Covers webhook integration, automated evaluation gates, and three deployment paths.

Feb 11, 2026
Git vs. Prompt Management Tools: Which Should You Use?Engineering

Git vs. Prompt Management Tools: Which Should You Use?

Should you use Git or a dedicated tool for prompt versioning? Honest comparison with decision framework and the hybrid approach.

Feb 11, 2026
Prompt Drift: What It Is and How to Detect ItEngineering

Prompt Drift: What It Is and How to Detect It

What is prompt drift and why do LLM outputs change without prompt edits? Learn the three causes, how to detect drift, and how to prevent it.

Feb 11, 2026
Prompt Management for Non-Engineers: How Product Teams Can Own Their AI PromptsEngineering

Prompt Management for Non-Engineers: How Product Teams Can Own Their AI Prompts

How product managers and domain experts can contribute to AI prompt quality without writing code. A practical guide to collaborative prompt management.

Feb 11, 2026
Prompt Versioning: The Complete GuideEngineering

Prompt Versioning: The Complete Guide

Learn how to version LLM prompts for teams. Covers Git-based approaches, dedicated systems, three integration paths, and step-by-step setup.

Feb 11, 2026
Building the Data Flywheel: How to Use Production Data to Improve Your LLM ApplicationArticle

Building the Data Flywheel: How to Use Production Data to Improve Your LLM Application

Learn how to build a data flywheel for your LLM application using production data. Discover the 5-step process: from error analysis and clustering to creating golden test sets and improving prompts with Agenta's LLMOps platform. Master continuous improvement for reliable AI.

Dec 19, 2025
Top Open-Source Prompt Management Platforms 2026Engineering

Top Open-Source Prompt Management Platforms 2026

Discover which open-source prompt management platform is right for your team. In-depth comparison of Agenta, Langfuse, Phoenix, Latitude, and Pezzo with features, licensing, and code examples.

Dec 17, 2025
Launch Week #2 Day 5: Jinja2 Prompt TemplatesArticle

Launch Week #2 Day 5: Jinja2 Prompt Templates

Agenta prompt playground now supports Jinja2 prompt templates. Create dynamic LLM prompts with conditional logic. Prompt management with Jinja2 templating support.

Nov 14, 2025
Commercial Open Source Is Hard: Our JourneyArticle

Commercial Open Source Is Hard: Our Journey

Today we're open-sourcing most of our product. Here's what we learned after three failed attempts.

Nov 13, 2025
Launch Week #2 Day 4: Open Sourcing EvaluationArticle

Launch Week #2 Day 4: Open Sourcing Evaluation

We're open-sourcing all functional features of Agenta under the MIT license.

Nov 13, 2025
Launch Week #2 Day 3: Evaluation SDKArticle

Launch Week #2 Day 3: Evaluation SDK

We're launching the evaluation SDK today. The evaluation SDK allows you to evaluate complex agents and LLM workflows using built-in or custom evaluators.

Nov 12, 2025
Launch Week #2 Day 2: Online EvaluationArticle

Launch Week #2 Day 2: Online Evaluation

Today we're launching online evaluation. With online evaluation each request is automatically evaluated. This allows you to monitor things in production.

Nov 11, 2025
Launch Week #2 Day 1: New Evaluation Dashboard Article

Launch Week #2 Day 1: New Evaluation Dashboard

Launch Week Day 1: Redesigned evaluation dashboard with side-by-side comparison, detailed debugging, and customizable LLM-as-a-judge evaluators.

Nov 10, 2025
LLM as a Judge: Guide to LLM Evaluation & Best PracticesArticle

LLM as a Judge: Guide to LLM Evaluation & Best Practices

A practical guide to LLM as a judge: design, implement, and automate LLM evaluation and RAG evaluation for your AI projects.

Sep 30, 2025
Top LLM Observability platforms 2025Engineering

Top LLM Observability platforms 2025

Explore the best LLM Observability platforms of 2025. Compare open-source and enterprise tools like Agenta, Langfuse, Langsmith and more.

Sep 29, 2025
The guide to structured outputs and function calling with LLMsArticle

The guide to structured outputs and function calling with LLMs

Get reliable JSON from any LLM using structured outputs, JSON mode, Pydantic, Instructor, and Outlines. Complete production guide with OpenAI, Claude, and Gemini code examples for consistent data extraction.

Sep 10, 2025
The AI Engineer's Guide to LLM Observability with OpenTelemetryArticle

The AI Engineer's Guide to LLM Observability with OpenTelemetry

Learn why LLM observability is critical for production AI. This guide covers traces, OpenTelemetry (OTel), and the LLMOps workflows you need to build reliable apps

Aug 27, 2025
Building in Public: Why We're Publishing Our RoadmapArticle

Building in Public: Why We're Publishing Our Roadmap

Why we're open-sourcing our product roadmap in Agenta

Aug 12, 2025
July 2025 Product UpdatesArticle

July 2025 Product Updates

Product updates for July 2025. Adding tool and image support to the LLM playground to improve your prompt engineering flow, new observability integrations, and feedback endpoint to capture evaluations from your end-users

Aug 7, 2025
Humanloop Sunsetting - Migration and AlternativeEngineering

Humanloop Sunsetting - Migration and Alternative

Humanloop has been acquired and goes offline on September 8, 2025. Agenta is an ideal alternative that lets you version prompts, evaluate, and monitor LLM apps easily. Migrate your prompts and workflows to Agenta with free white-glove migration support.

Jul 22, 2025
Top techniques to Manage Context Lengths in LLMsArticle

Top techniques to Manage Context Lengths in LLMs

Overcome LLM token limits with 6 practical techniques. Learn how you can use truncation, RAG, memory buffering, and compression to overcome the token limit and fit the LLM context window.

Jul 16, 2025
Top 10 Techniques to Improve RAG ApplicationsArticle

Top 10 Techniques to Improve RAG Applications

A practical guide to RAG architectures, chunking strategies, reranking, and evaluation—improve your RAG system's accuracy and performance.

Jul 9, 2025
How to Evaluate RAG: Metrics, Evals, and Best PracticesArticle

How to Evaluate RAG: Metrics, Evals, and Best Practices

A practical guide to RAG evaluation, evaluation metrics, RAGAS, and LLM evaluation. Learn how to measure and improve your RAG systems.

Jul 1, 2025
Launch Week Day 5: SOC2 Type 2 ComplianceArticle

Launch Week Day 5: SOC2 Type 2 Compliance

It's Official: Agenta Is Now SOC2 Type 2 Compliant

Apr 18, 2025
Launch Week Day 4 – Structured Output in the PlaygroundArticle

Launch Week Day 4 – Structured Output in the Playground

Enforce JSON and schema-validated responses straight from the Agenta playground.

Apr 17, 2025
Launch Week Day 3: Prompt & Configuration RegistryArticle

Launch Week Day 3: Prompt & Configuration Registry

Today we're launching the Prompt & Configuration Registry. It's a place to manage all your LLM prompts and configurations.

Apr 16, 2025
Launch Week Day 2: Custom WorkflowsArticle

Launch Week Day 2: Custom Workflows

Agenta helps teams build better LLM applications. Today, we're releasing Custom Workflows - a way to connect your entire application to Agenta's playground and evaluation tools.

Apr 15, 2025
Launch Week Day 1: AI Model HubArticle

Launch Week Day 1: AI Model Hub

Agenta helps you build LLM applications with our playground for prompt engineering and evaluation tools. Now, we're making it possible to use virtually any model you have access to, no matter where it's hosted.

Apr 14, 2025
Agenta Launch Week #1: April 15-19Article

Agenta Launch Week #1: April 15-19

We're excited to share that our first-ever Launch Week is happening next week, April 15-19!

Apr 9, 2025
What We Learned Building a Prompt Management SystemArticle

What We Learned Building a Prompt Management System

For teams building production-grade LLM applications, a systematic approach to prompt management is no longer optional—it's essential infrastructure. Here's why it matters and how to get it right.

Mar 18, 2025
Introducing prompt Playground 2.0: A New Prompt Engineering IDEArticle

Introducing prompt Playground 2.0: A New Prompt Engineering IDE

Streamling your prompt engineering with Playground 2.0. An integrated LLM playground for testing and comparing prompts and models.

Feb 6, 2025
The Definitive Guide to Prompt Management SystemsArticle

The Definitive Guide to Prompt Management Systems

Explore why prompt management is crucial for scaling AI applications from pilots to production.

Jan 22, 2025
Product Updates November 2024 - LLM Observability and Prompt managementArticle

Product Updates November 2024 - LLM Observability and Prompt management

In this product update we introduce LLM observability, prompt management, and a new interface to configure LLM-as-a-judge evaluators.

Nov 26, 2024
Introducing Open-Source LLM Observability with AgentaArticle

Introducing Open-Source LLM Observability with Agenta

Agenta introduces open-source LLM observability and LLM monitoring for LLM applications. It allows you to trace inputs, outputs, and meta-data with two-lines of code. It is OpenTelemetry compliant and comes with many integrations out of the box (OpenAI, LiteLLM, LangChain, Instructor and more).

Nov 13, 2024
Agenta Achieves SOC2 Type I CertificationArticle

Agenta Achieves SOC2 Type I Certification

Agenta secures SOC2 Type 1 certification, ensuring your LLM development data stays protected with enterprise-level security. Build your AI applications with confidence.

Jan 15, 2024

Ship agents that actually work

Build with skills and tools, run on any harness in any environment, and improve with real feedback. All open source.

Start building Book a demo