Prompt engineering is the foundation of any reliable LLM application. Yet most teams struggle with a fragmented workflow - testing prompts in one place, managing versions in another, and deploying somewhere else. Today, we’re introducing Playground 2.0, a complete prompt engineering IDE that brings everything together.
Why We Built a New Kind of Prompt Playground
The original OpenAI playground changed how we interact with LLMs. But as applications grew more complex, its limitations became clear. You couldn’t save test cases, compare models side-by-side, or manage prompts across environments.
We watched hundreds of teams build LLM applications and saw that success depends on rapid iteration - testing prompts, comparing models, and finding what works reliably. So we rebuilt our prompt engineering workflow from the ground up.
What Makes Playground 2.0 Different
Multi-Message Templates That Work
Modern LLM applications need more than single prompts. Now you can:
- Create templates with system and user messages in one view
- Add variables using {{variable}} syntax with built-in validation
- See exactly what your LLM will receive, eliminating surprises in production
Real Model Comparison
Stop guessing which model works best. Our playground lets you:
- Compare outputs from different models side-by-side
- Test across 50+ models including GPT-4, Claude, Gemini, Mistral, and DeepSeek
- Adjust parameters like temperature, top-k, and presence penalty to find optimal settings
- See cost and latency differences to make informed decisions
Testing Built In
We’ve made testing a core part of the workflow:
- Load test sets directly into the playground
- Save working examples as new test cases
- Import production data from traces for testing
- Build benchmark suites to evaluate model performance
An Integrated Platform
Everything you need in one place:
- Prompt management with version control and instant rollback
- Observability to track every model call in production
- Evaluation framework to measure and improve performance
- Deploy to different environments with one click
For Engineering Teams
We’ve built tools that make production deployment easier:
- Programmatic access through our API
- Works with any framework (LangChain, LlamaIndex, CrewAI)
- Version control for prompts and configurations
- Deploy to different environments without code changes
Creating prompts now happens instantly, and your whole team can collaborate without touching code.
Getting Started
Ready to improve your prompt engineering workflow? Here’s how:
- Create a free account
- Create a new prompt
- Load your test data
- Start comparing models
Or book a demo to see how it fits your use case.
p.s. The new playground is available now. It’s open source, so you can self-host or use our cloud version.
