---
type: email
from: Pydantic Team <hello@pydantic.dev>
subject: Evals Comparison & Issue Alerts in Logfire
received: 2026-03-06 07:38:09
date_header: Thu, 18 Sep 2025 16:04:13 +0000
priority: normal
status: awaiting_approval
uid: 30775
---

## Email Content

**From:** Pydantic Team <hello@pydantic.dev>
**Subject:** Evals Comparison & Issue Alerts in Logfire
**Date:** Thu, 18 Sep 2025 16:04:13 +0000

### Body (preview)

New in Pydantic: Evals comparison & Issue alerts



Pydantic ( https://pydantic.dev )



Some major updates from the Pydantic stack...



------------------------------------------------------------------------------------

📊 Pydantic Evals Comparison in Logfire (Beta): Track and compare your experiments

------------------------------------------------------------------------------------



We've built on our existing Pydantic Evals ( https://ai.pydantic.dev/evals/ ) integration in Logfire to offer a dedicated experiment comparison screen. Whether you're tracking quality over time, tweaking prompts, optimizing for cost and latency, or comparing models - evals comparison shows you a side-by-side view so you can understand what works best.



What makes this powerful:



* Visual comparison between any two experiment runs

* Track regressions on assertions, metrics and scores

* Compare cost vs quality tradeoffs at a glance

* Compare durations across experiment runs

* Share eval trace links with your team for easy review



Want to use Pydantic Evals without Logfire? No problem - you can still view your eval results in your local terminal.



Try Evals Comparison → ( https://logfire.pydantic.dev/docs/guides/web-ui/evals/ )



-----------------------------------------------------

🎯 Issue Alerts (Beta): Group and prioritize errors

-----------------------------------------------------



Focus on unique problems, not noise. Our intelligent fingerprinting groups related exceptions together, so you see each unique issue once along with how often it occurred, instead of thousands of duplicate log entries.



Key features:



* Smart fingerprinting groups similar errors automatically

* Get alerted on new issues, not repeat offenders

* Full context: stack traces, request details

* Get alerts on Slack, Teams, Discord - wherever you work



Get notified about new issues and trends while maintaining a clean, organized view of your application's health. Your team stays in

---

## Suggested Actions
- [ ] Reply
- [ ] Archive
- [ ] Escalate
