Compare frameworks
DeepEval vs AutoGen vs DSPy
Every figure below carries the source that reported it and the moment it was observed. Values that failed validation are withheld rather than shown, and a dash means no source we track carries that field for that framework.
| Field | DeepEval | AutoGen | DSPy |
|---|---|---|---|
| Stars | 18,476Synced from sourceCurrent3h ago | 61,194 (highest of the compared values)Synced from sourceCurrent3h ago | 38,388Synced from sourceCurrent3h ago |
| downloads | — | 47,487Synced from sourceStale10d ago | — |
| Last commit | 2026-09-25Synced from sourceCurrent3h ago | 2026-04-15Synced from sourceCurrent3h ago | 2026-09-27Synced from sourceCurrent3h ago |
| Language | pythonSeeded, unreviewedwritten 1mo ago | pythonSeeded, unreviewedwritten 1mo ago | pythonSeeded, unreviewedwritten 1mo ago |
| Licence | Apache-2.0Synced from sourceCurrent3h ago | CC-BY-4.0Synced from sourceCurrent3h ago | MITSynced from sourceCurrent3h ago |
| Archived | noSynced from sourceCurrent3h ago | noSynced from sourceCurrent3h ago | noSynced from sourceCurrent3h ago |
| Category | evaluationSeeded, unreviewedwritten 1mo ago | multi-agentSeeded, unreviewedwritten 1mo ago | optimisationSeeded, unreviewedwritten 1mo ago |
| Contributors | 337Synced from sourceCurrent3h ago | 534Synced from sourceCurrent3h ago | 461Synced from sourceCurrent3h ago |
| Forks | 1989Synced from sourceCurrent3h ago | 9256Synced from sourceCurrent3h ago | 3372Synced from sourceCurrent3h ago |
| Maintainer | Confident AISeeded, unreviewedwritten 1mo ago | MicrosoftSeeded, unreviewedwritten 1mo ago | Stanford NLPSeeded, unreviewedwritten 1mo ago |
| Open issues | 676Synced from sourceCurrent3h ago | 1105Synced from sourceCurrent3h ago | 739Synced from sourceCurrent3h ago |
| PyPI downloads, monthly | — | 263297Synced from sourceStale10d ago | — |
| PyPI downloads, weekly | — | 47487Synced from sourceStale10d ago | — |
| PyPI package | deepevalSynced from sourceCurrent3h ago | pyautogenSynced from sourceCurrent3h ago | dspy-aiSynced from sourceCurrent3h ago |
| PyPI released | 2026-09-24T09:31:55.310624ZSynced from sourceCurrent3h ago | 2025-07-15T00:37:26.170442ZSynced from sourceCurrent3h ago | 2026-09-25T04:04:30.339197ZSynced from sourceCurrent3h ago |
| Requires Python | <4.0,>=3.9Synced from sourceCurrent3h ago | >=3.10Synced from sourceCurrent3h ago | >=3.9Synced from sourceCurrent3h ago |
| PyPI version | 4.2.6Synced from sourceCurrent3h ago | 0.10.0Synced from sourceCurrent3h ago | 3.4.0Synced from sourceCurrent3h ago |
| Repository | https://github.com/confident-ai/deepevalSynced from sourceCurrent3h ago | https://github.com/microsoft/autogenSynced from sourceCurrent3h ago | https://github.com/stanfordnlp/dspySynced from sourceCurrent3h ago |
Sources: GitHub REST API, npm registry downloads, PyPI registry metadata, pypistats.org downloads. Most recent observation 3h ago. Where a row is marked, ▲ is the highest of the values shown and ▼ the lowest — arithmetic on the figures above, not a ranking or a recommendation. Rows where neither extreme is meaningful are left unmarked rather than given a direction they do not have.
Change the comparison
Remove one, or open the directory to pick a different set. Up to 3 at a time.