Tag: evaluation
All the articles with the tag "evaluation".
- llmevaluation
Three Rules for LLM-as-a-Judge
A model can help evaluate an AI system, but it cannot turn vague criteria into trustworthy evidence.
- agentic-aievaluation
When I Would Not Use an Agent
An agent is a poor default for deterministic, high-risk, or poorly observable work.
- genaievaluation
Evaluating an LLM Agent Like Real Software: Observability and Evals with Langfuse
A vibe-check isn't a test. How to trace, score, and gate an LLM agent with Langfuse — and the silent escalation regression evals catch that a demo never would.
- genaillm
Testing LLM-Based Applications
LLMs are stochastic — the same prompt yields different outputs, so deterministic tests break. How to test LLM apps with DeepEval and evals instead.