Evaluation - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Saurav Bhattacharya

Your Agent Said It Worked. Go Check the World, Not the Sentence.

#ai #agents #evaluation #observability

4 min read

How EvalPort's Grader System Works: 11 Types for LLM Evaluation

#llm #evaluation #testing #opensource

2 min read

Saurav Bhattacharya

Your New Eval Rule Is Untested Code Guarding Production

#ai #agents #evaluation #testing

5 min read

RAG Beyond the Demo: Pipeline, Citations, Evaluation, and When Not to Bother

#rag #llm #embeddings #evaluation

7 min read

OpenEval: Why LLM Evaluation Needs a Standard Format

#llm #evaluation #ai #testing

1 min read

Saurav Bhattacharya

Right Tool, Wrong Arguments: The Agent Failure Your Evals Wave Through

#ai #agents #evaluation #observability

4 min read

Your eval dashboard has 30 metrics. When one "moves," that is usually arithmetic, not a regression.

#statistics #machinelearning #datascience #evaluation

6 min read

Saurav Bhattacharya

Your Agent's Confidence Score Is Not a Probability

#ai #agents #evaluation #observability

4 min read

PoPE: Placebo-Controlled Evaluation Challenges Error-Conditioned Self-Repair in Small Code LLMs

#llms #codegeneration #selfrepair #evaluation

3 min read

Muhammed Rasin O M

Half the answer keys in text-to-SQL benchmarks are wrong. So I generated the database from the answer key.

#evaluation #dataagents #benchmarks #syntheticdata

7 min read

Saurav Bhattacharya

Your Agent's Deadline Is a Correctness Test, Not an SLO

#ai #agents #evaluation #observability

4 min read

Saurav Bhattacharya

Stop Judging Every Run: Eval Sampling Is a Budget Decision, Not a Coverage One

#ai #agents #evaluation #observability

5 min read

Evaluating LLM Apps in Python

#python #ai #llm #evaluation

9 min read

Evaluating LLM Apps in Java

#java #ai #llm #evaluation

10 min read

Saurav Bhattacharya

Short-Circuit Your Agent Evals: Tier Order Is a Latency Budget, Not a Preference

#ai #agents #evaluation #typescript

5 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.