AI-Wiki
Search
Search
Dark mode
Light mode
Explorer
Tag: llm-as-judge
8 items with this tag.
Jun 26, 2026
Agent Evaluation: A Detailed Guide
agent-evaluation
agent-harness
agent-scaffold
evaluation-harness
llm-as-judge
tau-bench
terminal-bench
pass-at-k
pass-hat-k
swiss-cheese-evaluation
react-framework
multi-agent-systems
context-engineering
compaction
model-based-graders
code-based-graders
outcome-driven-evaluation
cameron-wolfe
deep-learning-focus
evaluation-suite
type/source
kind/article
May 29, 2026
agent-development-lifecycle
agent-development-lifecycle
adlc
ai-agents
agent-engineering
lifecycle-frameworks
sdlc-parallel
build-test-deploy-monitor
agent-governance
evals
llm-as-judge
type/concept
May 25, 2026
Evals for taste: Hill-climbing a slide-generation agent
anthropic
claude-channel
ai-dev-26
evals
evals-for-taste
hill-climbing
slide-generation-agent
code-based-graders
model-based-graders
human-graders
llm-as-judge
pairwise-comparison
multi-judge-consensus
judge-calibration
qa-loop-adversarial
opus-4-7
sonnet-4-7
manage-agent
python-pptx
eval-saturation
autoregressive-judge-ordering-bug
agent-development-lifecycle
vendor-altitude-evals-doctrine
type/source
kind/video
May 14, 2026
Evals 101 — Doug Guthrie, Braintrust
evals
ai-evaluation
llm-as-judge
observability
agent-development-lifecycle
agent-harness
braintrust
ai-engineer-worlds-fair
flywheel-effect
human-in-the-loop
online-scoring
offline-evals
type/source
kind/video
May 14, 2026
AI Evaluations Clearly Explained in 50 Minutes (Real Example) — Hamel Husain on Peter Yang's podcast
evals
ai-evaluation
llm-as-judge
observability
binary-pass-fail
agreement-metric
true-positive-rate
true-negative-rate
error-analysis
axial-coding
spreadsheet-evals
hamel-husain
peter-yang
agent-development-lifecycle
agent-harness
ai-product-management
type/source
kind/video
May 14, 2026
Agentic Evaluations Workshop — Deep Dive on the Future of Evals for Agents
evals
agentic-evals
ai-benchmarks
reliability
capability-reliability-gap
automation-vs-augmentation
gaia-2
are-environment
inspect-ai
lighteval
open-llm-leaderboard
community-eval
living-benchmarks
every-eval-ever
sim-to-real-gap
reward-hacking
llm-as-judge
rubrics
agent-development-lifecycle
agent-harness
ai-policy
hugging-face
type/source
kind/video
May 14, 2026
What Is Andrej Karpathy's LLM Wiki — And How Can You Extend It?
llm-wiki
karpathy-llm-wiki
5w1h
wikizz
context-debt
knowledge-graphs
rag-vs-wiki
autonomous-scaffolding
contrast-engine
llm-as-judge
anthropic-api
nvidia-nim
gemini
cloudflare-worker
single-author-extension
vishal-mysore
type/source
kind/article
May 07, 2026
Towards Scalable Measurement of Durable Skills
durable-skills
future-ready-skills
21st-century-skills
ai-assessment
generative-ai
gemini
llm-as-judge
psychometrics
collaboration
creativity
critical-thinking
scalable-assessment
type/source
kind/paper