AI-Wiki

Tag: agent-evaluation

4 items with this tag.

  • Oct 11, 2026

    Three Questions Every Agent Engineer Should Be Able To Answer

    • langchain
    • langchain-labs
    • jake-broekhuizen
    • own-your-intelligence
    • agent-evaluation
    • production-traces
    • llm-as-judge
    • fine-tuned-judges
    • environment-backed-evaluation
    • world-spec
    • task-spec
    • reward-hacking
    • rl-environments
    • post-training
    • harness-vs-model
    • regression-testing
    • gtm-agent
    • vendor-talk
    • type/source
    • kind/video
  • Oct 01, 2026

    Why Your AI Agent Fails in Production (And How to Catch It)

    • google-cloud
    • ai-agent-clinic
    • agent-evaluation
    • evals
    • llm-as-judge
    • autorater
    • deterministic-checkers
    • trajectory-evaluation
    • opentelemetry
    • openinference
    • spans
    • langgraph
    • langsmith
    • antigravity
    • agent-eval
    • vertex-ai
    • gemini-enterprise-agent-platform
    • docshound
    • observability
    • scenarios
    • vibe-check
    • type/source
    • kind/video
  • Sep 22, 2026

    Jev-as-a-Judge for Agent Evals

    • langchain
    • langsmith
    • deep-agents
    • typesafe-ai
    • jev
    • system-one-models
    • daniel-shea
    • sean-roche
    • llm-as-judge
    • agent-evaluation
    • online-evals
    • evaluator-variance
    • repeatability
    • eval-cost
    • gpt-5-6
    • claude-sonnet-4-6
    • signal-value
    • vendor-experiment
    • small-n
    • type/source
    • kind/article
  • Aug 12, 2026

    Agent Evaluation: A Detailed Guide

    • agent-evaluation
    • agent-harness
    • agent-scaffold
    • evaluation-harness
    • llm-as-judge
    • tau-bench
    • terminal-bench
    • pass-at-k
    • pass-hat-k
    • swiss-cheese-evaluation
    • react-framework
    • multi-agent-systems
    • context-engineering
    • compaction
    • model-based-graders
    • code-based-graders
    • outcome-driven-evaluation
    • cameron-wolfe
    • deep-learning-focus
    • evaluation-suite
    • type/source
    • kind/article

Created with Quartz v0.1.0 © 2026

362 sources · 206 entities · 54 concepts · 9 threads · 6 syntheses

  • GitHub