Back to Report Blocks

ExplanationAnalysis

NLP
Report block

Clusters score-result explanations to reveal recurring model reasoning patterns.

What It Answers

  • What reasons does the model give most often?
  • Which reasoning patterns correlate with misses?
  • Where are explanations repetitive or vague?

Use When

  • Auditing model reasoning.
  • Preparing optimizer context.
  • Finding repeated explanation themes.

Avoid When

  • You need transcript topics instead of score explanations.
  • You need direct feedback agreement metrics.

Run From The CLI

Direct report commands are the simplest path for one-off usage. Saved report configurations use `plexus report config create` and `plexus report run`.

plexus report run --config "Explanation Analysis" days=30
plexus report config create --name "ExplanationAnalysis Example" --file explanation-analysis.md
plexus report run --config "ExplanationAnalysis Example"

Minimal Configuration

class: ExplanationAnalysis
scorecard: "Customer Service QA"
days: 30
min_topic_size: 5

Live Rendered Example

Rendered with the same dashboard component used by generated reports.

ExplanationAnalysis Example

Semantic topics inferred from production ScoreResult explanations.

0 explanations analyzed
1 topics found

Medication Review: Dosage

120 explanations
1 topics

How To Interpret It

  • Reasoning topics can reveal prompt ambiguity even when labels look acceptable.
  • Use exemplars to confirm the model is not rationalizing wrong outputs.