Scorecards

Understand how to create and manage Scorecards to evaluate your content effectively.

What are Scorecards?

Scorecards are collections of evaluation criteria that define how your content should be analyzed. They help ensure consistent evaluation across all your sources by providing a structured framework for assessment.

Think of a scorecard as a comprehensive evaluation template that contains all the metrics and criteria you want to measure for a specific type of content. Scorecards can be tailored to different content types, business objectives, or quality standards.

Scorecard Structure

Sections

Scorecards are organized into logical sections that group related evaluation criteria. For example, a customer service scorecard might have sections for "Greeting", "Problem Resolution", and "Closing".

Scores

Individual evaluation criteria that assess specific aspects of your content. Each score can be customized with its own evaluation logic and requirements. Scores are the building blocks of your evaluation framework.

Examples of scores include:

  • Grammar and spelling accuracy
  • Sentiment analysis (positive/negative/neutral)
  • Compliance with specific regulations
  • Presence of required information
  • Custom business-specific metrics

Sections

Logical groupings of related scores within a scorecard. Sections help organize scores into categories for better management and understanding.

Weights

Importance factors that determine how much each score contributes to the overall evaluation result. Weights allow you to prioritize certain criteria over others based on their importance to your business objectives.

Versions

Score configurations are versioned, allowing you to track changes over time, compare different implementations, and promote specific versions to champion status.

CLI Management

The Plexus CLI provides powerful commands for managing scorecards:

Listing Scorecards

# List all scorecards for an account
plexus scorecards list "account-name"

# List with filtering
plexus scorecards list "account-name" --name "Scorecard Name"
plexus scorecards list "account-name" --key "scorecard-key"

# Performance options
plexus scorecards list "account-name" --fast  # Skip fetching scores for faster results
plexus scorecards list "account-name" --hide-scores  # Don't display scores in output

The list command uses an optimized single GraphQL query to fetch scorecards, sections, and scores in one request, providing significantly faster performance.

Viewing Score Details

# View a specific score by name, key, ID, or external ID
plexus scorecards score "Score Name" --account "account-name"
plexus scorecards score "score-key" --account "account-name"
plexus scorecards score "score-id" --show-versions --show-config

# Scope to a specific scorecard
plexus scorecards score "Score Name" --scorecard "Scorecard Name"

Listing Scores in a Scorecard

To list all scores within a scorecard, use the scores list command:

# List all scores in a scorecard
plexus scores list --scorecard "Scorecard Name"

# You can also use the singular form
plexus score list --scorecard "Scorecard Name"

This command displays all scores organized by section, including their IDs, keys, and external IDs.

Version Management

# View version history (coming soon)
plexus scorecards history --account-key "account-key" --score-key "score-key"

# Promote a version to champion (coming soon)
plexus scorecards promote --account-key "account-key" --score-id "score-id" --version-id "version-id"

# Pull latest champion versions (coming soon)
plexus scorecards pull --account-key "account-key"

# Push local changes as new versions
plexus scorecards push --scorecard "scorecard-name" --note "Updated configuration"

Best Practices

Scorecard Organization

Group related scores into logical sections to improve clarity and maintainability. Use consistent naming conventions for scorecards, sections, and scores.

Version Management

Add descriptive notes to new versions to document changes. Test new versions thoroughly before promoting them to champion status.

Performance Considerations

Use the --fast option when listing many scorecards to improve performance. This skips fetching score details when you only need basic scorecard information.

Coming Soon

Additional scorecard features are being developed. Check back soon for:

  • Advanced score configuration options
  • Collaborative editing features
  • Performance analytics
  • Bulk operations for scorecard management