AgentNeo
RagaAIPackageGitHub
  • AgentNeo
  • Getting Started
    • Overview
    • Quick Start Guide
    • Installation Guide
  • Features
    • Architecture
    • Basic Usage
    • Components
    • Key Features
    • Dashboard
  • Developer Guide
    • Advanced Usage
    • API Documentation
    • Database
  • Evaluation & Metrics
    • Metric Configuration
    • Overview
    • Supported Metrics
  • Contributing
    • Guidelines
    • Pull Request Process
    • Development Setup
  • Troubleshooting
    • Common Issues and Solutions
    • Frequently Asked Questions
  • Release Information
    • Breaking Changes
    • Version History
  • Reference
    • Glossary
    • Changelog
Powered by GitBook
On this page
  • Introduction
  • Key Capabilities
  • Getting Started with Metrics
  • Evaluation Process
  1. Evaluation & Metrics

Overview

Introduction

AgentNeo provides comprehensive metrics and evaluation capabilities to assess and optimize your AI applications' performance. The evaluation framework helps you understand your agents' behavior, efficiency, and effectiveness.

Key Capabilities

  • Performance Assessment

  • Cost Analysis

  • Quality Metrics

  • Behavioral Analysis

  • Custom Metric Support

Getting Started with Metrics

from agentneo import Evaluation

# Initialize evaluation
exe = Evaluation(session=neo_session, trace_id=tracer.trace_id)

# Run evaluation
exe.evaluate(metric_list=['goal_decomposition_efficiency'])

# Get results
results = exe.get_results()

Evaluation Process

  1. Collect trace data

  2. Compute metrics

  3. Generate insights

  4. Provide recommendations

PreviousMetric ConfigurationNextSupported Metrics

Last updated 6 months ago