Hermes Pipeline
1ba56fd7e3
Extracted from: https://github.com/itszhaoziyan-n/AgentKit.git Score: 1.0
11 lines
827 B
Markdown
11 lines
827 B
Markdown
# Examples: three-tier-evaluation-pipeline
|
|
|
|
## Usage Example
|
|
|
|
```python
|
|
# How to use this skill
|
|
# Inputs: query/input text for the task, search results (for trace tier evaluation), evaluation criteria and thresholds
|
|
# Process: Step 1: Execute the main task using the Run tier of the evaluation pipeline (agentkit/runtime/LangGraph engine) to generate initial outputs and results → Step 2: Run the Trace tier where an LLM-as-Judge evaluates the output against defined criteria, generating detailed analysis and scoring → Step 3: Execute the Thread tier which facilitates human-in-the-loop discussion, approval, and iterative refinement of the output
|
|
# Outputs: Final consolidated report combining results from all three tiers, Detailed scores and metrics per tier, Threaded discussion logs for human review and approval
|
|
```
|