Epictetus
271f79610d
New skills: - blacknode-graph-workflow - multi-agent-workflow-execution - langgraph-agent-workflow - langgraph-multi-agent-router - three-tier-evaluation-pipeline Config: LLM pipeline uses LFM on llama.cpp (8080)
11 lines
827 B
Markdown
11 lines
827 B
Markdown
# Examples: three-tier-evaluation-pipeline
|
|
|
|
## Usage Example
|
|
|
|
```python
|
|
# How to use this skill
|
|
# Inputs: query/input text for the task, search results (for trace tier evaluation), evaluation criteria and thresholds
|
|
# Process: Step 1: Execute the main task using the Run tier of the evaluation pipeline (agentkit/runtime/LangGraph engine) to generate initial outputs and results → Step 2: Run the Trace tier where an LLM-as-Judge evaluates the output against defined criteria, generating detailed analysis and scoring → Step 3: Execute the Thread tier which facilitates human-in-the-loop discussion, approval, and iterative refinement of the output
|
|
# Outputs: Final consolidated report combining results from all three tiers, Detailed scores and metrics per tier, Threaded discussion logs for human review and approval
|
|
```
|