Add Skill: three-tier-evaluation-pipeline

Extracted from: https://github.com/itszhaoziyan-n/AgentKit.git Score: 1.0
2026-08-05 17:05:03 +00:00
parent d81ddeda88
commit 1ba56fd7e3
5 changed files with 148 additions and 0 deletions
@@ -0,0 +1,10 @@
+# Examples: three-tier-evaluation-pipeline
+
+## Usage Example
+
+```python
+# How to use this skill
+# Inputs: query/input text for the task, search results (for trace tier evaluation), evaluation criteria and thresholds
+# Process: Step 1: Execute the main task using the Run tier of the evaluation pipeline (agentkit/runtime/LangGraph engine) to generate initial outputs and results → Step 2: Run the Trace tier where an LLM-as-Judge evaluates the output against defined criteria, generating detailed analysis and scoring → Step 3: Execute the Thread tier which facilitates human-in-the-loop discussion, approval, and iterative refinement of the output
+# Outputs: Final consolidated report combining results from all three tiers, Detailed scores and metrics per tier, Threaded discussion logs for human review and approval
+```