Compare commits
2 Commits
| Author | SHA1 | Date | |
|---|---|---|---|
 Hermes Pipeline
|
2f2c7cf5fb | ||
|
Epictetus
|
271f79610d |
@@ -16,10 +16,10 @@ llm:
|
||||
api_key: ""
|
||||
max_tokens: 8000
|
||||
|
||||
# Secondary LLM for pipeline tasks — uses Ollama on 3060 (non-reasoning model)
|
||||
# Secondary LLM for pipeline tasks — uses LFM on 3060 (llama.cpp)
|
||||
llm_pipeline:
|
||||
base_url: http://100.64.0.4:11434
|
||||
model: qwen2.5:7b
|
||||
base_url: http://100.64.0.4:8080
|
||||
model: C:\models\LFM2.5-2.6B-Q4_K_M.gguf
|
||||
api_key: ""
|
||||
max_tokens: 6000
|
||||
|
||||
|
||||
@@ -0,0 +1,96 @@
|
||||
---
|
||||
name: blacknode-graph-workflow
|
||||
version: 1.0.0
|
||||
description: Build and execute node-based AI workflows with LLM agents and processing
|
||||
nodes
|
||||
inputs:
|
||||
- Model configuration (NIM_MODEL, API keys for NVIDIA NIM, OpenAI, Anthropic)
|
||||
- Node definitions with specified inputs and outputs (Literal, LLMAgent, FileWrite,
|
||||
etc.)
|
||||
- Data sources (URLs, text content, or other inputs for the workflow)
|
||||
steps:
|
||||
- Initialize a blacknode.Graph instance to create the workflow structure
|
||||
- Add nodes to the graph with defined inputs and outputs (e.g., Literal, LLMAgent,
|
||||
FileWrite)
|
||||
- Define edges connecting nodes to establish data flow between them
|
||||
- Execute the graph using cook() to run the workflow and generate outputs
|
||||
outputs:
|
||||
- Processed results from the final node (e.g., printed text, written files, or generated
|
||||
data)
|
||||
- Graph execution status and any errors encountered during execution
|
||||
tags: []
|
||||
metadata:
|
||||
source_repo: https://github.com/temiroff/Blacknode.git
|
||||
extracted_at: ''
|
||||
confidence: 0.95
|
||||
---
|
||||
|
||||
# blacknode-graph-workflow
|
||||
|
||||
Build and execute node-based AI workflows with LLM agents and processing nodes
|
||||
|
||||
## Setup
|
||||
|
||||
**Dependencies:**
|
||||
|
||||
```text
|
||||
pip install blacknode (core package) anthropic>=0.25 openai>=1.0 petgraph (for graph operations)
|
||||
```
|
||||
|
||||
**Setup steps:**
|
||||
|
||||
1. Install blacknode package: pip install blacknode
|
||||
1. Configure model API keys (NIM_API_KEY, OPENAI_API_KEY, etc.) in .env or editor
|
||||
1. Create a Graph instance and add nodes with inputs/outputs
|
||||
1. Define node connections in g._edges list
|
||||
1. Execute with g.cook() to run the workflow and capture results
|
||||
|
||||
## Key Files
|
||||
|
||||
- `blacknode/blacknode.py (Graph class implementation)`
|
||||
- `examples/hello_agent.py (simple LLM agent workflow)`
|
||||
- `examples/converted_nvidia_nim.py (NIM model workflow)`
|
||||
|
||||
## Steps
|
||||
|
||||
1. Initialize a blacknode.Graph instance to create the workflow structure
|
||||
2. Add nodes to the graph with defined inputs and outputs (e.g., Literal, LLMAgent, FileWrite)
|
||||
3. Define edges connecting nodes to establish data flow between them
|
||||
4. Execute the graph using cook() to run the workflow and generate outputs
|
||||
|
||||
## Implementation Details
|
||||
|
||||
```python
|
||||
g = bn.Graph()
|
||||
```
|
||||
|
||||
```python
|
||||
g._edges = [{'from': 'model', 'from_port': 'value', 'to': 'agent', 'to_port': 'model'}]
|
||||
```
|
||||
|
||||
```python
|
||||
result = g.cook(output_node, 'value')
|
||||
```
|
||||
|
||||
## Inputs
|
||||
|
||||
- Model configuration (NIM_MODEL, API keys for NVIDIA NIM, OpenAI, Anthropic)
|
||||
- Node definitions with specified inputs and outputs (Literal, LLMAgent, FileWrite, etc.)
|
||||
- Data sources (URLs, text content, or other inputs for the workflow)
|
||||
|
||||
## Outputs
|
||||
|
||||
- Processed results from the final node (e.g., printed text, written files, or generated data)
|
||||
- Graph execution status and any errors encountered during execution
|
||||
|
||||
## Failure Modes
|
||||
|
||||
- Missing or invalid model API key causing graph initialization failure
|
||||
- Incorrect node connections or missing edge definitions leading to runtime errors
|
||||
- Model not found or unavailable in the specified environment causing execution failure
|
||||
- Graph edges not properly defined or mismatched causing cook() to fail
|
||||
|
||||
## Source
|
||||
|
||||
Extracted from: [https://github.com/temiroff/Blacknode.git](https://github.com/temiroff/Blacknode.git)
|
||||
Confidence: 0.95
|
||||
@@ -0,0 +1,6 @@
|
||||
# Commands: blacknode-graph-workflow
|
||||
|
||||
## Available Commands
|
||||
|
||||
- `/skill blacknode-graph-workflow` — Load this skill
|
||||
- `/run blacknode-graph-workflow` — Execute workflow
|
||||
@@ -0,0 +1,10 @@
|
||||
# Examples: blacknode-graph-workflow
|
||||
|
||||
## Usage Example
|
||||
|
||||
```python
|
||||
# How to use this skill
|
||||
# Inputs: Model configuration (NIM_MODEL, API keys for NVIDIA NIM, OpenAI, Anthropic), Node definitions with specified inputs and outputs (Literal, LLMAgent, FileWrite, etc.), Data sources (URLs, text content, or other inputs for the workflow)
|
||||
# Process: Initialize a blacknode.Graph instance to create the workflow structure → Add nodes to the graph with defined inputs and outputs (e.g., Literal, LLMAgent, FileWrite) → Define edges connecting nodes to establish data flow between them
|
||||
# Outputs: Processed results from the final node (e.g., printed text, written files, or generated data), Graph execution status and any errors encountered during execution
|
||||
```
|
||||
@@ -0,0 +1,30 @@
|
||||
{
|
||||
"name": "blacknode-graph-workflow",
|
||||
"version": "1.0.0",
|
||||
"goal": "Build and execute node-based AI workflows with LLM agents and processing nodes",
|
||||
"inputs": [
|
||||
"Model configuration (NIM_MODEL, API keys for NVIDIA NIM, OpenAI, Anthropic)",
|
||||
"Node definitions with specified inputs and outputs (Literal, LLMAgent, FileWrite, etc.)",
|
||||
"Data sources (URLs, text content, or other inputs for the workflow)"
|
||||
],
|
||||
"steps": [
|
||||
"Initialize a blacknode.Graph instance to create the workflow structure",
|
||||
"Add nodes to the graph with defined inputs and outputs (e.g., Literal, LLMAgent, FileWrite)",
|
||||
"Define edges connecting nodes to establish data flow between them",
|
||||
"Execute the graph using cook() to run the workflow and generate outputs"
|
||||
],
|
||||
"outputs": [
|
||||
"Processed results from the final node (e.g., printed text, written files, or generated data)",
|
||||
"Graph execution status and any errors encountered during execution"
|
||||
],
|
||||
"failure_modes": [
|
||||
"Missing or invalid model API key causing graph initialization failure",
|
||||
"Incorrect node connections or missing edge definitions leading to runtime errors",
|
||||
"Model not found or unavailable in the specified environment causing execution failure",
|
||||
"Graph edges not properly defined or mismatched causing cook() to fail"
|
||||
],
|
||||
"confidence": 0.95,
|
||||
"explanation": "Blacknode provides a standardized Graph-based workflow pattern where users create node graphs using the blacknode.Graph class. This pattern is reusable across projects as it follows a consistent structure: initialize a graph, add nodes with defined inputs/outputs, connect them with edges, and execute with cook(). The examples demonstrate this pattern with LLM agents and text processing pipelines, making it adaptable to various robotics and AI workflows.",
|
||||
"source_repo": "https://github.com/temiroff/Blacknode.git",
|
||||
"score": 1.0
|
||||
}
|
||||
@@ -0,0 +1,9 @@
|
||||
# Tests: blacknode-graph-workflow
|
||||
|
||||
## Test Checklist
|
||||
|
||||
- [ ] Workflow has at least 3 steps
|
||||
- [ ] All inputs are defined
|
||||
- [ ] All outputs are defined
|
||||
- [ ] Failure modes are documented
|
||||
- [ ] Skill can be loaded without errors
|
||||
@@ -0,0 +1,115 @@
|
||||
---
|
||||
name: langgraph-agent-workflow
|
||||
version: 1.0.0
|
||||
description: Orchestrate multi-step AI agents using LangGraph with SerperDevTool for
|
||||
RAG, code execution, and citation generation
|
||||
inputs:
|
||||
- LangGraph chain configuration files defining agent workflows
|
||||
- SerperDevTool integration for LLM tool access
|
||||
- React agent creation scripts via create_react_agent
|
||||
- Knowledge graph retrieval and citation generation pipelines
|
||||
steps:
|
||||
- 'Step 1: Define LangGraph chain architecture with SerperDevTool integration - Create
|
||||
a LangGraph chain that combines retrieval, reasoning, and response generation using
|
||||
SerperDevTool for tool access'
|
||||
- 'Step 2: Implement React agent wrapper - Use create_react_agent to build a frontend
|
||||
agent that can interact with the LangGraph chain'
|
||||
- 'Step 3: Configure RAG pipeline - Set up vector search (Qdrant/OpenSearch) and knowledge
|
||||
graph retrieval (Neo4j/ArangoDB) with citation generation'
|
||||
- 'Step 4: Add code execution sandbox - Integrate artifact generation capabilities
|
||||
for code-related tasks'
|
||||
- "Step 5: Orchestrate multi-step research workflow - Chain search \u2192 deep research\
|
||||
\ \u2192 agent response in a single LangGraph workflow"
|
||||
outputs:
|
||||
- Reusable LangGraph chain definition (pyfile) with configurable steps
|
||||
- React agent frontend component that can be deployed independently
|
||||
- RAG pipeline that generates block citations and grounded answers
|
||||
- Code execution sandbox for artifact generation
|
||||
- Documentation for parameterizing workflows for different tasks
|
||||
tags: []
|
||||
metadata:
|
||||
source_repo: https://github.com/pipeshub-ai/pipeshub-ai.git
|
||||
extracted_at: ''
|
||||
confidence: 0.95
|
||||
---
|
||||
|
||||
# langgraph-agent-workflow
|
||||
|
||||
Orchestrate multi-step AI agents using LangGraph with SerperDevTool for RAG, code execution, and citation generation
|
||||
|
||||
## Setup
|
||||
|
||||
**Dependencies:**
|
||||
|
||||
```text
|
||||
pip install langgraph>=0.7.0 serper-dev-tool>=0.1.0 qdrant-client or opensearch-dsl neo4j-driver or arango-database-driver react, next.js
|
||||
```
|
||||
|
||||
**Setup steps:**
|
||||
|
||||
1. Install LangGraph and SerperDevTool dependencies
|
||||
1. Configure vector store (Qdrant/OpenSearch) and knowledge graph (Neo4j/ArangoDB)
|
||||
1. Define chain topology with retrieval, reasoning, and response steps
|
||||
1. Build React agent frontend using create_react_agent
|
||||
1. Test multi-step agent workflows end-to-end
|
||||
|
||||
## Key Files
|
||||
|
||||
- `pipeshub-ai/workflows/agent_chain.py - Main LangGraph chain definition`
|
||||
- `pipeshub-ai/workflows/agent_react.py - React agent wrapper`
|
||||
- `pipeshub-ai/workflows/rag_pipeline.py - RAG with citation generation`
|
||||
- `pipeshub-ai/workflows/code_sandbox.py - Code execution sandbox`
|
||||
|
||||
## Steps
|
||||
|
||||
1. Step 1: Define LangGraph chain architecture with SerperDevTool integration - Create a LangGraph chain that combines retrieval, reasoning, and response generation using SerperDevTool for tool access
|
||||
2. Step 2: Implement React agent wrapper - Use create_react_agent to build a frontend agent that can interact with the LangGraph chain
|
||||
3. Step 3: Configure RAG pipeline - Set up vector search (Qdrant/OpenSearch) and knowledge graph retrieval (Neo4j/ArangoDB) with citation generation
|
||||
4. Step 4: Add code execution sandbox - Integrate artifact generation capabilities for code-related tasks
|
||||
5. Step 5: Orchestrate multi-step research workflow - Chain search → deep research → agent response in a single LangGraph workflow
|
||||
|
||||
## Implementation Details
|
||||
|
||||
```python
|
||||
chain = LangGraph()
|
||||
```
|
||||
|
||||
```python
|
||||
chain.add_step(SerperDevToolAgent())
|
||||
```
|
||||
|
||||
```python
|
||||
agent = create_react_agent(chain, SerperDevToolAgent())
|
||||
```
|
||||
|
||||
```python
|
||||
workflow = chain.start()
|
||||
```
|
||||
|
||||
## Inputs
|
||||
|
||||
- LangGraph chain configuration files defining agent workflows
|
||||
- SerperDevTool integration for LLM tool access
|
||||
- React agent creation scripts via create_react_agent
|
||||
- Knowledge graph retrieval and citation generation pipelines
|
||||
|
||||
## Outputs
|
||||
|
||||
- Reusable LangGraph chain definition (pyfile) with configurable steps
|
||||
- React agent frontend component that can be deployed independently
|
||||
- RAG pipeline that generates block citations and grounded answers
|
||||
- Code execution sandbox for artifact generation
|
||||
- Documentation for parameterizing workflows for different tasks
|
||||
|
||||
## Failure Modes
|
||||
|
||||
- GraphDB connection failures if Neo4j/ArangoDB is not properly configured
|
||||
- Vector store unavailability (Qdrant/OpenSearch) causing RAG pipeline to fail
|
||||
- LLM tool access errors if SerperDevTool is not properly initialized
|
||||
- Agent timeout if complex multi-step reasoning exceeds time limits
|
||||
- Sandbox execution failures if code has security vulnerabilities or infinite loops
|
||||
|
||||
## Source
|
||||
|
||||
Extracted from: [https://github.com/pipeshub-ai/pipeshub-ai.git](https://github.com/pipeshub-ai/pipeshub-ai.git)
|
||||
Confidence: 0.95
|
||||
@@ -0,0 +1,6 @@
|
||||
# Commands: langgraph-agent-workflow
|
||||
|
||||
## Available Commands
|
||||
|
||||
- `/skill langgraph-agent-workflow` — Load this skill
|
||||
- `/run langgraph-agent-workflow` — Execute workflow
|
||||
@@ -0,0 +1,10 @@
|
||||
# Examples: langgraph-agent-workflow
|
||||
|
||||
## Usage Example
|
||||
|
||||
```python
|
||||
# How to use this skill
|
||||
# Inputs: LangGraph chain configuration files defining agent workflows, SerperDevTool integration for LLM tool access, React agent creation scripts via create_react_agent, Knowledge graph retrieval and citation generation pipelines
|
||||
# Process: Step 1: Define LangGraph chain architecture with SerperDevTool integration - Create a LangGraph chain that combines retrieval, reasoning, and response generation using SerperDevTool for tool access → Step 2: Implement React agent wrapper - Use create_react_agent to build a frontend agent that can interact with the LangGraph chain → Step 3: Configure RAG pipeline - Set up vector search (Qdrant/OpenSearch) and knowledge graph retrieval (Neo4j/ArangoDB) with citation generation
|
||||
# Outputs: Reusable LangGraph chain definition (pyfile) with configurable steps, React agent frontend component that can be deployed independently, RAG pipeline that generates block citations and grounded answers, Code execution sandbox for artifact generation, Documentation for parameterizing workflows for different tasks
|
||||
```
|
||||
@@ -0,0 +1,36 @@
|
||||
{
|
||||
"name": "langgraph-agent-workflow",
|
||||
"version": "1.0.0",
|
||||
"goal": "Orchestrate multi-step AI agents using LangGraph with SerperDevTool for RAG, code execution, and citation generation",
|
||||
"inputs": [
|
||||
"LangGraph chain configuration files defining agent workflows",
|
||||
"SerperDevTool integration for LLM tool access",
|
||||
"React agent creation scripts via create_react_agent",
|
||||
"Knowledge graph retrieval and citation generation pipelines"
|
||||
],
|
||||
"steps": [
|
||||
"Step 1: Define LangGraph chain architecture with SerperDevTool integration - Create a LangGraph chain that combines retrieval, reasoning, and response generation using SerperDevTool for tool access",
|
||||
"Step 2: Implement React agent wrapper - Use create_react_agent to build a frontend agent that can interact with the LangGraph chain",
|
||||
"Step 3: Configure RAG pipeline - Set up vector search (Qdrant/OpenSearch) and knowledge graph retrieval (Neo4j/ArangoDB) with citation generation",
|
||||
"Step 4: Add code execution sandbox - Integrate artifact generation capabilities for code-related tasks",
|
||||
"Step 5: Orchestrate multi-step research workflow - Chain search \u2192 deep research \u2192 agent response in a single LangGraph workflow"
|
||||
],
|
||||
"outputs": [
|
||||
"Reusable LangGraph chain definition (pyfile) with configurable steps",
|
||||
"React agent frontend component that can be deployed independently",
|
||||
"RAG pipeline that generates block citations and grounded answers",
|
||||
"Code execution sandbox for artifact generation",
|
||||
"Documentation for parameterizing workflows for different tasks"
|
||||
],
|
||||
"failure_modes": [
|
||||
"GraphDB connection failures if Neo4j/ArangoDB is not properly configured",
|
||||
"Vector store unavailability (Qdrant/OpenSearch) causing RAG pipeline to fail",
|
||||
"LLM tool access errors if SerperDevTool is not properly initialized",
|
||||
"Agent timeout if complex multi-step reasoning exceeds time limits",
|
||||
"Sandbox execution failures if code has security vulnerabilities or infinite loops"
|
||||
],
|
||||
"confidence": 0.95,
|
||||
"explanation": "PipesHub provides a reusable LangGraph-based agent workflow framework that can be parameterized for different tasks. The core pattern involves defining a LangGraph chain with SerperDevTool integration for tool access, creating a React agent wrapper, and configuring RAG pipelines with citation generation. This framework can be reused across RAG, code execution, and research workflows by adjusting the chain definition and agent configuration.",
|
||||
"source_repo": "https://github.com/pipeshub-ai/pipeshub-ai.git",
|
||||
"score": 1.0
|
||||
}
|
||||
@@ -0,0 +1,9 @@
|
||||
# Tests: langgraph-agent-workflow
|
||||
|
||||
## Test Checklist
|
||||
|
||||
- [ ] Workflow has at least 3 steps
|
||||
- [ ] All inputs are defined
|
||||
- [ ] All outputs are defined
|
||||
- [ ] Failure modes are documented
|
||||
- [ ] Skill can be loaded without errors
|
||||
@@ -0,0 +1,89 @@
|
||||
---
|
||||
name: langgraph-csv-workflow
|
||||
version: 1.0.0
|
||||
description: Transform simple CSV files into powerful AI agent workflows using LangGraph
|
||||
orchestration
|
||||
inputs:
|
||||
- 'CSV workflow files with columns: graph_name, node_name, agent_type, next_node,
|
||||
on_failure, prompt, input_fields, output_field'
|
||||
- LLM provider configuration (OpenAI, Anthropic, Google) in agentmap_config.yaml
|
||||
- Storage configuration for CSV/JSON/Vector DBs in agentmap_config_storage.yaml
|
||||
steps:
|
||||
- Define workflow in CSV format specifying graph nodes, agent types, and data flow
|
||||
between them
|
||||
- Configure LLM providers and storage backends in the agentmap configuration files
|
||||
- Execute the workflow using the agentmap CLI or Python API
|
||||
outputs:
|
||||
- Executed workflow with agent decisions and state transitions
|
||||
- Traced execution path through the graph nodes
|
||||
- Logged agent interactions and output fields populated
|
||||
tags: []
|
||||
metadata:
|
||||
source_repo: https://github.com/jwwelbor/AgentMap.git
|
||||
extracted_at: ''
|
||||
confidence: 0.95
|
||||
---
|
||||
|
||||
# langgraph-csv-workflow
|
||||
|
||||
Transform simple CSV files into powerful AI agent workflows using LangGraph orchestration
|
||||
|
||||
## Setup
|
||||
|
||||
**Dependencies:**
|
||||
|
||||
```text
|
||||
pip install langgraph>=1.0.0 langchain-core>=0.3.0 pyyaml fastapi uvicorn
|
||||
```
|
||||
|
||||
**Setup steps:**
|
||||
|
||||
1. Install agentmap: pip install agentmap[all]
|
||||
1. Initialize configuration: agentmap init-config
|
||||
1. Configure LLM providers in agentmap_config.yaml
|
||||
1. Run workflow: agentmap run workflow.csv
|
||||
|
||||
## Key Files
|
||||
|
||||
- `agentmap_config.yaml - Main configuration for LLM providers and paths`
|
||||
- `agentmap_config_storage.yaml - Storage configuration for CSV/JSON/Vector DBs`
|
||||
- `hello_world.csv - Sample workflow definition`
|
||||
|
||||
## Steps
|
||||
|
||||
1. Define workflow in CSV format specifying graph nodes, agent types, and data flow between them
|
||||
2. Configure LLM providers and storage backends in the agentmap configuration files
|
||||
3. Execute the workflow using the agentmap CLI or Python API
|
||||
|
||||
## Implementation Details
|
||||
|
||||
```python
|
||||
CSV format: graph_name,node_name,agent_type,next_node,on_failure,prompt,input_fields,output_field
|
||||
```
|
||||
|
||||
```python
|
||||
CLI command: agentmap run hello_world.csv --pretty
|
||||
```
|
||||
|
||||
## Inputs
|
||||
|
||||
- CSV workflow files with columns: graph_name, node_name, agent_type, next_node, on_failure, prompt, input_fields, output_field
|
||||
- LLM provider configuration (OpenAI, Anthropic, Google) in agentmap_config.yaml
|
||||
- Storage configuration for CSV/JSON/Vector DBs in agentmap_config_storage.yaml
|
||||
|
||||
## Outputs
|
||||
|
||||
- Executed workflow with agent decisions and state transitions
|
||||
- Traced execution path through the graph nodes
|
||||
- Logged agent interactions and output fields populated
|
||||
|
||||
## Failure Modes
|
||||
|
||||
- Invalid CSV format causing parse errors during workflow loading
|
||||
- Missing or misconfigured LLM provider credentials leading to runtime failures
|
||||
- Incorrect agent configuration (e.g., missing input_fields) causing processing errors
|
||||
|
||||
## Source
|
||||
|
||||
Extracted from: [https://github.com/jwwelbor/AgentMap.git](https://github.com/jwwelbor/AgentMap.git)
|
||||
Confidence: 0.95
|
||||
@@ -0,0 +1,6 @@
|
||||
# Commands: langgraph-csv-workflow
|
||||
|
||||
## Available Commands
|
||||
|
||||
- `/skill langgraph-csv-workflow` — Load this skill
|
||||
- `/run langgraph-csv-workflow` — Execute workflow
|
||||
@@ -0,0 +1,10 @@
|
||||
# Examples: langgraph-csv-workflow
|
||||
|
||||
## Usage Example
|
||||
|
||||
```python
|
||||
# How to use this skill
|
||||
# Inputs: CSV workflow files with columns: graph_name, node_name, agent_type, next_node, on_failure, prompt, input_fields, output_field, LLM provider configuration (OpenAI, Anthropic, Google) in agentmap_config.yaml, Storage configuration for CSV/JSON/Vector DBs in agentmap_config_storage.yaml
|
||||
# Process: Define workflow in CSV format specifying graph nodes, agent types, and data flow between them → Configure LLM providers and storage backends in the agentmap configuration files → Execute the workflow using the agentmap CLI or Python API
|
||||
# Outputs: Executed workflow with agent decisions and state transitions, Traced execution path through the graph nodes, Logged agent interactions and output fields populated
|
||||
```
|
||||
@@ -0,0 +1,29 @@
|
||||
{
|
||||
"name": "langgraph-csv-workflow",
|
||||
"version": "1.0.0",
|
||||
"goal": "Transform simple CSV files into powerful AI agent workflows using LangGraph orchestration",
|
||||
"inputs": [
|
||||
"CSV workflow files with columns: graph_name, node_name, agent_type, next_node, on_failure, prompt, input_fields, output_field",
|
||||
"LLM provider configuration (OpenAI, Anthropic, Google) in agentmap_config.yaml",
|
||||
"Storage configuration for CSV/JSON/Vector DBs in agentmap_config_storage.yaml"
|
||||
],
|
||||
"steps": [
|
||||
"Define workflow in CSV format specifying graph nodes, agent types, and data flow between them",
|
||||
"Configure LLM providers and storage backends in the agentmap configuration files",
|
||||
"Execute the workflow using the agentmap CLI or Python API"
|
||||
],
|
||||
"outputs": [
|
||||
"Executed workflow with agent decisions and state transitions",
|
||||
"Traced execution path through the graph nodes",
|
||||
"Logged agent interactions and output fields populated"
|
||||
],
|
||||
"failure_modes": [
|
||||
"Invalid CSV format causing parse errors during workflow loading",
|
||||
"Missing or misconfigured LLM provider credentials leading to runtime failures",
|
||||
"Incorrect agent configuration (e.g., missing input_fields) causing processing errors"
|
||||
],
|
||||
"confidence": 0.95,
|
||||
"explanation": "AgentMap provides a declarative pattern where workflows are defined in CSV files with specific columns describing graph nodes, agent types, and data flow. This pattern can be adapted to create multi-agent systems with LangGraph, supporting various LLM providers and storage backends. The workflow is reusable across different use cases by simply modifying the CSV definition.",
|
||||
"source_repo": "https://github.com/jwwelbor/AgentMap.git",
|
||||
"score": 1.0
|
||||
}
|
||||
@@ -0,0 +1,9 @@
|
||||
# Tests: langgraph-csv-workflow
|
||||
|
||||
## Test Checklist
|
||||
|
||||
- [ ] Workflow has at least 3 steps
|
||||
- [ ] All inputs are defined
|
||||
- [ ] All outputs are defined
|
||||
- [ ] Failure modes are documented
|
||||
- [ ] Skill can be loaded without errors
|
||||
@@ -0,0 +1,113 @@
|
||||
---
|
||||
name: multi-agent-workflow-execution
|
||||
version: 1.0.0
|
||||
description: Execute multi-agent AI workflows defined in YAML blueprints by creating
|
||||
sessions, submitting user prompts, and polling for completion until final answers
|
||||
are returned.
|
||||
inputs:
|
||||
- Blueprint ID or name (to identify the workflow to execute)
|
||||
- User shortcut (authentication identifier for the user)
|
||||
- User question or prompt (input to the workflow)
|
||||
- Base URL of the UnifAI API (endpoint for session management)
|
||||
- Polling interval (seconds between status checks during execution)
|
||||
steps:
|
||||
- Resolve the blueprint ID from either direct ID or name lookup via the API, handling
|
||||
cases where the blueprint is not found or not unique
|
||||
- Create a new session from the resolved blueprint using the session creation endpoint
|
||||
- Submit the session with the user's prompt to start the multi-agent workflow execution
|
||||
- Poll the session status at regular intervals until the session completes, fails,
|
||||
or is cancelled
|
||||
- Retrieve and return the final answer from the completed workflow
|
||||
outputs:
|
||||
- Final workflow result or answer (text or structured data)
|
||||
- Session status (completed, failed, or cancelled)
|
||||
- Error details if the workflow execution fails or times out
|
||||
tags: []
|
||||
metadata:
|
||||
source_repo: https://github.com/redhat-community-ai-tools/UnifAI.git
|
||||
extracted_at: ''
|
||||
confidence: 0.95
|
||||
---
|
||||
|
||||
# multi-agent-workflow-execution
|
||||
|
||||
Execute multi-agent AI workflows defined in YAML blueprints by creating sessions, submitting user prompts, and polling for completion until final answers are returned.
|
||||
|
||||
## Setup
|
||||
|
||||
**Dependencies:**
|
||||
|
||||
```text
|
||||
pip install requests urllib3 python-langgraph temporalio
|
||||
```
|
||||
|
||||
**Setup steps:**
|
||||
|
||||
1. Install Python 3.11+ and required packages (requests, langgraph, temporalio)
|
||||
1. Configure API base URL and user credentials in environment variables or config
|
||||
1. Define or select a blueprint from the available workflows in the system
|
||||
1. Run the execution_workflow.py script with blueprint ID/name and user prompt
|
||||
|
||||
## Key Files
|
||||
|
||||
- `scripts/execution_workflow.py - Main workflow execution script`
|
||||
- `multi-agent/lib/mas/engine/ - LangGraph-based orchestration modules`
|
||||
- `multi-agent/lib/mas/elements/ - Node definitions (custom_agent_node, merger_node, etc.)`
|
||||
- `multi-agent/lib/mas/blueprints/ - Blueprint resolution and validation logic`
|
||||
|
||||
## Steps
|
||||
|
||||
1. Resolve the blueprint ID from either direct ID or name lookup via the API, handling cases where the blueprint is not found or not unique
|
||||
2. Create a new session from the resolved blueprint using the session creation endpoint
|
||||
3. Submit the session with the user's prompt to start the multi-agent workflow execution
|
||||
4. Poll the session status at regular intervals until the session completes, fails, or is cancelled
|
||||
5. Retrieve and return the final answer from the completed workflow
|
||||
|
||||
## Implementation Details
|
||||
|
||||
```python
|
||||
resolve_blueprint_id() - Resolves blueprint by ID or name lookup with error handling
|
||||
```
|
||||
|
||||
```python
|
||||
create_session() - Creates a new session from a blueprint via POST /user.session.create
|
||||
```
|
||||
|
||||
```python
|
||||
submit_session() - Submits user prompt to start workflow via POST /user.session.submit
|
||||
```
|
||||
|
||||
```python
|
||||
poll_session_status() - Polls session.stream.status at configurable intervals
|
||||
```
|
||||
|
||||
```python
|
||||
get_final_answer() - Retrieves final output via GET /session.chat.get
|
||||
```
|
||||
|
||||
## Inputs
|
||||
|
||||
- Blueprint ID or name (to identify the workflow to execute)
|
||||
- User shortcut (authentication identifier for the user)
|
||||
- User question or prompt (input to the workflow)
|
||||
- Base URL of the UnifAI API (endpoint for session management)
|
||||
- Polling interval (seconds between status checks during execution)
|
||||
|
||||
## Outputs
|
||||
|
||||
- Final workflow result or answer (text or structured data)
|
||||
- Session status (completed, failed, or cancelled)
|
||||
- Error details if the workflow execution fails or times out
|
||||
|
||||
## Failure Modes
|
||||
|
||||
- Blueprint not found or not unique - script exits with an error listing available blueprints
|
||||
- Session creation fails - may be due to invalid blueprint ID, authentication issues, or rate limiting
|
||||
- Session submission fails - could be due to network issues, invalid parameters, or API rate limits
|
||||
- Polling loop times out - session may be stuck in a long-running state without progress
|
||||
- Final answer retrieval fails - could be due to session cleanup or network issues after completion
|
||||
|
||||
## Source
|
||||
|
||||
Extracted from: [https://github.com/redhat-community-ai-tools/UnifAI.git](https://github.com/redhat-community-ai-tools/UnifAI.git)
|
||||
Confidence: 0.95
|
||||
@@ -0,0 +1,6 @@
|
||||
# Commands: multi-agent-workflow-execution
|
||||
|
||||
## Available Commands
|
||||
|
||||
- `/skill multi-agent-workflow-execution` — Load this skill
|
||||
- `/run multi-agent-workflow-execution` — Execute workflow
|
||||
@@ -0,0 +1,10 @@
|
||||
# Examples: multi-agent-workflow-execution
|
||||
|
||||
## Usage Example
|
||||
|
||||
```python
|
||||
# How to use this skill
|
||||
# Inputs: Blueprint ID or name (to identify the workflow to execute), User shortcut (authentication identifier for the user), User question or prompt (input to the workflow), Base URL of the UnifAI API (endpoint for session management), Polling interval (seconds between status checks during execution)
|
||||
# Process: Resolve the blueprint ID from either direct ID or name lookup via the API, handling cases where the blueprint is not found or not unique → Create a new session from the resolved blueprint using the session creation endpoint → Submit the session with the user's prompt to start the multi-agent workflow execution
|
||||
# Outputs: Final workflow result or answer (text or structured data), Session status (completed, failed, or cancelled), Error details if the workflow execution fails or times out
|
||||
```
|
||||
@@ -0,0 +1,35 @@
|
||||
{
|
||||
"name": "multi-agent-workflow-execution",
|
||||
"version": "1.0.0",
|
||||
"goal": "Execute multi-agent AI workflows defined in YAML blueprints by creating sessions, submitting user prompts, and polling for completion until final answers are returned.",
|
||||
"inputs": [
|
||||
"Blueprint ID or name (to identify the workflow to execute)",
|
||||
"User shortcut (authentication identifier for the user)",
|
||||
"User question or prompt (input to the workflow)",
|
||||
"Base URL of the UnifAI API (endpoint for session management)",
|
||||
"Polling interval (seconds between status checks during execution)"
|
||||
],
|
||||
"steps": [
|
||||
"Resolve the blueprint ID from either direct ID or name lookup via the API, handling cases where the blueprint is not found or not unique",
|
||||
"Create a new session from the resolved blueprint using the session creation endpoint",
|
||||
"Submit the session with the user's prompt to start the multi-agent workflow execution",
|
||||
"Poll the session status at regular intervals until the session completes, fails, or is cancelled",
|
||||
"Retrieve and return the final answer from the completed workflow"
|
||||
],
|
||||
"outputs": [
|
||||
"Final workflow result or answer (text or structured data)",
|
||||
"Session status (completed, failed, or cancelled)",
|
||||
"Error details if the workflow execution fails or times out"
|
||||
],
|
||||
"failure_modes": [
|
||||
"Blueprint not found or not unique - script exits with an error listing available blueprints",
|
||||
"Session creation fails - may be due to invalid blueprint ID, authentication issues, or rate limiting",
|
||||
"Session submission fails - could be due to network issues, invalid parameters, or API rate limits",
|
||||
"Polling loop times out - session may be stuck in a long-running state without progress",
|
||||
"Final answer retrieval fails - could be due to session cleanup or network issues after completion"
|
||||
],
|
||||
"confidence": 0.95,
|
||||
"explanation": "The UnifAI repository contains a concrete, reusable workflow pattern for executing multi-agent AI workflows. The scripts/execution_workflow.py script demonstrates a complete pipeline: resolving blueprints by ID or name, creating sessions from blueprints, submitting user prompts to start workflows, polling session status until completion, and retrieving final answers. This pattern can be adapted to any multi-agent workflow defined in the YAML blueprint system, making it reusable across different use cases and teams.",
|
||||
"source_repo": "https://github.com/redhat-community-ai-tools/UnifAI.git",
|
||||
"score": 1.0
|
||||
}
|
||||
@@ -0,0 +1,9 @@
|
||||
# Tests: multi-agent-workflow-execution
|
||||
|
||||
## Test Checklist
|
||||
|
||||
- [ ] Workflow has at least 3 steps
|
||||
- [ ] All inputs are defined
|
||||
- [ ] All outputs are defined
|
||||
- [ ] Failure modes are documented
|
||||
- [ ] Skill can be loaded without errors
|
||||
@@ -0,0 +1,94 @@
|
||||
---
|
||||
name: three-tier-evaluation-pipeline
|
||||
version: 1.0.0
|
||||
description: Run tasks through three evaluation tiers (Run, Trace, Thread) to produce
|
||||
comprehensive reports with human-in-the-loop validation
|
||||
inputs:
|
||||
- query/input text for the task
|
||||
- search results (for trace tier evaluation)
|
||||
- evaluation criteria and thresholds
|
||||
steps:
|
||||
- 'Step 1: Execute the main task using the Run tier of the evaluation pipeline (agentkit/runtime/LangGraph
|
||||
engine) to generate initial outputs and results'
|
||||
- 'Step 2: Run the Trace tier where an LLM-as-Judge evaluates the output against defined
|
||||
criteria, generating detailed analysis and scoring'
|
||||
- 'Step 3: Execute the Thread tier which facilitates human-in-the-loop discussion,
|
||||
approval, and iterative refinement of the output'
|
||||
outputs:
|
||||
- Final consolidated report combining results from all three tiers
|
||||
- Detailed scores and metrics per tier
|
||||
- Threaded discussion logs for human review and approval
|
||||
tags: []
|
||||
metadata:
|
||||
source_repo: https://github.com/itszhaoziyan-n/AgentKit.git
|
||||
extracted_at: ''
|
||||
confidence: 0.95
|
||||
---
|
||||
|
||||
# three-tier-evaluation-pipeline
|
||||
|
||||
Run tasks through three evaluation tiers (Run, Trace, Thread) to produce comprehensive reports with human-in-the-loop validation
|
||||
|
||||
## Setup
|
||||
|
||||
**Dependencies:**
|
||||
|
||||
```text
|
||||
pip install langgraph>=0.3 langchain-core>=0.3 langchain-anthropic>=0.3 langfuse>=2.0 mcp[server]>=1.24 tenacity>=9.0 fastapi>=0.115 psycopg[binary]>=3.1
|
||||
```
|
||||
|
||||
**Setup steps:**
|
||||
|
||||
1. Install dependencies with pip install -e .[dev]
|
||||
1. Start infrastructure: docker compose up -d (PostgreSQL, Langfuse, MCP server)
|
||||
1. Configure environment variables (DATABASE_URL, MCP_API_KEY, etc.)
|
||||
1. Run the pipeline: python -m eval.runner --tiers run,thread,trace
|
||||
|
||||
## Key Files
|
||||
|
||||
- `eval/ - contains the three-tier evaluation logic`
|
||||
- `scripts/ci_gate.py - threshold update and benchmark validation`
|
||||
- `agentkit/runtime/ - LangGraph engine for state management and graph execution`
|
||||
|
||||
## Steps
|
||||
|
||||
1. Step 1: Execute the main task using the Run tier of the evaluation pipeline (agentkit/runtime/LangGraph engine) to generate initial outputs and results
|
||||
2. Step 2: Run the Trace tier where an LLM-as-Judge evaluates the output against defined criteria, generating detailed analysis and scoring
|
||||
3. Step 3: Execute the Thread tier which facilitates human-in-the-loop discussion, approval, and iterative refinement of the output
|
||||
|
||||
## Implementation Details
|
||||
|
||||
```python
|
||||
The eval/ directory implements Run, Trace, and Thread stages with configurable tiers
|
||||
```
|
||||
|
||||
```python
|
||||
Benchmark suite (40 test cases) validates the pipeline's reliability
|
||||
```
|
||||
|
||||
```python
|
||||
CI/CD workflows (ci.yml, eval-fast.yml, eval-trace.yml) orchestrate the evaluation pipeline
|
||||
```
|
||||
|
||||
## Inputs
|
||||
|
||||
- query/input text for the task
|
||||
- search results (for trace tier evaluation)
|
||||
- evaluation criteria and thresholds
|
||||
|
||||
## Outputs
|
||||
|
||||
- Final consolidated report combining results from all three tiers
|
||||
- Detailed scores and metrics per tier
|
||||
- Threaded discussion logs for human review and approval
|
||||
|
||||
## Failure Modes
|
||||
|
||||
- If the Run tier fails (e.g., code execution error), the pipeline can retry but may produce incomplete outputs
|
||||
- If the Trace tier LLM-as-Judge produces low-quality evaluations, the Thread tier may need additional human intervention
|
||||
- Threshold mismatches between tiers could cause the pipeline to exit early or require manual adjustment
|
||||
|
||||
## Source
|
||||
|
||||
Extracted from: [https://github.com/itszhaoziyan-n/AgentKit.git](https://github.com/itszhaoziyan-n/AgentKit.git)
|
||||
Confidence: 0.95
|
||||
@@ -0,0 +1,6 @@
|
||||
# Commands: three-tier-evaluation-pipeline
|
||||
|
||||
## Available Commands
|
||||
|
||||
- `/skill three-tier-evaluation-pipeline` — Load this skill
|
||||
- `/run three-tier-evaluation-pipeline` — Execute workflow
|
||||
@@ -0,0 +1,10 @@
|
||||
# Examples: three-tier-evaluation-pipeline
|
||||
|
||||
## Usage Example
|
||||
|
||||
```python
|
||||
# How to use this skill
|
||||
# Inputs: query/input text for the task, search results (for trace tier evaluation), evaluation criteria and thresholds
|
||||
# Process: Step 1: Execute the main task using the Run tier of the evaluation pipeline (agentkit/runtime/LangGraph engine) to generate initial outputs and results → Step 2: Run the Trace tier where an LLM-as-Judge evaluates the output against defined criteria, generating detailed analysis and scoring → Step 3: Execute the Thread tier which facilitates human-in-the-loop discussion, approval, and iterative refinement of the output
|
||||
# Outputs: Final consolidated report combining results from all three tiers, Detailed scores and metrics per tier, Threaded discussion logs for human review and approval
|
||||
```
|
||||
@@ -0,0 +1,29 @@
|
||||
{
|
||||
"name": "three-tier-evaluation-pipeline",
|
||||
"version": "1.0.0",
|
||||
"goal": "Run tasks through three evaluation tiers (Run, Trace, Thread) to produce comprehensive reports with human-in-the-loop validation",
|
||||
"inputs": [
|
||||
"query/input text for the task",
|
||||
"search results (for trace tier evaluation)",
|
||||
"evaluation criteria and thresholds"
|
||||
],
|
||||
"steps": [
|
||||
"Step 1: Execute the main task using the Run tier of the evaluation pipeline (agentkit/runtime/LangGraph engine) to generate initial outputs and results",
|
||||
"Step 2: Run the Trace tier where an LLM-as-Judge evaluates the output against defined criteria, generating detailed analysis and scoring",
|
||||
"Step 3: Execute the Thread tier which facilitates human-in-the-loop discussion, approval, and iterative refinement of the output"
|
||||
],
|
||||
"outputs": [
|
||||
"Final consolidated report combining results from all three tiers",
|
||||
"Detailed scores and metrics per tier",
|
||||
"Threaded discussion logs for human review and approval"
|
||||
],
|
||||
"failure_modes": [
|
||||
"If the Run tier fails (e.g., code execution error), the pipeline can retry but may produce incomplete outputs",
|
||||
"If the Trace tier LLM-as-Judge produces low-quality evaluations, the Thread tier may need additional human intervention",
|
||||
"Threshold mismatches between tiers could cause the pipeline to exit early or require manual adjustment"
|
||||
],
|
||||
"confidence": 0.95,
|
||||
"explanation": "The AgentKit repository contains a production-ready three-tier evaluation pipeline (Run \u2192 Trace \u2192 Thread) that can be adapted to any task requiring multi-stage validation. This workflow uses LangGraph for orchestration and LangChain for tool integration, making it portable across different agent engineering scenarios. The pattern is reusable because it separates concerns into distinct stages with clear inputs/outputs, allowing teams to plug in different evaluation criteria or human reviewers as needed.",
|
||||
"source_repo": "https://github.com/itszhaoziyan-n/AgentKit.git",
|
||||
"score": 1.0
|
||||
}
|
||||
@@ -0,0 +1,9 @@
|
||||
# Tests: three-tier-evaluation-pipeline
|
||||
|
||||
## Test Checklist
|
||||
|
||||
- [ ] Workflow has at least 3 steps
|
||||
- [ ] All inputs are defined
|
||||
- [ ] All outputs are defined
|
||||
- [ ] Failure modes are documented
|
||||
- [ ] Skill can be loaded without errors
|
||||
Reference in New Issue
Block a user