Connect with Internal Systems
Overview
This tutorial guides you through creating the final version of “The Orienteer,” an advanced onboarding assistant that answers employee questions, collects feedback, and takes appropriate actions based on that feedback, including tagging relevant SMEs when needed.
The Orienteer v3 Workflow
- User asks a question
- Agent consults the shared FAQ and answers quickly if the information exists
- Otherwise, consults the company knowledge base to find the answer
- If more information is needed, searches the web for supplementary details
- Responds to the user with an answer while soliciting feedback (tagging relevant SMEs if the answer is incomplete)
- Based on feedback:
- Creates a Jira ticket if feedback indicates issues or improvements needed
- Updates the FAQ document if the answer was helpful and correct
Implementation Steps
Step 1: Update the Core Prompt to Include Feedback Collection and SME Tagging
Step 2: Create a Jira Ticket Creation Action
Create an action that can post Jira tickets based on user feedback. This action should:
- Accept parameters for ticket title, description, priority, and assignee
- Post to the ONB Credal Project
- Return confirmation when the ticket is created
Note: Ensure you have proper permissions set up for Jira actions. Only use write-actions like creating Jira tickets in public projects where appropriate.
Step 3: Create a Confluence Page Update Action
-
Create a new Agent named “Confluence Page Editor” with this description: “This assistant is an expert at updating Confluence pages. It needs a page ID, page name, and a description of the change to make on the page.”
-
Use this background prompt for the Confluence Page Editor:
-
Create two actions for this agent:
- An action to fetch HTML content from a Confluence page
- An action to overwrite a Confluence page with new content
-
Ask a Credal admin to publish this Agent and attach it as an Action to your “The Orienteer” agent.
Step 4: Update the Final Prompt to Process Feedback and Take Action
Testing Your Implementation
- Ask a question that should be in the FAQ
- Ask a question that requires searching the knowledge base
- Ask a question that might need web search
- Ask a complex question that might result in an incomplete answer to test the SME tagging functionality
- Provide positive feedback (4-5 rating) and verify the FAQ is updated
- Provide negative feedback (1-3 rating) and verify a Jira ticket is created
This implementation creates a complete feedback loop that continuously improves the onboarding experience by updating documentation and addressing issues based on real user interactions. The addition of SME tagging ensures that when The Orienteer cannot provide a complete answer, the question is directed to the appropriate expert, maintaining a high level of service even for complex or specialized inquiries.