What Website Content Review Does
Website Content Review lets you inspect and edit the text Kyrios extracted from a website URL. The edited content becomes source material that Conversation AI can reference when answering customer questions. Editing crawled website content does not update or publish changes to your live website.
Key Benefits
Website Content Review helps improve the quality of information available to Conversation AI. Key benefits include:
Improved accuracy: Correct outdated or incomplete website details.
More relevant responses: Remove navigation text, repeated content, or unrelated copy.
Better customer experience: Keep AI answers aligned with services, policies, pricing, locations, and hours.
Greater control: Adjust AI source content without changing the live website.
Easier maintenance: Review edited website sources before refreshing or re-crawling.
Website Sources and Crawled Content
Website sources are knowledge sources used by Conversation AI. A Web Crawler source can include content from URLs, paths, domains, and supported website pages. Depending on the website structure, crawled content may include visible page text, tabs, accordions, lazy-loaded sections, and other interactive page areas.
When to Edit Crawled Website Content
Edit crawled content when the website text is not ideal for AI-generated answers. Common reasons to edit include:
Old pricing or expired promotions
Incorrect business hours or locations
Vague or unclear service descriptions
Duplicate header, footer, or menu text
Missing context needed for customer questions
Content that belongs on the website but should not be used by AI
How to Open Website Content Review
Go to AI Agents.
Open the relevant bot or knowledge base.
Click Knowledge sources.
Click the Web Crawler tab.
Find the website URL.
Click the content review icon in the Actions column.
How to Review and Edit Crawled Website Content
After clicking the content review icon, Kyrios opens the Data scraped from website window. Use this window to review the extracted website content. You can:
Remove outdated information
Delete irrelevant website text
Clean up duplicated content
Add missing context
Rewrite unclear sections
Save the revised source content
Once saved, the updated content becomes available for Conversation AI to reference in future responses.
Refreshing or Re-Crawling Website Content
Refreshing or re-crawling a website source retrieves the latest content from the live website. Use refresh when the live website has been updated, and Conversation AI should use the newer page content. Refreshing or re-crawling may overwrite manual edits. Review and copy important edits before refreshing a source.
Auto Refresh
Auto Refresh can re-crawl and retrain web URL sources on a set schedule. Use Auto Refresh carefully when a website source contains manual edits. Scheduled refreshes are designed to keep knowledge sources synced with the latest website content, which may replace edited content.
Reviewing Source Usage From Conversations
Website Content Review is best for cleaning source material before or after bot testing. When troubleshooting a specific AI response, use AI Response Info in Conversations to see which prompts, intents, actions, and knowledge sources contributed to the answer. AI Response Info may show sources such as Knowledge Chunks, FAQs, and website data when available.
Common Issues and Fixes
Crawled content contains menu, footer, or repeated website text
Remove repeated navigation, footer, or generic website text if it does not help Conversation AI answer customer questions.
Manual edits disappeared after refresh
Refreshing or re-crawling may replace edited content with newly crawled website data. Reapply the edits or copy important content before refreshing next time.
Conversation AI still gives outdated answers
Review the website source content, save updates, then test the bot with customer-style questions. Also, check AI Response Info to confirm which source was used.
FAQ
Does editing crawled website content change my live website?
No. Editing crawled website content only updates the source content available to Conversation AI. It does not change, publish, or edit your live website.
When should I edit crawled website content instead of updating my website?
Edit crawled content when the live website is correct for visitors but needs cleanup for AI responses. Update your website when the public page itself contains incorrect or outdated information.
What happens after I save edited website content?
The saved content becomes available for Conversation AI to reference when generating future responses.
Will refreshing the website source remove my manual edits?
Refreshing or re-crawling may overwrite manual edits and replace them with newly crawled website data.
Can I undo edits after saving?
There may not be a one-click undo option. You can manually edit the content again or refresh the source to retrieve content from the live website.
How do I know which website content was used in a specific AI response?
Use AI Response Info in Conversations to view source details for an AI-generated message.
Why does crawled content include text from tabs, accordions, or hidden sections?
The Web Crawler may capture content from interactive website elements such as tabs, accordions, lazy-loaded areas, and similar page sections.
Should I use Auto Refresh for sources with manual edits?
Use caution. Auto Refresh may replace manually edited source content when it re-crawls the website.