What Does 'Load URL Recursively' Mean?
The 'Load URL Recursively' feature in AskHandle AI allows the system to learn not just from a single webpage URL you provide, but also from its child pages. This feature is particularly useful for creating a comprehensive data source from structured websites like help centers or FAQ sections.
How 'Load URL Recursively' Works
When you enable the 'Load URL Recursively' option, the AI will follow links from the specified parent page to its child pages and gather content from them.
Example:
If you input the URL:
https://www.example.com/help
And this page contains links like:
https://www.example.com/help/how-to-reset-password
https://www.example.com/help/how-to-contact-customer-support
https://www.example.com/help/how-to-get-refund
The AI will visit and learn from these linked pages as well. Currently, AskHandle AI supports learning up to 3 levels of links:
- Parent Page: The page you input.
- Direct Child Pages: Links directly found on the parent page.
- Child Pages of Each Child Page: Links found on each direct child page.
This 3-level structure is designed to cover the majority of help center and FAQ content effectively.
If your goal is to train the AI on your help center or FAQ section, simply input the parent URL, and the AI will automatically process the relevant linked pages.
Limitations to Keep in Mind
- Website Restrictions: Some websites, particularly those with anti-scraping measures or firewalls like CAPTCHA, may block the AI from accessing their content. In such cases, the AI will only process the original URL you provide.
- Large Parent Sites: If the parent page has an extensive number of child pages, the AI might not capture all of them in a single attempt. To address this, you can:
- Add specific subpages individually as additional data sources.
- Contact our customer support team at [email protected] for further assistance.
Best Practices
- Use the 'Load URL Recursively' option for websites you manage or own, ensuring no restrictions prevent the AI from accessing the content.
- If you need finer control over the AI's learning process, you can input individual URLs as separate data sources.
The 'Load URL Recursively' feature simplifies the process of training AskHandle AI on large, structured websites, making it easier to create a robust and informative AI response system.