Website Scraper
Save hours of manual work by letting ViViDlyPro automatically read your website and import relevant content into your Knowledge Base.
How the Scraper Works
The scraper visits your website URL, reads all visible text content, and extracts Q&A pairs, product and service descriptions, and policy information. It uses AI to structure this content into Knowledge Base entries.
Step 1 — Start a Scrape Job
- Go to Knowledge Base → Import → Scrape Website.
- Enter your website URL (e.g., https://yourbusiness.com).
- Optionally specify which pages to scrape (e.g., /faq, /products, /contact).
- Click Start Scraping.
Step 2 — Review Extracted Content
The scraper shows all extracted content for your review before saving:
- Green items are high-confidence entries
- Yellow items need your review
- Red items were unclear and are not recommended
Step 3 — Approve and Import
Select the entries you want to keep and click Import Selected. You can edit any entry before importing.
Supported Page Types
The scraper works best with:
- FAQ pages
- Product and service pages
- About Us and Contact pages
- Blog posts about your services
- Policy pages (returns, shipping, privacy)
Re-Scraping After Website Updates
If your website changes (new prices, new products), re-run the scraper and it will highlight what's changed since the last scrape.
Limitations
- The scraper cannot read password-protected pages
- PDF or document content is not scraped (add manually)
- Dynamic content loaded via JavaScript apps may be limited — use manual import for those