Adding Sources
Sources are ingested into the system and parsed into observations for your agent. You can add sources via URL crawling or document upload.
Step 1: Access the Add Source form
Navigate to Sources in your project sidebar to open the source management interface.
Step 2: Choose source type
Select one of the following source types:
- URL (webpage): Crawl web-based documentation or marketing pages
- Document Upload: Upload files directly
Step 3: Configure URL sources
If you selected URL (webpage), provide:
URL or path
Enter the starting URL (e.g., https://docs.example.com)
Crawl depth
Choose from the following options:
- Single page: Only crawl the specified URL
- This directory /* (only this domain): Crawl all pages in the current directory and subdirectories on the same domain
- This directory /* + single page from external links: Crawl the directory plus one level deep into external links
Step 4: Configure document uploads
If you selected Document Upload:
Click Choose file and select the document you want to upload from your local system.
Step 5: Add optional metadata
Label (optional)
Provide a descriptive label for this source (e.g., "API Documentation")
Content class
Classify the source content:
- Own Content: Your application's own documentation or materials
- Competitor Reference: Competitor or third-party reference materials
Step 6: Add the source
Click Add Source to begin ingestion and processing.
Your source will be queued for processing, and observations will be generated for use by your chat agent and documentation builder.
Next steps
Once you've added sources, you can use the Chrome Extension to crawl authenticated areas of your app. See Crawling Your App for instructions.
You can also monitor processing status and manage your sources from the Version Settings and Managing Sources pages.