CatchAll API is currently in beta (v0.x.x). The API may change as we refine
features and gather feedback. Breaking changes may occur in minor version
updates during this phase.
Monitor webhooks and deduplication
Introduced webhook notifications and intelligent deduplication for monitors to streamline automated data collection workflows.Features:- Webhook notifications: Receive real-time POST notifications when scheduled monitor jobs complete, including monitor ID, latest job ID, and record counts.
- Intelligent deduplication: Monitors automatically eliminate duplicate records across job executions, sending only new results to webhooks.
- Monitor management: Enable or disable monitors to control automated job execution.
GET /catchAll/monitors— List all monitors for your API key.POST /catchAll/monitors/{monitor_id}/enable— Enable a disabled monitor.POST /catchAll/monitors/{monitor_id}/disable— Disable an active monitor.
- Reduced default date range from 14 days to 5 days for faster job processing.
- Limited maximum date range to 30 days to maintain optimal performance.
- Fixed special characters displaying incorrectly in article text.
- Improved error handling when monitor jobs have incomplete data.
Pagination and reliability improvements
Enhanced core functionality with pagination fixes, job tracking capabilities, and improved data quality.Endpoints:GET /catchAll/jobs/user— List all jobs created with your API key.GET /catchAll/monitors/pull/{monitor_id}— Retrieve aggregated results from all monitor jobs.
- Fixed pagination returning all records instead of the requested page.
- Enhanced pagination support for handling large result sets with
pageandpage_sizeparameters. - Fixed jobs failing to complete during data extraction.
- Fixed special characters displaying incorrectly in article text.
- Fixed timezone errors when scheduling monitor jobs.
- Fixed monitors failing to execute all configured queries.
Monitors feature
Introduced monitors for automated queries — schedule recurring data collection with natural language and webhook notifications.Features:- Schedule automation: Create monitors that run queries on schedules defined in natural language (e.g., “every day at 12 PM UTC”).
- Job tracking: Track all jobs associated with a monitor.
- Execution history: Retrieve job execution history and status for each monitor.
- Webhook notifications: Get notified when scheduled jobs complete.
POST /catchAll/monitors/create— Create scheduled monitor.GET /catchAll/monitors/{monitor_id}/jobs— List monitor jobs.
- Added date range information to results showing the time period covered.
- Fixed incorrect date filtering in search results.
Initial beta release
CatchAll API transforms natural language questions into structured, validated data extracted from web sources.Features:- Natural language processing: Submit queries in plain English and receive structured data with source citations.
- Dynamic schemas: Response structures adapt to your query, generating relevant fields automatically.
- 12-stage pipeline: Track your job through analysis, retrieval, clustering, validation, and extraction phases.
- Real-time status tracking: Monitor job progress from submission to completion.
POST /catchAll/submit— Create jobs with natural language queries.GET /catchAll/status/{job_id}— Check processing status.GET /catchAll/pull/{job_id}— Retrieve structured results with citations.