CatchAll API changelog

​

API response enhancements and monitor configuration

• Enrichments metadata: Job pull endpoint returns enrichments array listing all extracted field names.
• Human-readable schedules: Monitor list includes schedule_human_readable alongside cron expressions.
• Webhook visibility: Monitor list exposes full webhook configuration including URL, method, and headers.

• Pull endpoints return all citations without limits.
• Monitors require minimum 24-hour intervals between executions.
• First webhook execution includes complete reference job results.
• Improved validation error messages for invalid schedules.

​

Status tracking and monitor improvements

• Progress tracking: Status endpoint now returns detailed steps array showing completion state for each processing stage.
• Monitor timestamps: Monitor records include added_on and updated_on fields to track when each data record was first collected and last updated across job executions.
• Time-constrained jobs: Monitors now work with reference jobs that include time constraints. The system automatically adapts date-specific validators for each execution.

• GET /catchAll/jobs/user now returns only user-created jobs, excluding repeated monitor jobs.
• Monitor responses use run_info structure with first_run and last_run timestamps instead of date_range for clearer execution metadata.
• Improved error handling in monitor creation endpoint with specific validation messages for invalid schedules and incomplete reference jobs.

​

Monitor webhooks and deduplication

• Webhook notifications: Receive real-time POST notifications when scheduled monitor jobs complete, including monitor ID, latest job ID, and record counts.
• Intelligent deduplication: Monitors automatically eliminate duplicate records across job executions, sending only new results to webhooks.
• Monitor management: Enable or disable monitors to control automated job execution.

• GET /catchAll/monitors — List all monitors for your API key.
• POST /catchAll/monitors/{monitor_id}/enable — Enable a disabled monitor.
• POST /catchAll/monitors/{monitor_id}/disable — Disable an active monitor.

• Reduced default date range from 14 days to 5 days for faster job processing.
• Limited maximum date range to 30 days to maintain optimal performance.
• Fixed special characters displaying incorrectly in article text.
• Improved error handling when monitor jobs have incomplete data.

​

Pagination and reliability improvements

• GET /catchAll/jobs/user — List all jobs created with your API key.
• GET /catchAll/monitors/pull/{monitor_id} — Retrieve aggregated results from all monitor jobs.

• Fixed pagination returning all records instead of the requested page.
• Enhanced pagination support for handling large result sets with page and page_size parameters.
• Fixed jobs failing to complete during data extraction.
• Fixed special characters displaying incorrectly in article text.
• Fixed timezone errors when scheduling monitor jobs.
• Fixed monitors failing to execute all configured queries.

​

Monitors feature

• Schedule automation: Create monitors that run queries on schedules defined in natural language (e.g., “every day at 12 PM UTC”).
• Job tracking: Track all jobs associated with a monitor.
• Execution history: Retrieve job execution history and status for each monitor.
• Webhook notifications: Get notified when scheduled jobs complete.

• POST /catchAll/monitors/create — Create scheduled monitor.
• GET /catchAll/monitors/{monitor_id}/jobs — List monitor jobs.

• Added date range information to results showing the time period covered.
• Fixed incorrect date filtering in search results.

​

Initial beta release

• Natural language processing: Submit queries in plain English and receive structured data with source citations.
• Dynamic schemas: Response structures adapt to your query, generating relevant fields automatically.
• 12-stage pipeline: Track your job through analysis, retrieval, clustering, validation, and extraction phases.
• Real-time status tracking: Monitor job progress from submission to completion.

• POST /catchAll/submit — Create jobs with natural language queries.
• GET /catchAll/status/{job_id} — Check processing status.
• GET /catchAll/pull/{job_id} — Retrieve structured results with citations.