Skip to main content
CatchAll converts natural language queries into structured, machine-readable records extracted from web sources. Instead of manually searching and organizing information, you submit questions in plain English and receive validated records with source citations—ready for analysis, automation, or integration into your applications.

How it works

CatchAll processes queries through a multi-stage pipeline:
1

Analyze

Generates search queries, validators, and extractors from your input
2

Fetch

Retrieves relevant content from web sources
3

Cluster

Groups similar content into distinct events
4

Validate

Filters clusters based on relevance criteria
5

Extract

Pulls structured data from validated clusters
6

Return

Delivers records with source citations
Processing typically takes 10-15 minutes per job. Poll the status endpoint every 30-60 seconds to track progress.

Key characteristics

Each job generates a unique response schema. Field names and structure in the enrichment object vary between jobs—even with identical inputs.Guaranteed fields in every record:
  • record_id
  • record_title
  • citations array
Variable fields:
  • All other fields in enrichment (names, types, structure)
  • Number of records returned
  • Specific content extracted
See Understanding dynamic schemas for integration patterns.
Identical queries can produce different results:
  • LLMs may generate different keywords, validators, and extractors.
  • Different content sources may be retrieved.
  • Field names and structure vary between runs.
  • Record counts differ.
Each query creates a job that processes asynchronously. Use the returned job_id to poll for status and retrieve results when the job completes.

Endpoints

Base URL: https://catchall.newscatcherapi.com
  • Jobs
  • Monitors
  • Meta
EndpointMethodDescription
/catchAll/submitPOSTCreate a new job
/catchAll/jobs/userGETList all jobs for your API key
/catchAll/status/{job_id}GETCheck job processing status
/catchAll/pull/{job_id}GETRetrieve job results

Use cases

  • Market intelligence: Company earnings, M&A activity, product launches
  • Regulatory monitoring: Policy changes, government actions, compliance updates
  • Business development: Partnerships, funding rounds, market entries
  • Competitive analysis: Competitor activities and announcements
  • Research automation: Structured data extraction for analysis
  • News aggregation: Topic-specific news with structured output

What’s next

For technical support, contact us at support@newscatcherapi.com.