📚 Kafka Data Ingest

Stephanie_Richardson
Stephanie_Richardson Posts: 505 QUANTEXA TEAM
edited February 2024 in Getting Started

Kafka Data Ingest handles near real-time ingestion of raw Documents into the platform. This enables you to perform ad-hoc Document ingestion and implement larger-scale integrations with event-streamed data sources.

Kafka Data Ingest consists of two sets of services, each running within a separate application:

  • Record Extraction service: The Record Extraction service handles the Cleansing, Parsing, and extraction of Records from raw Documents.
  • Document Ingest service: The Document Ingest service loads extracted Records to Elasticsearch for use within Quantexa services and the UI.

Read more about Kafka Data Ingest on the Documentation site.

Note: Kafka Ingest was referred to as Kafka Loader before version 2.1.

Tagged:
Getting Started Links