📚 Kafka Data Ingest

Stephanie_Richardson

Kafka Data Ingest handles near real-time ingestion of raw Documents into the platform. This enables you to perform ad-hoc Document ingestion and implement larger-scale integrations with event-streamed data sources.

Kafka Data Ingest consists of two sets of services, each running within a separate application:

• Record Extraction service: The Record Extraction service handles the Cleansing, Parsing, and extraction of Records from raw Documents.
• Document Ingest service: The Document Ingest service loads extracted Records to Elasticsearch for use within Quantexa services and the UI.

Read more about Kafka Data Ingest on the Documentation site.

Note: Kafka Ingest was referred to as Kafka Loader before version 2.1.