📚 Kafka Data Ingest
Kafka Data Ingest handles near real-time ingestion of raw Documents into the platform. This enables you to perform ad-hoc Document ingestion and implement larger-scale integrations with event-streamed data sources. Kafka Data Ingest consists of two sets of services, each running within a separate application: Record Extraction service: The Record Extraction service handles the Cleansing, Parsing, and extraction of Records from raw Documents. Document Ingest service: The Document Ingest service loads extracted Records to Elasticsearch for use within Quantexa services and the UI. Read more about Kafka Data Ingest on the Documentation site. Note: Kafka Ingest was referred to as Kafka Loader before version 2.1.