Kafka -> ONNX -> Kafka
Enrich events inline and republish without a sidecar model-serving hop.
AI infrastructure
AI enrichment should not require a sidecar, a model-serving hop, and custom audit glue for every record. StreamKernel keeps ONNX inference, model labels, provenance, and delivery inside the pipeline boundary.
In-process enrichment
The commercial differentiator is the AI path: model-aware operational movement without splitting every record across separate services and audit systems.
AI use cases
Enrich events inline and republish without a sidecar model-serving hop.
Generate embeddings and insert vector records from the same pipeline boundary.
Score or embed records in-process and write vector-ready rows to Postgres Vector targets.
Deliver scored records from Kafka, Pulsar, REST, or custom sources into a relational store.
Run transport-agnostic AI enrichment into a lakehouse destination.
Bootstrap model artifacts from the registry and write enriched records.
Promote and roll back models without restarting the pipeline.
Vertical inference
The same in-process ONNX path can serve fraud scoring, clinical classification, sensor anomaly detection, and embedding generation without sending records through an external model hop.
Transaction events can receive model scores before they leave controlled financial systems.
HL7/FHIR and telemetry streams can be classified without sending PHI to an external endpoint.
Defense and industrial sensor streams can be scored at the edge in disconnected deployments.
Operational records can be converted into vector-search-ready output for MongoDB Vector or Postgres Vector.
AI proof strip
The PRD calls for clear caveats, exact profiles, and reproducible evidence rather than a universal performance promise.
Kafka Bench NOOP
956K ops/sec Published local producer ceilingKafka ALO WireEvent
525K ops/sec 512-byte payload, at-least-oncemTLS + OPA
366K ops/sec TLSv1.3 + fail-closed policyMongoDB Insert
163K docs/sec 95.5M document baselineONNX -> MongoDB Vector
337 eps 336.8 eps final run, zero record lossCommercial path
Bring the event source, model governance requirements, destination path, and audit expectations.