This repository has been archived by the owner on Feb 19, 2025. It is now read-only.

Length-delimited protobuf #65 #67

Merged

lspgn merged 1 commit into master from feature/fixed-length-proto

Mar 22, 2020

Contributor

lspgn commented Mar 22, 2020

Added -proto.fixedlen=true to have protobuf encoded with length before the message (Buffer.EncodeMessage). This is required by Clickhouse.

A table example is the following:

CREATE TABLE flows
(
    TimeReceived UInt64,
    SamplingRate UInt64,
    ...
) ENGINE = Kafka()
SETTINGS
    kafka_broker_list = 'kafka:9092',
    kafka_topic_list = 'flows',
    kafka_group_name = 'clickhouse',
    kafka_format = 'Protobuf',
    kafka_schema = './flow.proto:FlowMessage';


          Length-delimited protobuf #65

edcb2b6

lspgn merged commit 8b0a2cc into master

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet