Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

support flattenSpec for ProtoBuf #3509

Closed
wants to merge 4 commits into from

Conversation

knoguchi
Copy link
Contributor

This PR is to show the idea of supporting JSON Path flattenSpec for ProtoBuf.

The implementation is not efficient because it converts whole ProtoBuf message to JSON string, then deserialize it back to object, and finally apply JSON Path. If you think flattenSpec in JSON Path for PB is a good idea, I will spend more time on proper implementation.

Relevant discussion is at #3505

@fjy fjy added this to the 0.9.3 milestone Nov 4, 2016
@fjy fjy added the Improvement label Nov 4, 2016
@fjy
Copy link
Contributor

fjy commented Nov 4, 2016

@knoguchi this feature is great. Same question as I had in your other PR, how do you feel about moving Protobuf into its own extension?

@fjy
Copy link
Contributor

fjy commented Nov 18, 2016

@knoguchi what do you think of my suggestion? Also, there are merge conflicts now

@knoguchi
Copy link
Contributor Author

I will create a protobuf extension. We can close this ticket.

@gianm gianm removed this from the 0.9.3 milestone Nov 29, 2016
@gianm gianm closed this Nov 29, 2016
@knoguchi knoguchi mentioned this pull request Mar 13, 2017
@knoguchi knoguchi deleted the protobuf3_flatten branch April 13, 2017 21:38
knoguchi pushed a commit to knoguchi/druid that referenced this pull request May 30, 2017
fjy pushed a commit that referenced this pull request May 30, 2017
* move ProtoBufInputRowParser from processing module to protobuf extensions

* Ported PR #3509

* add DynamicMessage

* fix local test stuff that slipped in

* add license header

* removed redundant type name

* removed commented code

* fix code style

* rename ProtoBuf -> Protobuf

* pom.xml: shade protobuf classes, handle .desc resource file as binary file

* clean up error messages

* pick first message type from descriptor if not specified

* fix protoMessageType null check. add test case

* move protobuf-extension from contrib to core

* document: add new configuration keys, and descriptions

* update document. add examples

* move protobuf-extension from contrib to core (2nd try)

* touch

* include protobuf extensions in the distribution

* fix whitespace

* include protobuf example in the distribution

* example: create new pb obj everytime

* document: use properly quoted json

* fix whitespace

* bump parent version to 0.10.1-SNAPSHOT

* ignore Override check

* touch
seoeun25 pushed a commit to seoeun25/incubator-druid that referenced this pull request Feb 25, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants