Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: modular parser and formatter v0 #175

Merged
merged 14 commits into from
Jan 10, 2025
Merged

feat: modular parser and formatter v0 #175

merged 14 commits into from
Jan 10, 2025

Conversation

chloedia
Copy link
Collaborator

@chloedia chloedia commented Dec 9, 2024

This PR is making Megaparse modular with the creation of multiple basic "Formatters" such as :

  • Table Formatters : Repass over the identified tables to improve their rendering
  • Structured Formatter: Use the structured outputs from Claude or GPT-4o to render the file in a specific json

BREAKING CHANGE:

  • Unstructured Parser will return a MegaParse Document (not a string), which can be rendered simply using str(document)
  • This resulted in a change in the test

SOLVE #3464

@chloedia chloedia requested a review from AmineDiro December 9, 2024 23:51
@chloedia chloedia marked this pull request as draft December 26, 2024 15:23
@chloedia chloedia marked this pull request as ready for review January 8, 2025 13:01
@AmineDiro AmineDiro merged commit 1f4dcf8 into main Jan 10, 2025
5 checks passed
@dosubot dosubot bot added the size:XXL This PR changes 1000+ lines, ignoring generated files. label Jan 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
size:XXL This PR changes 1000+ lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants