Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix:GitHubLoader to Handle Binary Files #1337

Merged
merged 3 commits into from
Oct 26, 2024
Merged

Conversation

Devparihar5
Copy link
Contributor

Fix GitHubLoader to Handle Binary Files

  • Updated fetch_file_content method to skip decoding of binary files (e.g., images, pickled models).
  • Introduced MIME type checking to differentiate between text and binary files.

in previous code: it raise the error as given

decoded_content = base64.b64decode(content["content"]).decode("utf-8") UnicodeDecodeError: 'utf-8' codec can't decode byte 0x80 in position 0: invalid start byte

in updated code: now it's handled properly

.gitignore is a binary file and was skipped.

LICENSE is a binary file and was skipped.

model/faiss_store_gemini.pkl is a binary file and was skipped.

Copy link

vercel bot commented Oct 18, 2024

Someone is attempting to deploy a commit to the Arc53 Team on Vercel.

A member of the Team first needs to authorize it.

@Devparihar5
Copy link
Contributor Author

Devparihar5 commented Oct 21, 2024

@ManishMadan2882, can you please take a look at this PR

@Vaibhav91one
Copy link
Contributor

@Vaibhav91one can you please take a look at this PR

I am not the moderator @Devparihar5.

@Devparihar5
Copy link
Contributor Author

@Vaibhav91one can you please take a look at this PR

I am not the moderator @Devparihar5.

Sorry, I mentioned you by mistake

Copy link

vercel bot commented Oct 22, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
docs-gpt ✅ Ready (Inspect) Visit Preview 💬 Add feedback Oct 22, 2024 0:06am

Copy link
Contributor

@dartpain dartpain left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thank you!

@dartpain dartpain merged commit bea0cca into arc53:main Oct 26, 2024
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
application Application
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants