Skip to content
This repository has been archived by the owner on Oct 26, 2023. It is now read-only.

Fix/handle large repos #90

Merged
merged 1 commit into from
Apr 18, 2022
Merged

Fix/handle large repos #90

merged 1 commit into from
Apr 18, 2022

Conversation

scott-es
Copy link
Contributor

The primary method used by this tool to retrieve the GIT tree from each repository for the basis of comparison is via the Github API.
For sufficiently large repositories, though, Github truncates the API response. When a truncated Github response is detected when retrieving the GIT tree, this tool will fall back on using the local git if available and configured to perform a shallow clone of the repository's default branch in order to build the tree.

It will use /tmp to perform the git clone and then capture the output of git ls-tree -r

When this situation occurs, you will see the following in the console:

Large repo detected, falling back to cloning. This may take a few minutes ...
image

The truncated GIT tree response is described here. The last known limits are: 100,000 files or 7 MB of response data, whichever is first.

@scott-es scott-es requested a review from a team as a code owner April 18, 2022 20:55
@scott-es scott-es force-pushed the fix/handle-large-repos branch 2 times, most recently from 296b0ec to a2cd556 Compare April 18, 2022 21:05
@scott-es scott-es force-pushed the fix/handle-large-repos branch from de122fa to e6cc64d Compare April 18, 2022 21:09
@scott-es scott-es merged commit f22578b into develop Apr 18, 2022
@scott-es scott-es deleted the fix/handle-large-repos branch April 18, 2022 21:29
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant