CIFuzz: repository can't be cloned as recursive

[athre0z]

We're currently in the progress of implementing CIFuzz for Zydis and stumbled across the issue that it doesn't appear to be possible to tell CIFuzz to clone a repo recursively. Since we depend on that to pull in our zycore utility library, CIFuzz currently doesn't work for us.

I can't pretend to understand all the inner workings of CIFuzz, but it appears to me like the non-recursive clone originates here:

oss-fuzz/infra/repo_manager.py

Line 247 in 8bd5676

out, _, _ = utils.execute(['git', 'clone', self.repo_url, self.repo_name],

Our workflow config can be viewed here: https://github.com/zyantific/zydis/blob/6b48854250013bad75f570d1b566e56f19770c4d/.github/workflows/main.yml#L43
A corresponding failed run: https://github.com/zyantific/zydis/runs/1498160477

Just cloning every repository recursively sounds risky, so that probably won't be the fix -- my suggestion would be to add a GH action config just like e.g. oss-fuzz-project-name: 'zydis' where users can specify recursive-clone: true.

It's also very much possible that we're just doing it wrong -- any help would be appreciated!

[jonathanmetzman]

Hmm....I'm working on a new API for projects to use CIFuzz where you simply provide the repo to CIFuzz rather than CIFuzz cloning the repo for you. Do you want to try using this?

[flobernd]

@jonathanmetzman Sure, that sounds great :-) Could you point us a site to get started?

[jonathanmetzman]

Sorry for the big delay in this. I ended up changing the API so I think we still may have a problem here.
I'm still thinking about a solution to this.

[jonathanmetzman]

Duplicate: #6755