Skip to content
This repository has been archived by the owner on Oct 16, 2024. It is now read-only.

GTO: updating docs #235

Merged
merged 19 commits into from
Dec 8, 2022
Merged

GTO: updating docs #235

merged 19 commits into from
Dec 8, 2022

Conversation

aguschin
Copy link
Contributor

@aguschin aguschin commented Nov 23, 2022

New pages:

TODO:

@aguschin aguschin added A: docs Area: user documentation (gatsby-theme-iterative) C: gto Content of /doc/gto labels Nov 23, 2022
@aguschin aguschin self-assigned this Nov 23, 2022
@shcheklein shcheklein temporarily deployed to mlem-ai-gto-docs-2nd-dzansp2qm November 23, 2022 15:21 Inactive
@github-actions
Copy link

github-actions bot commented Nov 23, 2022

e306e13

Link Check Report

There were no links to check!

@shcheklein shcheklein temporarily deployed to mlem-ai-gto-docs-2nd-dzansp2qm November 24, 2022 11:42 Inactive
@shcheklein shcheklein temporarily deployed to mlem-ai-gto-docs-2nd-dzansp2qm November 24, 2022 13:58 Inactive
@shcheklein shcheklein temporarily deployed to mlem-ai-gto-docs-2nd-dzansp2qm November 26, 2022 07:50 Inactive
@shcheklein shcheklein temporarily deployed to mlem-ai-gto-docs-2nd-dzansp2qm November 26, 2022 16:52 Inactive
@shcheklein shcheklein temporarily deployed to mlem-ai-gto-docs-2nd-dzansp2qm November 26, 2022 16:52 Inactive
@shcheklein shcheklein temporarily deployed to mlem-ai-gto-docs-2nd-dzansp2qm November 28, 2022 15:13 Inactive
@shcheklein shcheklein temporarily deployed to mlem-ai-gto-docs-2nd-dzansp2qm November 30, 2022 05:54 Inactive
Comment on lines -82 to +116
## Git tag message format
## Git tags format
Copy link
Contributor

@jorgeorpinel jorgeorpinel Nov 30, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

But it's really the tag's annotation message that has a format right? Not all tags are annotated in Git (in fact it's rare to use annotated tags, I think) so this could be confusing/misleading wording.

Copy link
Contributor Author

@aguschin aguschin Nov 30, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, it's Git tag name. E.g. to register a version, you need a Git tag called [email protected], annotated with some message. It could be annotated with any text, but without a text annotation it would be a lightweight tag, not an annotated one (and GTO ignores lightweight tags). For example, see https://github.com/iterative/example-gto/tags

image

[email protected] is a tag name and Registering artifact churn version v3.1.1 is a Git tag message.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It could be annotated with any text, but without a text annotation it would be a lightweight tag...

I see. May I ask why does GTO ignore lightweight tags?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, we had a discussion about it here iterative/gto#127

Copy link
Contributor

@jorgeorpinel jorgeorpinel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review on UG index page 👇🏼

content/docs/gto/user-guide/index.md Outdated Show resolved Hide resolved
content/docs/gto/user-guide/index.md Outdated Show resolved Hide resolved
content/docs/gto/user-guide/index.md Outdated Show resolved Hide resolved
content/docs/gto/user-guide/index.md Outdated Show resolved Hide resolved
content/docs/gto/user-guide/index.md Outdated Show resolved Hide resolved
content/docs/gto/user-guide/index.md Outdated Show resolved Hide resolved
content/docs/gto/user-guide/index.md Outdated Show resolved Hide resolved
@jorgeorpinel jorgeorpinel mentioned this pull request Nov 30, 2022
@shcheklein shcheklein temporarily deployed to mlem-ai-gto-docs-2nd-dzansp2qm November 30, 2022 11:07 Inactive
@shcheklein shcheklein temporarily deployed to mlem-ai-gto-docs-2nd-dzansp2qm November 30, 2022 11:07 Inactive
@jorgeorpinel jorgeorpinel mentioned this pull request Dec 2, 2022
Copy link
Contributor

@jorgeorpinel jorgeorpinel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some more details in the UG index

content/docs/gto/user-guide/index.md Show resolved Hide resolved
content/docs/gto/user-guide/index.md Outdated Show resolved Hide resolved
content/docs/gto/user-guide/index.md Outdated Show resolved Hide resolved
content/docs/gto/user-guide/index.md Outdated Show resolved Hide resolved
files instead.
practice, you should consider not committing your artifacts to Git. Instead,
[use DVC](/doc/gto/user-guide/dvc), Git-lfs, or any method to commit pointers to
the binary files instead.

## Annotations in artifacts.yaml
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Minor but I'm a bit worried about the use of term annotation here (and in gto annotate) given that Git tags also have annotations AND since we specifically use annotated Git tags only. May be confusing (esp. for users familiar with Git tags).

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yep. Don't remember why we decided on using "annotations" considering this collision.

content/docs/gto/user-guide/index.md Outdated Show resolved Hide resolved
content/docs/gto/user-guide/index.md Outdated Show resolved Hide resolved
Copy link
Contributor

@jorgeorpinel jorgeorpinel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

On the DVC integration page 👇🏼

p.s. if we had made this PR into 3 or 4 (Get Starteg, UG index, DVC page, MLEM page), we would already have one or two significant changes published 😼

content/docs/gto/user-guide/dvc.md Outdated Show resolved Hide resolved
content/docs/gto/user-guide/dvc.md Outdated Show resolved Hide resolved
content/docs/gto/user-guide/dvc.md Outdated Show resolved Hide resolved
Comment on lines +35 to +37
## Tracking an artifact with DVC

First, we need to start tracking artifact with DVC. If you produce this artifact
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think we need this section at all: it's DVC documentation (redundant since we already linked to the Get Started)...

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

But, this tells the bare minimum so people could understand the full workflow. DVC GS is quite huge, so just redirecting there without any context would be confusion. Do you disagree?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Besides, this shows dvc import-url, which could be an important scenario for some folks starting to use MR while having some models outside.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

People without context will get the bare minimum from this part. People with context will just see some story here.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

WDYT?

Copy link
Contributor

@jorgeorpinel jorgeorpinel Dec 23, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think that linking to https://dvc.org/doc/start/data-management/data-versioning or even straight to https://dvc.org/doc/command-reference/add would be acceptable.

Not a super strong opinion since this section is small, but I think that in principle we should not cross-document products. Logic: what if the DVC feature changes? dvc.org/doc will probably get updated, but not here.

Besides, this shows dvc import-url

Not seeing why that's particularly important. BTW, the blocks are missing git add .gitignore

content/docs/gto/user-guide/dvc.md Outdated Show resolved Hide resolved
content/docs/gto/user-guide/dvc.md Outdated Show resolved Hide resolved
content/docs/gto/user-guide/dvc.md Outdated Show resolved Hide resolved
content/docs/gto/user-guide/dvc.md Outdated Show resolved Hide resolved
content/docs/gto/user-guide/dvc.md Show resolved Hide resolved
content/docs/gto/user-guide/dvc.md Outdated Show resolved Hide resolved
@jorgeorpinel jorgeorpinel added C: user-guide Content of /doc/user-guide ✨ epic Placeholder ticket for multi-sprint direction, use story, improvement labels Dec 2, 2022
@jorgeorpinel
Copy link
Contributor

Ping @aguschin. Need help moving this fwd?

@shcheklein shcheklein temporarily deployed to mlem-ai-gto-docs-2nd-dzansp2qm December 7, 2022 14:25 Inactive
@shcheklein shcheklein temporarily deployed to mlem-ai-gto-docs-2nd-dzansp2qm December 7, 2022 14:44 Inactive
@restyled-io restyled-io bot mentioned this pull request Dec 7, 2022
@shcheklein shcheklein temporarily deployed to mlem-ai-gto-docs-2nd-dzansp2qm December 7, 2022 14:44 Inactive
@shcheklein shcheklein temporarily deployed to mlem-ai-gto-docs-2nd-dzansp2qm December 7, 2022 15:16 Inactive
@restyled-io restyled-io bot mentioned this pull request Dec 7, 2022
@shcheklein shcheklein temporarily deployed to mlem-ai-gto-docs-2nd-dzansp2qm December 7, 2022 15:27 Inactive
@shcheklein shcheklein temporarily deployed to mlem-ai-gto-docs-2nd-dzansp2qm December 7, 2022 16:08 Inactive
@aguschin aguschin merged commit e306e13 into main Dec 8, 2022
@aguschin aguschin deleted the gto-docs-2nd branch December 8, 2022 12:07
@aguschin aguschin mentioned this pull request Dec 12, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
A: docs Area: user documentation (gatsby-theme-iterative) C: gto Content of /doc/gto C: user-guide Content of /doc/user-guide ✨ epic Placeholder ticket for multi-sprint direction, use story, improvement
Projects
No open projects
Status: Done
Development

Successfully merging this pull request may close these issues.

4 participants