【映射文档自动化】 添加 PyTorch 与 Paddle 映射关系主目录的自动生成 #6256
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
感谢你贡献飞桨文档，文档预览构建中，Docs-New 跑完后即可预览，预览链接：http://preview-pr-6256.paddle-docs-preview.paddlepaddle.org.cn/documentation/docs/zh/api/index_cn.html |
RedContritio
force-pushed
the
auto_mapping_index
branch
from
01e4304 to
37e3761
Compare
RedContritio
force-pushed
the
auto_mapping_index
branch
from
e79115f to
b476058
Compare
SigureMo
reviewed
Oct 30, 2023
docs/guides/model_convert/convert_from_pytorch/api_mappings.json
Outdated
Show resolved
Hide resolved
docs/guides/model_convert/convert_from_pytorch/apply_reference_from_api_difference.py
Outdated
Show resolved
Hide resolved
zhwesky2010
reviewed
Oct 30, 2023
docs/guides/model_convert/convert_from_pytorch/api_difference/others/torch.diag_embed.md
Outdated
Show resolved
Hide resolved
docs/guides/model_convert/convert_from_pytorch/api_difference/others/torch.nansum.md
Outdated
Show resolved
Hide resolved
docs/guides/model_convert/convert_from_pytorch/api_difference/utils/torch.utils.data.Dataset.md
Outdated
Show resolved
Hide resolved
docs/guides/model_convert/convert_from_pytorch/apply_reference_from_api_difference.py
Outdated
Show resolved
Hide resolved
| @@ -1,15 +1,15 @@ | |||
| # PyTorch 1.13 与 Paddle 2.4 API 映射表 | |||
There was a problem hiding this comment.
这个改成Pytorch 2.1.0，Paddle develop 吧
|
|
||
| ## 贡献代码 | ||
| 本文档梳理了 PyTorch（v1.13）常用 API 与 PaddlePaddle 2.4.0 API 对应关系与差异分析。通过本文档，帮助开发者快速迁移 PyTorch 使用经验，完成模型的开发与调优。 |
There was a problem hiding this comment.
本文梳理了 Pytorch最新发行版（当前v2.1.0）API与PaddlePaddle develop版本API 对应关系与差异分析。通过本文档，帮助开发者快速迁移 PyTorch 使用经验，完成模型的开发与调优。
docs/guides/model_convert/convert_from_pytorch/validate_mapping_in_api_difference.py
Outdated
Show resolved
Hide resolved
ci_scripts/hooks/pre-doc-compile.sh
Outdated
| DOCROOT=${FLUIDDOCDIR}/docs/ | ||
|
|
||
|
|
||
| APIMAPPING_ROOT=${DOCROOT}/guides/model_convert/convert_from_pytorch |
There was a problem hiding this comment.
- 关于能否删除这几个变量
这几个变量是因为其他脚本统一采用这一系列变量作为 docs 根目录来处理，考虑之后的脚本间同步问题，所以用了这几个变量 - 关于变量定义位置
已经将APIMAPPING_ROOT移动到第三步中，其余两个变量因为可能会其他步骤用到，所以继续留在开头
好的了解，目前仍然有两个问题：
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
添加了映射主目录的表单自动生成脚本 apply_reference_from_api_difference.py，根据 api_difference/ 目录下的映射文档，提取其映射的元数据，更新到映射目录中。
同时，将元数据保存，得到
api_mappings.json，用于后续PaConvert与文档部分的对齐。尚未添加对映射文档合法性检查的规则。
当前仍有 10 个表单项（存量）来自手动维护，由于尚无这部分映射文档，对于手动维护内容，目前进行跳过不处理。
主目录映射记法：
REFERENCE-MAPPING-ITEM(<torch_api>, <mapping_document_url>)NOT-IMPLEMENTED-ITEM(<torch_api>, <torch_api_url>)功能描述：
<torch_api>支持反引号记法 (`torch.XX`）、\_记法 （torch.manual\_seed）等，后续查找时会对不同记法进行统一处理，来确保匹配正确REFERENCE-MAPPING-ITEM，根据其实际对应的 api 名称，到api_difference目录中查找名称符合<torch_api>.md的映射文档，并从中提取torch_api_url, paddle_api, paddle_api_url, 映射类型 mapping_type这些元信息，用于映射目录生成。NOT-IMPLEMENTED-ITEM不进行映射文档查找，直接将该项作为 “功能缺失” 类别。生成结果（源文件）预览见
页面预览见
本 PR 中含有部分映射文档更新，单独 PR 于
映射文档 添加部分缺失的映射文档 #6252
注：待 映射文档 添加部分缺失的映射文档 #6252 合入后，再合入本文档
@SigureMo @zhwesky2010