test sphinx mapping to networkx #4323

raybellwaves · 2024-04-09T04:42:45Z

I'll report back if it get to render locally. Ran out of mem building the library on my ec2 machine (g5.2xlarge: 32 Gb RAM) but I did just build cudf. I'll try again soon.

~~Also brainstorming here and I probably should upstream this to the rapids CI process. Would be nice to have /ok to test docs which just builds the docs for this PR~~ created https://github.com/nv-gha-runners/nvidia-runners/issues/25

I tried building the docs locally and got

WARNING: [autosummary] failed to import cugraph.jaccard_w.
Possible hints:
* AttributeError: module 'cugraph' has no attribute 'jaccard_w'
* ImportError: 
* ModuleNotFoundError: No module named 'cugraph.jaccard_w'
WARNING: [autosummary] failed to import cugraph.overlap_w.
Possible hints:
* ModuleNotFoundError: No module named 'cugraph.overlap_w'
* ImportError: 
* AttributeError: module 'cugraph' has no attribute 'overlap_w'
WARNING: [autosummary] failed to import cugraph.sorensen_w.
Possible hints:
* ModuleNotFoundError: No module named 'cugraph.sorensen_w'
* ImportError: 
* AttributeError: module 'cugraph' has no attribute 'sorensen_w'

Think this comes from

cugraph/docs/cugraph/source/api_docs/cugraph/link_prediction.rst

Line 14 in abe69c0

cugraph.jaccard_w

but I may have messed up my build

copy-pr-bot · 2024-04-09T04:42:47Z

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

rlratzel · 2024-04-09T18:52:08Z

Thanks, @raybellwaves ! The errors you saw are due to this PR, which (intentionally) removed those APIs, but I missed the .rst files. I (or @acostadon ?) will open a PR to take care of that (I created #4330).

rlratzel · 2024-04-09T18:52:39Z

/ok to test

acostadon · 2024-04-09T20:02:47Z

PR #4331 fixes this. It is in review now.

raybellwaves · 2024-04-11T21:21:49Z

Had a couple of mins to try and build the docs again. Now getting the Traceback below.

Believe i'm missing pylibcugraphops.operators.mha_gat_n2n_bwd, pylibcugraphops.operators.mha_gat_n2n_efeat_bwd, pylibcugraphops.operators.mha_gat_n2n_efeat_fwd, pylibcugraphops.operators.mha_gat_n2n_fwd which are called in https://github.com/rapidsai/cugraph/blob/branch-24.06/docs/cugraph/source/api_docs/cugraph-ops/python/operators.rst?plain=1#L50#L53 I see those methods in pylibcugraphops 24.02 (https://colab.research.google.com/drive/1Yev1vPUbTVxXMzSrcKnraSCb5KtrFMwF?usp=sharing). But missing in 24.06.00a9. Looks like they been updated to include precision e.g. ["mha_gat_n2n_fwd_bf16_fp32", "mha_gat_n2n_fwd_fp16_fp32", "mha_gat_n2n_fwd_fp32_fp32"]

[autosummary] generating autosummary for: api_docs/cugraph-dgl/cugraph_dgl.rst, api_docs/cugraph-ops/c_cpp/index.rst, api_docs/cugraph-ops/index.rst, api_docs/cugraph-ops/python/dimenet.rst, api_docs/cugraph-ops/python/graph_types.rst, api_docs/cugraph-ops/python/index.rst, api_docs/cugraph-ops/python/operators.rst, api_docs/cugraph-ops/python/pytorch.rst, api_docs/cugraph-pyg/cugraph_pyg.rst, api_docs/cugraph/centrality.rst, ..., tutorials/index.rst, wholegraph/basics/index.rst, wholegraph/basics/wholegraph_intro.md, wholegraph/basics/wholememory_implementation_details.md, wholegraph/basics/wholememory_intro.md, wholegraph/index.rst, wholegraph/installation/container.md, wholegraph/installation/getting_wholegraph.md, wholegraph/installation/index.rst, wholegraph/installation/source_build.md
WARNING: [autosummary] failed to import pylibcugraphops.operators.mha_gat_n2n_bwd.
Possible hints:
* AttributeError: module 'pylibcugraphops.operators' has no attribute 'mha_gat_n2n_bwd'
* ImportError:
* ModuleNotFoundError: No module named 'pylibcugraphops.operators.mha_gat_n2n_bwd'
WARNING: [autosummary] failed to import pylibcugraphops.operators.mha_gat_n2n_efeat_bwd.
Possible hints:
* ImportError:
* ModuleNotFoundError: No module named 'pylibcugraphops.operators.mha_gat_n2n_efeat_bwd'
* AttributeError: module 'pylibcugraphops.operators' has no attribute 'mha_gat_n2n_efeat_bwd'
WARNING: [autosummary] failed to import pylibcugraphops.operators.mha_gat_n2n_efeat_fwd.
Possible hints:
* ImportError:
* ModuleNotFoundError: No module named 'pylibcugraphops.operators.mha_gat_n2n_efeat_fwd'
* AttributeError: module 'pylibcugraphops.operators' has no attribute 'mha_gat_n2n_efeat_fwd'
WARNING: [autosummary] failed to import pylibcugraphops.operators.mha_gat_n2n_fwd.
Possible hints:
* ImportError:
* ModuleNotFoundError: No module named 'pylibcugraphops.operators.mha_gat_n2n_fwd'
* AttributeError: module 'pylibcugraphops.operators' has no attribute 'mha_gat_n2n_fwd'

Traceback (most recent call last):
  File "/home/ubuntu/.conda/envs/all_cuda-122_arch-x86_64/lib/python3.11/site-packages/sphinx/ext/autosummary/generate.py", line 395, in generate_autosummary_docs
    name, obj, parent, modname = import_by_name(entry.name)
                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/.conda/envs/all_cuda-122_arch-x86_64/lib/python3.11/site-packages/sphinx/ext/autosummary/__init__.py", line 661, in import_by_name
    raise ImportExceptionGroup('no module named %s' % ' or '.join(tried), exceptions)
sphinx.ext.autosummary.ImportExceptionGroup: no module named pylibcugraphops.pytorch.operators.agg_concat_n2n

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/ubuntu/.conda/envs/all_cuda-122_arch-x86_64/lib/python3.11/site-packages/sphinx/events.py", line 94, in emit
    results.append(listener.handler(self.app, *args))
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/.conda/envs/all_cuda-122_arch-x86_64/lib/python3.11/site-packages/sphinx/ext/autosummary/__init__.py", line 811, in process_generate_options
    generate_autosummary_docs(genfiles, suffix=suffix, base_path=app.srcdir,
  File "/home/ubuntu/.conda/envs/all_cuda-122_arch-x86_64/lib/python3.11/site-packages/sphinx/ext/autosummary/generate.py", line 400, in generate_autosummary_docs
    name, obj, parent, modname = import_ivar_by_name(entry.name)
                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/.conda/envs/all_cuda-122_arch-x86_64/lib/python3.11/site-packages/sphinx/ext/autosummary/__init__.py", line 720, in import_ivar_by_name
    real_name, obj, parent, modname = import_by_name(name, prefixes, grouped_exception)
                                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/.conda/envs/all_cuda-122_arch-x86_64/lib/python3.11/site-packages/sphinx/ext/autosummary/__init__.py", line 661, in import_by_name
    raise ImportExceptionGroup('no module named %s' % ' or '.join(tried), exceptions)
sphinx.ext.autosummary.ImportExceptionGroup: no module named pylibcugraphops.pytorch.operators

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/ubuntu/.conda/envs/all_cuda-122_arch-x86_64/lib/python3.11/site-packages/sphinx/cmd/build.py", line 276, in build_main
    app = Sphinx(args.sourcedir, args.confdir, args.outputdir,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/.conda/envs/all_cuda-122_arch-x86_64/lib/python3.11/site-packages/sphinx/application.py", line 262, in __init__
    self._init_builder()
  File "/home/ubuntu/.conda/envs/all_cuda-122_arch-x86_64/lib/python3.11/site-packages/sphinx/application.py", line 335, in _init_builder
    self.events.emit('builder-inited')
  File "/home/ubuntu/.conda/envs/all_cuda-122_arch-x86_64/lib/python3.11/site-packages/sphinx/events.py", line 105, in emit
    raise ExtensionError(__("Handler %r for event %r threw an exception") %
sphinx.errors.ExtensionError: Handler <function process_generate_options at 0x762210477ce0> for event 'builder-inited' threw an exception (exception: no module named pylibcugraphops.pytorch.operators)

Extension error (sphinx.ext.autosummary):
Handler <function process_generate_options at 0x762210477ce0> for event 'builder-inited' threw an exception (exception: no module named pylibcugraphops.pytorch.operators)

Steps taken:

git clone https://github.com/raybellwaves/cugraph.git
cd cugraph
git checkout intersphinx-mapping-test
# Apply https://github.com/rapidsai/cugraph/pull/4331
conda env create -f conda/environments/all_cuda-122_arch-x86_64.yaml
conda activate all_cuda-122_arch-x86_64
./build.sh
./build.sh cugraph-service
./build.sh cugraph-pyg
./build.sh cugraph-dgl
./build.sh cugraph-equivariant
./build.sh nx-cugraph
./build.sh docs

rlratzel

Even though this looks like a test PR I'll approve/merge it since it looks useful for future updates.

…-mapping-test

rlratzel · 2024-05-20T21:06:17Z

/ok to test

rlratzel · 2024-05-20T21:31:43Z

/ok to test

rlratzel · 2024-05-20T21:34:30Z

/merge

test sphinx mapping to networkx

9f2b683

raybellwaves requested review from a team as code owners April 9, 2024 04:42

github-actions bot added the python label Apr 9, 2024

acostadon added this to the 24.06 milestone Apr 9, 2024

acostadon added doc Documentation non-breaking Non-breaking change labels Apr 9, 2024

rlratzel mentioned this pull request Apr 9, 2024

Various docs .rst files still include APIs which have been removed #4330

Closed

rlratzel approved these changes May 20, 2024

View reviewed changes

Merge remote-tracking branch 'upstream/branch-24.06' into intersphinx…

e48f71d

…-mapping-test

Updates copyright date.

82c4fa6

rapids-bot bot merged commit 6bd08d2 into rapidsai:branch-24.06 May 21, 2024
131 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

test sphinx mapping to networkx #4323

test sphinx mapping to networkx #4323

raybellwaves commented Apr 9, 2024 •

edited

Loading

copy-pr-bot bot commented Apr 9, 2024

rlratzel commented Apr 9, 2024

rlratzel commented Apr 9, 2024

acostadon commented Apr 9, 2024

raybellwaves commented Apr 11, 2024 •

edited

Loading

rlratzel left a comment

rlratzel commented May 20, 2024

rlratzel commented May 20, 2024

rlratzel commented May 20, 2024

test sphinx mapping to networkx #4323

test sphinx mapping to networkx #4323

Conversation

raybellwaves commented Apr 9, 2024 • edited Loading

copy-pr-bot bot commented Apr 9, 2024

rlratzel commented Apr 9, 2024

rlratzel commented Apr 9, 2024

acostadon commented Apr 9, 2024

raybellwaves commented Apr 11, 2024 • edited Loading

rlratzel left a comment

Choose a reason for hiding this comment

rlratzel commented May 20, 2024

rlratzel commented May 20, 2024

rlratzel commented May 20, 2024

raybellwaves commented Apr 9, 2024 •

edited

Loading

raybellwaves commented Apr 11, 2024 •

edited

Loading