docs: restructure ROCm installation section and add vLLM adapter topic - #473
Conversation
a348f36 to
9ab059d
Compare
|
🔴 Automated review · pr-review-watcher · 9ab059d This automation never files a GitHub approval, so no approving review will appear here whatever the outcome — the merge decision stays with a human reviewer. SummaryDocs-only change: restructures the README 🚫 Blocking (must fix before merge)
Why it blocks: Fix: add Per-commit notes
Non-blocking
Standing note on tests: this change adds and alters no test, and nothing reddens if it is reverted — there is no defect being fixed, and the |
siloteemu
left a comment
There was a problem hiding this comment.
🔴 Automated review · pr-review-watcher · 9ab059d
Requesting changes on one item from the round posted alongside this review. Everything else in that round is non-blocking.
The docs path filter was not extended for the file this change newly pulls into the docs build.
docs/rocm-docs/engines/vllm.md is nothing but a MyST {include} of docs/vllm.md, so that file becomes a build input for the first time — before this change it was only named as literal text on the install page, never transcluded. The docs: path filter in the CI workflow still lists only docs/rocm-docs/**, README.md, CONTRIBUTING.md, .readthedocs.yaml and .github/workflows/**, and the filter's own comment states the rule it is meant to encode: the doc sources plus the files that pages single-source via {include} directives. This change adds a third such file and does not list it.
Why this blocks rather than being a note: the -W Sphinx build is conditioned directly on that filter, and it is this change's own stated test plan — it is the only thing validating the new page. With the filter unchanged, a later pull request that edits only docs/vllm.md skips the job entirely, so a broken include marker, a malformed directive or a heading change in a long and actively edited file merges green and surfaces afterwards as a failure on the default branch or on an unrelated pull request. This change is the one that opens that hole, and a gap like this is not revisited once it has landed.
Resolving it: add docs/vllm.md to the docs: filter list alongside README.md and CONTRIBUTING.md, and extend the comment above the list to name it, so the next person adding a transcluded page from outside the docs tree sees the obligation.
Checks at review time: 19 success, 10 skipped, 0 pending, 0 failure. The docs build was not run here; the finding rests on reading the filter, the job's condition and the new include together.
juhovainio
left a comment
There was a problem hiding this comment.
Nice cleanup of the install section and good to see the vLLM adapter land in the built docs site. Two things worth fixing before merge, left inline below — neither is about the prose itself, both are about wiring that this PR changes.
| SPDX-License-Identifier: MIT | ||
| --> | ||
|
|
||
| ```{include} ../../vllm.md |
There was a problem hiding this comment.
This file {include}s docs/vllm.md into the built Sphinx site for the first time, but .github/workflows/ci.yml's docs: path filter (around lines 165-174) only watches docs/rocm-docs/**, README.md, CONTRIBUTING.md, .readthedocs.yaml, and .github/workflows/** — it doesn't list docs/vllm.md. A future PR that edits docs/vllm.md alone (a broken include, a bad code fence) won't trigger the "Sphinx docs build (-W)" check that would catch it, even though this page now ships in the site. Worth adding docs/vllm.md to the docs: filter list.
There was a problem hiding this comment.
Thanks @juhovainio. I've added docs/vllm.md to the path filter in .github/workflows/ci.yml and extended the comment above it.
| .. grid-item-card:: Commands | ||
| .. grid-item-card:: Use ROCm CLI | ||
|
|
||
| * :doc:`vLLM adapter <engines/vllm>` |
There was a problem hiding this comment.
After the second commit reorders docs/rocm-docs/sphinx/_toc.yml.in to list commands before engines/vllm ("Command reference is the more common lookup target"), this landing-page grid card still lists vLLM adapter before Command reference — so the sidebar and the index page now disagree on which one comes first. Worth swapping these two lines to match the TOC order, or dropping the TOC reorder commit's rationale if vLLM-first is actually intended here.
There was a problem hiding this comment.
Thanks @juhovainio, I updated card order so Command reference precedes vLLM adapter, matching the _toc.yml.in reorder.
1365357 to
270c7e6
Compare
|
Reviewer feedback addressed
|
anisha-amd
left a comment
There was a problem hiding this comment.
Review complete, minor suggestions
juhovainio
left a comment
There was a problem hiding this comment.
Looks like the batch-apply of anisha-amd's suggestion comments (the "Apply batched suggestions from code review" commit) didn't fully replace the original text in four spots — it inserted the rewritten line(s) right after the original instead of swapping them, so the docs now show the same sentence twice back-to-back. Left inline comments at each spot. Everything else in this round (ci.yml docs: path filter, README table header, index.rst card order) looks correctly applied.
|
|
||
| You can also serve any compatible Hugging Face model directly — see | ||
| [Model serving](commands.md#model-serving) for the GGUF-vs-safetensors rule, | ||
| You can also serve any compatible Hugging Face model directly. See |
There was a problem hiding this comment.
This duplicates the previous two lines ("You can also serve any compatible Hugging Face model directly — see / [Model serving]... for the GGUF-vs-safetensors rule,") with slightly different wording ("directly. See" vs "directly — see"). The old pair is still there right above as unchanged context — only one of the two should remain. Note the code comment a few lines up says to edit this sentence in lockstep with README.md's copy; README.md's own copy (git show 409ff164:README.md around "You can also serve") wasn't touched, so whichever version you keep here, please re-sync it with README.md too.
| runtime. Two installers write torch into the same environment — the SDK install | ||
| writes TheRock's build, and the engine install then writes the build from its own | ||
| index — so `rocm engines install` settles which one stays and prints the result | ||
| Installing an engine into a managed TheRock runtime can change the torch in that |
There was a problem hiding this comment.
Same pattern: these 4 lines duplicate the paragraph right above ("runtime. Two installers write torch...") with minor wording changes (em dash → colon, "so" → "So."). The original paragraph is still present as unchanged context immediately before this hunk.
|
|
||
| Use it when you are deliberately running a torch the alignment would replace — a | ||
| locally built wheel, a version under test, a stack pinned for a reproduction. It | ||
| Use it when you are deliberately running a torch the alignment would replace (a |
There was a problem hiding this comment.
Partial duplicate: line 62 ("Use it when you are deliberately running a torch the alignment would replace — a", unchanged context) is immediately followed by this added line repeating the same sentence opening ("...replace (a"). Looks like only the second line of the original two-line paragraph was swapped out; the first line should have been replaced too, not kept.
| The value is a fraction in `(0, 1]` of total device VRAM. Lower it to leave room | ||
| for a display, another workload, or a second server; raise it to give a large | ||
| model more KV cache. Applies to vLLM only — it is ignored, with a note in the | ||
| model more KV cache. Applies to vLLM only; it is ignored, with a note in the |
There was a problem hiding this comment.
Same pattern again: this line repeats the context line directly above it ("model more KV cache. Applies to vLLM only — it is ignored, with a note in the") with an em dash → semicolon change. One of the two needs to go.
|
Thanks @juhovainio for flagging the issue with the batch apply. I've removed the instances of duplicated text. |
juhovainio
left a comment
There was a problem hiding this comment.
The latest commit (d051e18) correctly fixes all four duplicate-line spots I flagged in the last round — checked each one against the actual diff, and they're clean swaps, not a one-sided removal. The README.md sentence is also re-synced with its getting-started.md copy, which was the one loose end from before. Looks good to merge.
Split the install sdk prose in the README into Compiler toolchain (--devel), Approval prompt, Install location, Driver installation, Updates, and ROCm 10 and newer subsections, with a flag table for update. Add the vLLM adapter topic to the Sphinx site, re-group the index and TOC, and add a cross-link from Getting started to the approval gate. Applies editorial changes on top of the --devel, runtimes list, and rocm remote text already on main. Signed-off-by: pmoutsias-amd <peter.moutsias@amd.com> Signed-off-by: pmoutsia_amdeng <peter.moutsias@amd.com>
Command reference is the more common lookup target for readers opening Use ROCm CLI; the vLLM adapter serves a narrower audience. Also pin the entry title to 'Command reference' so the nav matches the page heading (without it the entry renders from the file name as 'Commands'). Signed-off-by: pmoutsias-amd <peter.moutsias@amd.com> Signed-off-by: pmoutsia_amdeng <peter.moutsias@amd.com>
Orient readers before the first included command and point to the command list in Getting started. Signed-off-by: pmoutsias-amd <peter.moutsias@amd.com> Signed-off-by: pmoutsia_amdeng <peter.moutsias@amd.com>
Fix the wiring gaps raised in review of the install-section restructure: - Add docs/vllm.md to the CI `docs:` path filter. The new docs/rocm-docs/engines/vllm.md page transcludes it, making it a build input for the first time; without this a later edit to that file alone would skip the `-W` docs build. Extend the filter comment to name it. - Swap the index.rst landing-page cards so Command reference precedes vLLM adapter, matching the _toc.yml.in reorder. - Restore "No CPU fallback is used." in the relocated Windows paragraph of docs/vllm.md, dropped in the restructure. - Add a comment to the getting-started.md block explaining that the prose is a deliberate copy of the README sentence reused as the next `:start-after:` anchor. Signed-off-by: pmoutsias-amd <peter.moutsias@amd.com> Signed-off-by: pmoutsia_amdeng <peter.moutsias@amd.com>
Co-authored-by: anisha-amd <anisha.sankar@amd.com> Signed-off-by: pmoutsia_amdeng <peter.moutsias@amd.com>
Co-authored-by: anisha-amd <anisha.sankar@amd.com> Signed-off-by: pmoutsia_amdeng <peter.moutsias@amd.com>
Co-authored-by: anisha-amd <anisha.sankar@amd.com> Signed-off-by: pmoutsia_amdeng <peter.moutsias@amd.com>
Co-authored-by: anisha-amd <anisha.sankar@amd.com> Signed-off-by: pmoutsia_amdeng <peter.moutsias@amd.com>
The batched suggestion apply inserted the reworded text without removing the original in four places. Remove the originals in docs/vllm.md and docs/rocm-docs/getting-started.md, and re-sync the README sentence that getting-started.md copies. Signed-off-by: pmoutsia_amdeng <peter.moutsias@amd.com>
d051e18 to
3c27c19
Compare
Blockers have been implemented.
Summary
--develits own.docs/rocm-docs/engines/vllm.md) to the docs site and regroups the index and TOC.docs/vllm.md(the oldrocmdocs.amd.comlink now points to the AI ecosystem vLLM page, and the bare reference URLs become titled links).Docs-only change: no scenario needed
This change is docs-only. It ships no behavioral change to the CLI, so no test scenario is required: nothing reddens if the change is reverted, and the
-Wdocs build is the only thing that validates it. The one edit outside the docs tree is the CIdocs:path filter, which extends an existing gate rather than adding behavior.Test plan