Skip to content

[libcudf] Add memory_resources support for gather - #23690

Draft
nirandaperera wants to merge 12 commits into
NVIDIA:mainfrom
nirandaperera:gather-memory-resources
Draft

[libcudf] Add memory_resources support for gather#23690
nirandaperera wants to merge 12 commits into
NVIDIA:mainfrom
nirandaperera:gather-memory-resources

Conversation

@nirandaperera

@nirandaperera nirandaperera commented Aug 17, 2026

Copy link
Copy Markdown
Contributor

Description

Depends on #23665 #23688

A part of #20780.

  • Port public and detail gather, list/segmented gather, and sizes-to-offsets helpers to take cudf::memory_resources, routing output and temporary allocations explicitly.
  • Update gathering tests to pass stream/memory_resources; wrap non-list gather calls in scoped fail_on_current_device_resource_use() where safe.
  • Leave list/segmented and slice-dependent struct cases without strict current-MR enforcement, with TODOs for blockers (valid_if, slice/get_sliced_child, concatenate, nested list-wrapper construction).

Test plan

  • COPYING_TEST --gtest_filter='Gather*:SegmentedGather*:StructGather*:TypedStructGather*'

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

Signed-off-by: niranda perera <niranda.perera@gmail.com>
Signed-off-by: niranda perera <niranda.perera@gmail.com>
Signed-off-by: niranda perera <niranda.perera@gmail.com>
Signed-off-by: niranda perera <niranda.perera@gmail.com>
Signed-off-by: niranda perera <niranda.perera@gmail.com>
Signed-off-by: niranda perera <niranda.perera@gmail.com>
Signed-off-by: niranda perera <niranda.perera@gmail.com>
Route gather, list/segmented gather, and sizes-to-offsets through explicit
output/temporary resources. Enable fail_on_current around non-list gather
tests; leave list and slice-dependent cases with TODOs for transitive ports.
Avoid ambiguous empty fixed_width/list wrappers with stream/mr args, drop
fail_on_current around struct gather blocked by slice/get_sliced_child, and
use DONT_CHECK for in-bounds sliced struct gather so nullability matches.
@copy-pr-bot

copy-pr-bot Bot commented Aug 17, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@nirandaperera
nirandaperera changed the base branch from main to pull-request/23665 August 17, 2026 22:36
@github-actions github-actions Bot added the libcudf Affects libcudf (C++/CUDA) code. label Aug 17, 2026
@nirandaperera
nirandaperera changed the base branch from pull-request/23665 to main August 17, 2026 22:42
@bdice bdice changed the title [cudf] Add memory_resources suppor for gather [cudf] Add memory_resources support for gather Aug 18, 2026
@nirandaperera nirandaperera changed the title [cudf] Add memory_resources support for gather [libcudf] Add memory_resources support for gather Aug 18, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

libcudf Affects libcudf (C++/CUDA) code.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant