Java pinned memory pool allocator

[jlowe]

Adds a pinned memory pool on the Java side along with a runtime Java config option, ai.rapids.cudf.prefer-pinned, that specifies whether host buffers should use pinned memory if possible. Even if pinned memory buffers are preferred, the pinned memory pool must be initialized first or host buffers will fallback to paged memory.

Host buffers that need paged memory can use the new allocate overload with a boolean parameter to request the pinned memory allocator not be used.

[jrhemstad]

@harrism should we add a pinned memory resource to RMM?

[harrism]

@jrhemstad yes I think that makes sense. In RMM I like the ID of having a non-pool MR for every memory type, and then we can use any of those MRs as a heap resource for a pool MR, making it flexible. All your memory are belong to RMM. :)

[codecov]

Codecov Report

Merging #2872 into branch-0.10 will not change coverage.
The diff coverage is n/a.

@@             Coverage Diff              @@
##           branch-0.10    #2872   +/-   ##
============================================
  Coverage        86.53%   86.53%           
============================================
  Files               48       48           
  Lines             9000     9000           
============================================
  Hits              7788     7788           
  Misses            1212     1212

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 570ad62...6fd47c3. Read the comment docs.

[razajafri]

Talked to @jlowe about the best fit approach instead of getting the largest chunk which can be visited when/if need arises