Project

General

Profile

Feature #1468

Enable pre-pinning memory for RDMA message sends

Added by Sam White 16 days ago. Updated 16 days ago.

Status:
New
Priority:
Normal
Assignee:
Category:
-
Target version:
Start date:
03/10/2017
Due date:
% Done:

0%

Tags:

Description

The cost of memory pinning on Verbs and GNI is high, so we'd like to enable users to pre-pin memory for use in later RDMA message sends. This is a step toward a persistent messaging API in that users can pin once and send multiple times.

We'd like to let the user allocate however they like, and then underneath we avoid re-pinning memory that is already pinned. Unfortunately, Verbs does not seem implement re-pinning of memory that is already pinned in a faster way, and doesn't seem to have a method to query the pinned-ness of some memory, so we'll have to track that ourselves. We can provide a CkAlloc routine that wraps something like infi_CmiAlloc() or that accepts a parameter that says whether memory should be pinned or not.

Also available in: Atom PDF