You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
With api.CreateAndRegisterAllocatorV2 I can create global allocator, but I still have no access to it.
With api.CreateAllocator I can create one and have access to it, but it requires a session as a parameter.
So, I need to create a session with some dummy graph first.
Describe scenario use case
With an access to allocator, I can reuse it to pre-allocate tensors (not with bindings), to know current utilization of a memory, etc.
It can be a new api.GetAllocator method or api.CreateAllocator without session
The text was updated successfully, but these errors were encountered:
AndreyOrb
changed the title
[Feature Request] C++: Create global allocator and have access to it
[Feature Request] C++: Create arena based allocator and have access to it
Dec 22, 2023
Describe the feature request
I would like to reuse a global allocator.
With api.CreateAndRegisterAllocatorV2 I can create global allocator, but I still have no access to it.
With api.CreateAllocator I can create one and have access to it, but it requires a session as a parameter.
So, I need to create a session with some dummy graph first.
Describe scenario use case
With an access to allocator, I can reuse it to pre-allocate tensors (not with bindings), to know current utilization of a memory, etc.
It can be a new api.GetAllocator method or api.CreateAllocator without session
The text was updated successfully, but these errors were encountered: