Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[NVIDIA] Add Multi-graph Feature to NVIDIA Plugin #710

Merged
merged 27 commits into from
Sep 1, 2023
Merged

[NVIDIA] Add Multi-graph Feature to NVIDIA Plugin #710

merged 27 commits into from
Sep 1, 2023

Commits on Aug 30, 2023

  1. [NVIDIA] Change CudaGraphTopologyRunner/SubGraph to aggregation from … 

    …inheritance
    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    2f0468c View commit details
    Browse the repository at this point in the history

  2. [NVIDIA] Add new constructor to SubGraph

    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    df7a759 View commit details
    Browse the repository at this point in the history

  3. [NVIDIA] Update CudaGraphContext to use vectors

    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    fcc6096 View commit details
    Browse the repository at this point in the history

  4. [NVIDIA] Extract inputs/outputs to TensorMappingContext

    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    590db80 View commit details
    Browse the repository at this point in the history

  5. [NVIDIA] Update SubGraph to use direct exec_sequence_ and std::shared… 

    …_ptr<MemoryManager>
    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    05e13e7 View commit details
    Browse the repository at this point in the history

  6. [NVIDIA] Add CudaGraphInfo and update CudaGraphContext to use them

    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    9c0ed5d View commit details
    Browse the repository at this point in the history

  7. [NVIDIA] Fix single-graph tests

    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    2ff31ec View commit details
    Browse the repository at this point in the history

  8. [NVIDIA] Add CudaMultiGraphTest test

    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    b035b80 View commit details
    Browse the repository at this point in the history

  9. [NVIDIA] Add SubGraph::IsCudaGraphCompatible() cache

    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    6af3486 View commit details
    Browse the repository at this point in the history

  10. [NVIDIA] Add execute_sequence/capture_sequence member functions to Pr… 

    …ofiler
    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    cfba412 View commit details
    Browse the repository at this point in the history

  11. [NVIDIA] Enable TensorIterator to use Profiler::execute_sequence()

    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    e305986 View commit details
    Browse the repository at this point in the history

  12. [NVIDIA] Enable SubGraph to use Profiler::execute/capture_sequence()

    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    26703db View commit details
    Browse the repository at this point in the history

  13. [NVIDIA] Extract ITopologyRunner into the separate header

    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    39baa30 View commit details
    Browse the repository at this point in the history

  14. [NVIDIA] Update tests to include cuda_eager_topology_runner.hpp

    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    a493f44 View commit details
    Browse the repository at this point in the history

  15. [NVIDIA] Add IExecutionDelegator

    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    8277039 View commit details
    Browse the repository at this point in the history

  16. [NVIDIA] Add cuda_perf_counts.hpp

    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    3e4a839 View commit details
    Browse the repository at this point in the history

  17. [NVIDIA] Add SimpleExecutionDelegator class and use it when profiling… 

    … is not needed
    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    3d820b1 View commit details
    Browse the repository at this point in the history

  18. [NVIDIA] Update tests to use SimpleExecutionDelegator

    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    d326be2 View commit details
    Browse the repository at this point in the history

  19. [NVIDIA] Add updateExecSequence() to TensorIteratorOp

    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    5d27fc7 View commit details
    Browse the repository at this point in the history

  20. [NVIDIA] Update TensorIteratorOp::IsCudaGraphCompatible() to use SubG… 

    …raph implementation
    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    9395549 View commit details
    Browse the repository at this point in the history

  21. [NVIDIA] Add rebase fixes

    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    93c99d2 View commit details
    Browse the repository at this point in the history

  22. [NVIDIA] Add comment fixes

    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    1d59b6e View commit details
    Browse the repository at this point in the history

  23. [NVIDIA] Rename functions to correspond to OV coding style

    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    6f5a407 View commit details
    Browse the repository at this point in the history

  24. [NVIDIA] Add number_of_cuda_graphs property

    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    7cf15dd View commit details
    Browse the repository at this point in the history

  25. [NVIDIA] Fix and update SimpleExecutionDelegator

    Andrii Pavliuk committed Aug 30, 2023
    Configuration menu
    Copy the full SHA
    8f32a6b View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2023

  1. [NVIDIA] Fix build error on some configurations

    Andrii Pavliuk committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    cbba769 View commit details
    Browse the repository at this point in the history

  2. [NVIDIA] Temporary disable CUDA graph compatibility for TensorIterator

    Andrii Pavliuk committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    5699b60 View commit details
    Browse the repository at this point in the history