Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RELEASE] MRC v24.10.00 #507

Merged
merged 19 commits into from
Nov 1, 2024
Merged

[RELEASE] MRC v24.10.00 #507

merged 19 commits into from
Nov 1, 2024

Commits on Jul 3, 2024

  1. Configuration menu
    Copy the full SHA
    f754c78 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    246ac97 View commit details
    Browse the repository at this point in the history
  3. Merge pull request #484 from nv-morpheus/branch-24.06

    Forward-merge branch-24.06 into branch-24.10
    dagardner-nv authored Jul 3, 2024
    Configuration menu
    Copy the full SHA
    8377f6a View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2024

  1. Ensure proper initialization of CMAKE_INSTALL_PREFIX if needed (#485)

    * Invoke `morpheus_utils_initialize_install_prefix` function after calling `project`
    * Related to nv-morpheus/Morpheus#1776
    
    Authors:
      - David Gardner (https://github.com/dagardner-nv)
    
    Approvers:
      - Michael Demoret (https://github.com/mdemoret-nv)
    
    URL: #485
    dagardner-nv authored Jul 24, 2024
    Configuration menu
    Copy the full SHA
    bceb7ef View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2024

  1. Stop a python source once the subscriber is no longer subscribed (#493)

    * When a Python generator source yields a value, and the subscriber is no longer subscribed, stop the source.
    * Fix out of date docstring comment.
    
    This is a partial fix for nv-morpheus/Morpheus#1838
    
    Authors:
      - David Gardner (https://github.com/dagardner-nv)
    
    Approvers:
      - Anuradha Karuppiah (https://github.com/AnuradhaKaruppiah)
    
    URL: #493
    dagardner-nv authored Aug 29, 2024
    Configuration menu
    Copy the full SHA
    ca8a73f View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2024

  1. Define a Python source which receives a reference to a subscriber (#496)

    * Allows a Python generator source to check if the subscriber is still subscribed.
    * Define a class `SubscriberFuncWrapper`  for Python sources rather than just a lambda. The reason is that python objects captured by the lambda need to be destroyed while the gil is held, which causes a problem if the lambda is destroyed unexpectedly.
    * Update `conftest.py` to set the loglevel to `DEBUG` if the `GLOG_v` environment variable is defined.
    
    Authors:
      - David Gardner (https://github.com/dagardner-nv)
    
    Approvers:
      - Michael Demoret (https://github.com/mdemoret-nv)
    
    URL: #496
    dagardner-nv authored Sep 11, 2024
    Configuration menu
    Copy the full SHA
    8489b45 View commit details
    Browse the repository at this point in the history
  2. Change LOG(WARNING) to VLOG(1) when no GPUs are detected (#497)

    * Since CPU-only mode will become a supported feature we want to avoid unnecessary warnings.
    
    Relates to nv-morpheus/Morpheus#1851
    
    Authors:
      - David Gardner (https://github.com/dagardner-nv)
    
    Approvers:
      - Michael Demoret (https://github.com/mdemoret-nv)
    
    URL: #497
    dagardner-nv authored Sep 11, 2024
    Configuration menu
    Copy the full SHA
    ccbcd76 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. Pass a mrc.Subscription object to sources rather than a `mrc.Subscr…

    …iber` (#499)
    
    * Remove the `make_source_subscriber` method in favor of inspecting the Python function signature.
    * Since the `make_source_subscriber` method was never part of a release I think this can still be considered a non-breaking change.
    
    Authors:
      - David Gardner (https://github.com/dagardner-nv)
    
    Approvers:
      - Michael Demoret (https://github.com/mdemoret-nv)
    
    URL: #499
    dagardner-nv authored Sep 17, 2024
    Configuration menu
    Copy the full SHA
    48d17a1 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2024

  1. Update to RAPIDS 24.10 (#494)

    Closes #478
    Requires nv-morpheus/utilities#75
    
    Authors:
      - Christopher Harris (https://github.com/cwharris)
      - Michael Demoret (https://github.com/mdemoret-nv)
    
    Approvers:
      - Anuradha Karuppiah (https://github.com/AnuradhaKaruppiah)
      - David Gardner (https://github.com/dagardner-nv)
    
    URL: #494
    cwharris authored Oct 4, 2024
    Configuration menu
    Copy the full SHA
    cef7f0b View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2024

  1. Adding environment variable to allow skip NUMA node check (#505)

    If the NUMA node check fails for a GPU, the entire pipeline cannot start. This allows setting `MRC_SKIP_NUMA_CHECK=1` to bypass the assertion if the check fails.
    
    Closes #504
    
    Authors:
      - Michael Demoret (https://github.com/mdemoret-nv)
      - David Gardner (https://github.com/dagardner-nv)
    
    Approvers:
      - Devin Robison (https://github.com/drobison00)
      - David Gardner (https://github.com/dagardner-nv)
    
    URL: #505
    mdemoret-nv authored Oct 10, 2024
    Configuration menu
    Copy the full SHA
    43f200e View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. Fix Incorrect docstring in mrc.core.coro (#503)

    * Include MRC libs with quotes not <>
    * Add MRC version string to coro module (all the other Python modules have this)
    * Fix spelling mistake in a comment in `python/mrc/core/executor.cpp`
    
    Closes [#492](#492)
    
    Authors:
      - David Gardner (https://github.com/dagardner-nv)
    
    Approvers:
      - Michael Demoret (https://github.com/mdemoret-nv)
    
    URL: #503
    dagardner-nv authored Oct 16, 2024
    Configuration menu
    Copy the full SHA
    4f23470 View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2024

  1. Fix get-pr-info gha reference (#500)

    `rapidsai/shared-action-workflows/get-pr-info` was deleted in favor of `nv-gha-runners/get-pr-info`
    
    rapidsai/shared-actions#11
    
    Authors:
      - Christopher Harris (https://github.com/cwharris)
      - David Gardner (https://github.com/dagardner-nv)
    
    Approvers:
      - Michael Demoret (https://github.com/mdemoret-nv)
    
    URL: #500
    cwharris authored Oct 21, 2024
    Configuration menu
    Copy the full SHA
    4acef2b View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2024

  1. devcontainer: replace VAULT_HOST with AWS_ROLE_ARN (#506)

    This PR is replacing the `VAULT_HOST` variable with `AWS_ROLE_ARN`. This is required to use the new token service to get AWS credentials
    
    Authors:
      - Jordan Jacobelli (https://github.com/jjacobelli)
    
    Approvers:
      - David Gardner (https://github.com/dagardner-nv)
    
    URL: #506
    jjacobelli authored Oct 22, 2024
    Configuration menu
    Copy the full SHA
    61862b5 View commit details
    Browse the repository at this point in the history
  2. Add Router nodes to support single input, multi output routing. (#502)

    Overview of new classes added in this PR:
    
    - `DynamicRouterBase`
      - Sink
        - `WritableProvider`, `ReadableAcceptor`, `SinkChannelOwner`
      - Source
        - `MultiWritableAcceptor`, `MultiReadableProvider`, `MultiSourceChannelOwner`
      - Runnable with ability to change number of outputs at runtime
      - Cannot be added to a Segment
      - Good backpressure support. Can still process requests if downstream blocks
      - `LambdaDynamicRouter`
        - Provide key function via lambda
    - `DynamicRouterComponentBase`
      - Sink
        - `ForwardingWritableProvider`
      - Source
        - `MultiWritableAcceptor`, `MultiReadableProvider`, `MultiSourceChannelOwner`
      - Non-Runnable with ability to change number of outputs at runtime
      - Limited backpressure support. Will block if downstream blocks
      - `LambdaDynamicRouterComponent`
        - Provide key function via lambda
    - `StaticRouterRunnableBase`
      - Sink
        - `WritableProvider`, `ReadableAcceptor`, `SinkChannelOwner`
      - Source
        - `MultiWritableAcceptor`, `MultiReadableProvider`, `MultiSourceChannelOwner`
      - Runnable with fixed number of outputs
      - Can be added to a Segment since it supports child outputs
      - Good backpressure support. Can still process requests if downstream blocks
      - `LambdaStaticRouterRunnable`
        - Provide key function via lambda
    - `StaticRouterComponentBase`
      - Sink
        - `ForwardingWritableProvider`
      - Source
        - `MultiWritableAcceptor`, `MultiReadableProvider`, `MultiSourceChannelOwner`
      - Non-Runnable with fixed number of outputs
      - Can be added to a Segment since it supports child outputs
      - Limited backpressure support. Will block if downstream blocks
      - `LambdaStaticRouterComponent`
        - Provide key function via lambda
    
    Closes #491
    
    Authors:
      - Michael Demoret (https://github.com/mdemoret-nv)
      - David Gardner (https://github.com/dagardner-nv)
    
    Approvers:
      - David Gardner (https://github.com/dagardner-nv)
    
    URL: #502
    mdemoret-nv authored Oct 22, 2024
    Configuration menu
    Copy the full SHA
    a4b2ca1 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2024

  1. Fix CMake issue which installed headers incorrectly during conda build (

    #511)
    
    Fixes a few issues:
    - Headers were being installed incorrectly with new `HEADER_SET`
    - Fixed packages for pymrc component
    - Standardized the component naming
    
    Closes #509
    
    Authors:
      - Michael Demoret (https://github.com/mdemoret-nv)
    
    Approvers:
      - Anuradha Karuppiah (https://github.com/AnuradhaKaruppiah)
      - Christopher Harris (https://github.com/cwharris)
    
    URL: #511
    mdemoret-nv authored Oct 24, 2024
    Configuration menu
    Copy the full SHA
    7abfdf7 View commit details
    Browse the repository at this point in the history
  2. fix build interface includes (#514)

    build interface includes was accidentally using
    ```
    .../build/conda/cuda-12.5/release/autogenerated/include
    ```
    instead of 
    ```
    .../build/conda/cuda-12.5/release/cpp/mrc/autogenerated/include
    ```
    this PR fixes that, such when depending on mrc from down-stream libraries, the following error does not occur:
    ```
    CMake Error in python/morpheus_llm/morpheus_llm/_lib/CMakeLists.txt:
      Imported target "mrc::pymrc" includes non-existent path
    
        "/home/coder/mrc/build/conda/cuda-12.5/release/autogenerated/include"
    
      in its INTERFACE_INCLUDE_DIRECTORIES.  Possible reasons include:
    
      * The path was deleted, renamed, or moved to another location.
    
      * An install or uninstall procedure did not complete successfully.
    
      * The installation package was faulty and references files it does not
      provide.
    ```
    
    Authors:
      - Christopher Harris (https://github.com/cwharris)
    
    Approvers:
      - Michael Demoret (https://github.com/mdemoret-nv)
    
    URL: #514
    cwharris authored Oct 24, 2024
    Configuration menu
    Copy the full SHA
    06d4ea1 View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2024

  1. Updating CHANGELOG

    dagardner-nv committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    fff44d6 View commit details
    Browse the repository at this point in the history
  2. IWYU fixes (#517)

    Authors:
      - David Gardner (https://github.com/dagardner-nv)
    
    Approvers:
      - Anuradha Karuppiah (https://github.com/AnuradhaKaruppiah)
    
    URL: #517
    dagardner-nv authored Nov 1, 2024
    Configuration menu
    Copy the full SHA
    af67e11 View commit details
    Browse the repository at this point in the history
  3. Updating CHANGELOG

    dagardner-nv committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    e1f286f View commit details
    Browse the repository at this point in the history