Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Tpetra: revert TAFC changes #13607

Merged
merged 1 commit into from
Nov 21, 2024
Merged

Tpetra: revert TAFC changes #13607

merged 1 commit into from
Nov 21, 2024

Conversation

jhux2
Copy link
Member

@jhux2 jhux2 commented Nov 15, 2024

Until we can diagnose segfaults reported wrt PR #13598.

This reverts commit 7eb5fe5, reversing changes made to e20e3cd.

@trilinos/

Motivation

Segfaults reported in MiniEM.

Related Issues

  • Closes put-issue-number-here

Stakeholder Feedback

N/A

Testing

@skennon10 confirmed that reverted this MR fixes observed segfaults.

@jhux2 jhux2 requested a review from a team as a code owner November 15, 2024 20:05
@jhux2
Copy link
Member Author

jhux2 commented Nov 15, 2024

@NyquilDreams

@jhux2 jhux2 requested review from tjfulle and removed request for a team November 15, 2024 20:31
@trilinos-autotester
Copy link
Contributor

Status Flag 'Pre-Test Inspection' - Auto Inspected - Inspection is Not Necessary for this Pull Request.

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: PR_gcc-openmpi-openmp

  • Build Num: 778
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-openmpi-4.1.6-openmp_release-debug_static_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f

Build Information

Test Name: PR_gcc

  • Build Num: 828
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-serial_release-debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_no-mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f

Build Information

Test Name: PR_gcc-openmpi_debug

  • Build Num: 829
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-openmpi-4.1.6-serial_debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f

Build Information

Test Name: PR_clang

  • Build Num: 827
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-clang-11.0.1-openmpi-4.0.5-serial_release-debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f

Build Information

Test Name: Trilinos_PR_python3

  • Build Num: 4786
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
BLOCKING_BUILD false
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_aue-gnu-12.1.0-anaconda3-serial_debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_no-mpi_no-pt_no-rdc_no-uvm_deprecated-on_pr-framework
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f

Build Information

Test Name: PR_cuda

  • Build Num: 826
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-cuda-11.4.2-gnu-10.1.0-openmpi-4.1.6_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8-gpu
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f

Build Information

Test Name: PR_intel

  • Build Num: 747
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-intel-2021.3-sems-openmpi-4.1.6_release-debug_shared_no-kokkos-arch_no-asan_no-complex_fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f

Build Information

Test Name: PR_cuda-uvm

  • Build Num: 826
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-cuda-11.4.2-gnu-10.1.0-openmpi-4.1.6_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f

Using Repos:

Repo: TRILINOS (trilinos/Trilinos)
  • Branch: revert-tafc-changes
  • SHA: f5996ca
  • Mode: TEST_REPO

Pull Request Author: jhux2

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pull Request AutoTester' - Jenkins Testing: 1 or more Jobs FAILED

Note: Testing will normally be attempted again in approx. 2 Hrs 30 Mins. If a change to the PR source branch occurs, the testing will be attempted again on next available autotester run.

Pull Request Auto Testing has FAILED (click to expand)

Build Information

Test Name: PR_gcc-openmpi-openmp

  • Build Num: 778
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-openmpi-4.1.6-openmp_release-debug_static_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f

Build Information

Test Name: PR_gcc

  • Build Num: 828
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-serial_release-debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_no-mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f

Build Information

Test Name: PR_gcc-openmpi_debug

  • Build Num: 829
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-openmpi-4.1.6-serial_debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f

Build Information

Test Name: PR_clang

  • Build Num: 827
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-clang-11.0.1-openmpi-4.0.5-serial_release-debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f

Build Information

Test Name: Trilinos_PR_python3

  • Build Num: 4786
  • Status: FAILED

Jenkins Parameters

Parameter Name Value
BLOCKING_BUILD false
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_aue-gnu-12.1.0-anaconda3-serial_debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_no-mpi_no-pt_no-rdc_no-uvm_deprecated-on_pr-framework
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f

Build Information

Test Name: PR_cuda

  • Build Num: 826
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-cuda-11.4.2-gnu-10.1.0-openmpi-4.1.6_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8-gpu
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f

Build Information

Test Name: PR_intel

  • Build Num: 747
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-intel-2021.3-sems-openmpi-4.1.6_release-debug_shared_no-kokkos-arch_no-asan_no-complex_fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f

Build Information

Test Name: PR_cuda-uvm

  • Build Num: 826
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-cuda-11.4.2-gnu-10.1.0-openmpi-4.1.6_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA f5996ca
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA 0dd826f


CDash Test Results for PR# 13607.


Wiki: How to Reproduce PR Testing Builds and Errors.

@jhux2 jhux2 mentioned this pull request Nov 18, 2024
Closed
@eugeneswalker
Copy link

Without this PR I was seeing segfaults for all of the following tests:

Amesos2_KLU2_Solver_Test_MPI_2
Amesos2_KLU2_UnitTests_MPI_2
Amesos2_SolverFactory_UnitTests_MPI_4
Amesos2_Tpetra_CrsMatrix_Adapter_UnitTests_MPI_4
TpetraCore_AdditiveSchwarzHalo_MPI_4
TpetraCore_AsyncTransfer_UnitTests_MPI_4
TpetraCore_BlockCrsMatrix_MPI_4
TpetraCore_Bug10008_MPI_4
TpetraCore_CrsMatrix_Bug8447_MPI_2
TpetraCore_CrsMatrix_transpose_sortedRows_MPI_4
TpetraCore_FECrs_MatrixMatrix_UnitTests_MPI_4
TpetraCore_ImportExport2_UnitTests_Alltoall_MPI_4
TpetraCore_ImportExport2_UnitTests_ISend_MPI_4
TpetraCore_ImportExport2_UnitTests_Send_MPI_4
TpetraCore_MatrixMatrix_UnitTests_MPI_4
TpetraCore_RowMatrixTransposer_test_MPI_4
TpetraCore_RowMatrixTransposer_UnitTests_MPI_4
Zoltan2_Coloring1_commanchedual_D1_nonzeros_MPI_4
Zoltan2_Coloring1_commanchedual_D1_rows_MPI_4
Zoltan2_Coloring1_commanchedual_D1-2GL_nonzeros_MPI_4
Zoltan2_Coloring1_commanchedual_D1-2GL_rows_MPI_4
Zoltan2_Coloring1_commanchedual_D2_MPI_4
Zoltan2_Coloring1_commanchedual_D2_nonzeros_MPI_4
Zoltan2_Coloring1_commanchedual_D2_rows_MPI_4
Zoltan2_Coloring1_commanchedual_PD2_MPI_4
Zoltan2_Coloring1_commanchedual_PD2_nonzeros_MPI_4
Zoltan2_Coloring1_commanchedual_PD2_rows_MPI_4
Zoltan2_Coloring1_complete_D2_MPI_4
Zoltan2_Coloring1_complete_PD2_MPI_4
Zoltan2_Coloring1_simple_D1_nonzeros_MPI_4
Zoltan2_Coloring1_simple_D1_rows_MPI_4
Zoltan2_Coloring1_simple_D1-2GL_nonzeros_MPI_4
Zoltan2_Coloring1_simple_D1-2GL_rows_MPI_4
Zoltan2_Coloring1_simple_D2_MPI_4
Zoltan2_Coloring1_simple_D2_nonzeros_MPI_4
Zoltan2_Coloring1_simple_D2_recolor_degrees_MPI_4
Zoltan2_Coloring1_simple_D2_rows_MPI_4
Zoltan2_Coloring1_simple_D2_serial_threshold_25_MPI_4
Zoltan2_Coloring1_simple_PD2_MPI_4
Zoltan2_Coloring1_simple_PD2_nonzeros_MPI_4
Zoltan2_Coloring1_simple_PD2_recolor_degrees_MPI_4
Zoltan2_Coloring1_simple_PD2_rows_MPI_4
Zoltan2_Coloring1_simple_PD2_serial_threshold_25_MPI_4
Zoltan2_GraphModel_MPI_4
Zoltan2_Partitioning1_ParMETIS_EWeights_MPI_4
Zoltan2_Partitioning1_ParMETIS_MPI_4
Zoltan2_Partitioning1_ParMETIS_OneProc_EWeights_MPI_4
Zoltan2_Partitioning1_ParMETIS_OneProc_MPI_4
Zoltan2_Partitioning1_ParMETIS_OneProc_VWeights_MPI_4
Zoltan2_Partitioning1_ParMETIS_VWeights_MPI_4
Zoltan2_Partitioning1_Quotient_MPI_4
Zoltan2_Partitioning1_Quotient_OneProc_MPI_4
Zoltan2_Partitioning1_Quotient_OneProc_Threshold1_MPI_4
Zoltan2_Partitioning1_Quotient_OneProc_Threshold2_MPI_4
Zoltan2_Partitioning1_Quotient_Threshold1_MPI_4
Zoltan2_Partitioning1_Quotient_Threshold2_MPI_4
Zoltan2_TpetraCrsColorer_galeri1_MPI_4
Zoltan2_TpetraCrsColorer_galeri2_MPI_4
Zoltan2_TpetraCrsColorer_simple_MPI_4
Zoltan2_TpetraCrsColorer_simple_nodistrib_MPI_4
Zoltan2_TpetraCrsColorer_troublecauser_MPI_4
Zoltan2_TpetraCrsColorer_west0067_MPI_4
Zoltan2_TpetraCrsColorer_west0067_nodistrib_MPI_4
Zoltan2_XpetraCrsMatrixInput_MPI_4
Zoltan2_XpetraTraits_MPI_4

With this PR I only see the following test from the above list continuing to segfault:

  • Amesos2_SolverFactory_UnitTests_MPI_4
root@17e849900a29:/build# ctest --timeout 180 --output-on-failure -R "Amesos2_SolverFactory_UnitTests_MPI_4"
Test project /build
    Start 785: Amesos2_SolverFactory_UnitTests_MPI_4
1/1 Test #785: Amesos2_SolverFactory_UnitTests_MPI_4 ...***Failed  Required regular expression not found. Regex=[End Result: TEST PASSED
]  4.15 sec
Teuchos::GlobalMPISession::GlobalMPISession(): started processor with name 17e849900a29 and rank 0!

***
*** Unit test suite ...
***


Sorting tests by group name then by the order they were added ... (time = 2.58e-06)

Running unit tests ...

0. SolverFactory_double_int_longlong_Tpetra_KokkosCompat_KokkosCudaWrapperNode_Solve_UnitTest ... Teuchos::GlobalMPISession::GlobalMPISession(): started processor with name 17e849900a29 and rank 1!
Teuchos::GlobalMPISession::GlobalMPISession(): started processor with name 17e849900a29 and rank 2!
Teuchos::GlobalMPISession::GlobalMPISession(): started processor with name 17e849900a29 and rank 3!

===================================================================================
=   BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
=   PID 1346602 RUNNING AT 17e849900a29
=   EXIT CODE: 139
=   CLEANING UP REMAINING PROCESSES
=   YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
===================================================================================
YOUR APPLICATION TERMINATED WITH THE EXIT STRING: Segmentation fault (signal 11)
This typically refers to a problem with your application.
Please see the FAQ page for debugging suggestions


0% tests passed, 1 tests failed out of 1

Subproject Time Summary:
Amesos2    =  16.61 sec*proc (1 test)

Total Test time (real) =   4.72 sec

The following tests FAILED:
	785 - Amesos2_SolverFactory_UnitTests_MPI_4 (Failed)
Errors while running CTest

@jhux2
Tpetra: revert #13491
4b7b350 
Until we can diagnose segfaults reported wrt PR #13598.

Signed-off-by: Jonathan Hu <[email protected]>
@jhux2 jhux2 added the AT: RETEST Causes the PR autotester to run a new round of PR tests on the next iteration label Nov 20, 2024
@trilinos-autotester
Copy link
Contributor

Status Flag 'Pull Request AutoTester' - User Requested Retest - Label AT: RETEST will be reset after testing.

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pre-Test Inspection' - Auto Inspected - Inspection is Not Necessary for this Pull Request.

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: PR_gcc-openmpi-openmp

  • Build Num: 805
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-openmpi-4.1.6-openmp_release-debug_static_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: PR_gcc

  • Build Num: 855
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-serial_release-debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_no-mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: PR_gcc-openmpi_debug

  • Build Num: 856
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-openmpi-4.1.6-serial_debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: PR_clang

  • Build Num: 854
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-clang-11.0.1-openmpi-4.0.5-serial_release-debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: Trilinos_PR_python3

  • Build Num: 4813
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
BLOCKING_BUILD false
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_aue-gnu-12.1.0-anaconda3-serial_debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_no-mpi_no-pt_no-rdc_no-uvm_deprecated-on_pr-framework
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: PR_cuda

  • Build Num: 853
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-cuda-11.4.2-gnu-10.1.0-openmpi-4.1.6_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8-gpu
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: PR_intel

  • Build Num: 774
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-intel-2021.3-sems-openmpi-4.1.6_release-debug_shared_no-kokkos-arch_no-asan_no-complex_fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: PR_cuda-uvm

  • Build Num: 853
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-cuda-11.4.2-gnu-10.1.0-openmpi-4.1.6_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Using Repos:

Repo: TRILINOS (trilinos/Trilinos)
  • Branch: revert-tafc-changes
  • SHA: 4b7b350
  • Mode: TEST_REPO

Pull Request Author: jhux2

@jhux2 jhux2 added AT: STALE Added by the PR autotester if too much time has elapsed since the last successful PR test iteration AT: WIP Causes the PR autotester to not test the PR. (Remove to allow testing to occur.) AT: RETEST Causes the PR autotester to run a new round of PR tests on the next iteration and removed AT: RETEST Causes the PR autotester to run a new round of PR tests on the next iteration AT: STALE Added by the PR autotester if too much time has elapsed since the last successful PR test iteration AT: WIP Causes the PR autotester to not test the PR. (Remove to allow testing to occur.) labels Nov 20, 2024
@trilinos-autotester
Copy link
Contributor

Status Flag 'Pull Request AutoTester' - Jenkins Testing: 1 or more Jobs FAILED

Note: Testing will normally be attempted again in approx. 2 Hrs 30 Mins. If a change to the PR source branch occurs, the testing will be attempted again on next available autotester run.

Pull Request Auto Testing has FAILED (click to expand)

Build Information

Test Name: PR_gcc-openmpi-openmp

  • Build Num: 805
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-openmpi-4.1.6-openmp_release-debug_static_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: PR_gcc

  • Build Num: 855
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-serial_release-debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_no-mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: PR_gcc-openmpi_debug

  • Build Num: 856
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-openmpi-4.1.6-serial_debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: PR_clang

  • Build Num: 854
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-clang-11.0.1-openmpi-4.0.5-serial_release-debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: Trilinos_PR_python3

  • Build Num: 4813
  • Status: FAILED

Jenkins Parameters

Parameter Name Value
BLOCKING_BUILD false
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_aue-gnu-12.1.0-anaconda3-serial_debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_no-mpi_no-pt_no-rdc_no-uvm_deprecated-on_pr-framework
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: PR_cuda

  • Build Num: 853
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-cuda-11.4.2-gnu-10.1.0-openmpi-4.1.6_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8-gpu
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: PR_intel

  • Build Num: 774
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-intel-2021.3-sems-openmpi-4.1.6_release-debug_shared_no-kokkos-arch_no-asan_no-complex_fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: PR_cuda-uvm

  • Build Num: 853
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-cuda-11.4.2-gnu-10.1.0-openmpi-4.1.6_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd


CDash Test Results for PR# 13607.


Wiki: How to Reproduce PR Testing Builds and Errors.

@trilinos-autotester trilinos-autotester removed the AT: RETEST Causes the PR autotester to run a new round of PR tests on the next iteration label Nov 20, 2024
@jhux2 jhux2 added AT: RETEST Causes the PR autotester to run a new round of PR tests on the next iteration AT: AUTOMERGE Causes the PR autotester to automatically merge the PR branch once approvals are completed labels Nov 20, 2024
@trilinos-autotester
Copy link
Contributor

Status Flag 'Pull Request AutoTester' - User Requested Retest - Label AT: RETEST will be reset after testing.

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: PR_gcc-openmpi-openmp

  • Build Num: 815
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-openmpi-4.1.6-openmp_release-debug_static_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: PR_gcc

  • Build Num: 865
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-serial_release-debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_no-mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: PR_gcc-openmpi_debug

  • Build Num: 866
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-openmpi-4.1.6-serial_debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: PR_clang

  • Build Num: 864
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-clang-11.0.1-openmpi-4.0.5-serial_release-debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: Trilinos_PR_python3

  • Build Num: 4823
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
BLOCKING_BUILD false
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_aue-gnu-12.1.0-anaconda3-serial_debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_no-mpi_no-pt_no-rdc_no-uvm_deprecated-on_pr-framework
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: PR_cuda

  • Build Num: 863
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-cuda-11.4.2-gnu-10.1.0-openmpi-4.1.6_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8-gpu
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: PR_intel

  • Build Num: 784
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-intel-2021.3-sems-openmpi-4.1.6_release-debug_shared_no-kokkos-arch_no-asan_no-complex_fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: PR_cuda-uvm

  • Build Num: 863
  • Status: STARTED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-cuda-11.4.2-gnu-10.1.0-openmpi-4.1.6_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Using Repos:

Repo: TRILINOS (trilinos/Trilinos)
  • Branch: revert-tafc-changes
  • SHA: 4b7b350
  • Mode: TEST_REPO

Pull Request Author: jhux2

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pull Request AutoTester' - Jenkins Testing: all Jobs PASSED

Pull Request Auto Testing has PASSED (click to expand)

Build Information

Test Name: PR_gcc-openmpi-openmp

  • Build Num: 815
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-openmpi-4.1.6-openmp_release-debug_static_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: PR_gcc

  • Build Num: 865
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-serial_release-debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_no-mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: PR_gcc-openmpi_debug

  • Build Num: 866
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-gnu-8.5.0-openmpi-4.1.6-serial_debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: PR_clang

  • Build Num: 864
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-clang-11.0.1-openmpi-4.0.5-serial_release-debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: Trilinos_PR_python3

  • Build Num: 4823
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
BLOCKING_BUILD false
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_aue-gnu-12.1.0-anaconda3-serial_debug_shared_no-kokkos-arch_no-asan_no-complex_no-fpic_no-mpi_no-pt_no-rdc_no-uvm_deprecated-on_pr-framework
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: PR_cuda

  • Build Num: 863
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-cuda-11.4.2-gnu-10.1.0-openmpi-4.1.6_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8-gpu
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: PR_intel

  • Build Num: 784
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-intel-2021.3-sems-openmpi-4.1.6_release-debug_shared_no-kokkos-arch_no-asan_no-complex_fpic_mpi_no-pt_no-rdc_no-uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd

Build Information

Test Name: PR_cuda-uvm

  • Build Num: 863
  • Status: PASSED

Jenkins Parameters

Parameter Name Value
FORCE_CLEAN true
GENCONFIG_BUILD_NAME rhel8_sems-cuda-11.4.2-gnu-10.1.0-openmpi-4.1.6_release_static_Volta70_no-asan_complex_no-fpic_mpi_pt_no-rdc_uvm_deprecated-on_no-package-enables
PR_LABELS pkg: Tpetra;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM 13607
PULLREQUEST_CDASH_TRACK Pull Request
TEST_REPO_ALIAS TRILINOS
TRILINOS_NODE_LABEL rhel8
TRILINOS_SOURCE_REPO https://github.com/trilinos/Trilinos
TRILINOS_SOURCE_SHA 4b7b350
TRILINOS_SRN_CONFIG true
TRILINOS_TARGET_BRANCH develop
TRILINOS_TARGET_REPO https://github.com/trilinos/Trilinos
TRILINOS_TARGET_SHA c87e9bd


CDash Test Results for PR# 13607.

@trilinos-autotester trilinos-autotester removed the AT: RETEST Causes the PR autotester to run a new round of PR tests on the next iteration label Nov 21, 2024
@trilinos-autotester
Copy link
Contributor

Status Flag 'Pre-Merge Inspection' - SUCCESS: The last commit to this Pull Request has been INSPECTED AND APPROVED by [ cgcgcg ]!

@trilinos-autotester
Copy link
Contributor

Status Flag 'Pull Request AutoTester' - Pull Request will be Automerged

@trilinos-autotester trilinos-autotester merged commit b6b5da6 into develop Nov 21, 2024
16 of 17 checks passed
@trilinos-autotester
Copy link
Contributor

Merge on Pull Request# 13607: IS A SUCCESS - Pull Request successfully merged

@trilinos-autotester trilinos-autotester removed the AT: AUTOMERGE Causes the PR autotester to automatically merge the PR branch once approvals are completed label Nov 21, 2024
@trilinos-autotester trilinos-autotester deleted the revert-tafc-changes branch November 21, 2024 02:21
@NyquilDreams
Copy link

Without this PR I was seeing segfaults for all of the following tests:

Amesos2_KLU2_Solver_Test_MPI_2
Amesos2_KLU2_UnitTests_MPI_2
Amesos2_SolverFactory_UnitTests_MPI_4
Amesos2_Tpetra_CrsMatrix_Adapter_UnitTests_MPI_4
TpetraCore_AdditiveSchwarzHalo_MPI_4
TpetraCore_AsyncTransfer_UnitTests_MPI_4
TpetraCore_BlockCrsMatrix_MPI_4
TpetraCore_Bug10008_MPI_4
TpetraCore_CrsMatrix_Bug8447_MPI_2
TpetraCore_CrsMatrix_transpose_sortedRows_MPI_4
TpetraCore_FECrs_MatrixMatrix_UnitTests_MPI_4
TpetraCore_ImportExport2_UnitTests_Alltoall_MPI_4
TpetraCore_ImportExport2_UnitTests_ISend_MPI_4
TpetraCore_ImportExport2_UnitTests_Send_MPI_4
TpetraCore_MatrixMatrix_UnitTests_MPI_4
TpetraCore_RowMatrixTransposer_test_MPI_4
TpetraCore_RowMatrixTransposer_UnitTests_MPI_4
Zoltan2_Coloring1_commanchedual_D1_nonzeros_MPI_4
Zoltan2_Coloring1_commanchedual_D1_rows_MPI_4
Zoltan2_Coloring1_commanchedual_D1-2GL_nonzeros_MPI_4
Zoltan2_Coloring1_commanchedual_D1-2GL_rows_MPI_4
Zoltan2_Coloring1_commanchedual_D2_MPI_4
Zoltan2_Coloring1_commanchedual_D2_nonzeros_MPI_4
Zoltan2_Coloring1_commanchedual_D2_rows_MPI_4
Zoltan2_Coloring1_commanchedual_PD2_MPI_4
Zoltan2_Coloring1_commanchedual_PD2_nonzeros_MPI_4
Zoltan2_Coloring1_commanchedual_PD2_rows_MPI_4
Zoltan2_Coloring1_complete_D2_MPI_4
Zoltan2_Coloring1_complete_PD2_MPI_4
Zoltan2_Coloring1_simple_D1_nonzeros_MPI_4
Zoltan2_Coloring1_simple_D1_rows_MPI_4
Zoltan2_Coloring1_simple_D1-2GL_nonzeros_MPI_4
Zoltan2_Coloring1_simple_D1-2GL_rows_MPI_4
Zoltan2_Coloring1_simple_D2_MPI_4
Zoltan2_Coloring1_simple_D2_nonzeros_MPI_4
Zoltan2_Coloring1_simple_D2_recolor_degrees_MPI_4
Zoltan2_Coloring1_simple_D2_rows_MPI_4
Zoltan2_Coloring1_simple_D2_serial_threshold_25_MPI_4
Zoltan2_Coloring1_simple_PD2_MPI_4
Zoltan2_Coloring1_simple_PD2_nonzeros_MPI_4
Zoltan2_Coloring1_simple_PD2_recolor_degrees_MPI_4
Zoltan2_Coloring1_simple_PD2_rows_MPI_4
Zoltan2_Coloring1_simple_PD2_serial_threshold_25_MPI_4
Zoltan2_GraphModel_MPI_4
Zoltan2_Partitioning1_ParMETIS_EWeights_MPI_4
Zoltan2_Partitioning1_ParMETIS_MPI_4
Zoltan2_Partitioning1_ParMETIS_OneProc_EWeights_MPI_4
Zoltan2_Partitioning1_ParMETIS_OneProc_MPI_4
Zoltan2_Partitioning1_ParMETIS_OneProc_VWeights_MPI_4
Zoltan2_Partitioning1_ParMETIS_VWeights_MPI_4
Zoltan2_Partitioning1_Quotient_MPI_4
Zoltan2_Partitioning1_Quotient_OneProc_MPI_4
Zoltan2_Partitioning1_Quotient_OneProc_Threshold1_MPI_4
Zoltan2_Partitioning1_Quotient_OneProc_Threshold2_MPI_4
Zoltan2_Partitioning1_Quotient_Threshold1_MPI_4
Zoltan2_Partitioning1_Quotient_Threshold2_MPI_4
Zoltan2_TpetraCrsColorer_galeri1_MPI_4
Zoltan2_TpetraCrsColorer_galeri2_MPI_4
Zoltan2_TpetraCrsColorer_simple_MPI_4
Zoltan2_TpetraCrsColorer_simple_nodistrib_MPI_4
Zoltan2_TpetraCrsColorer_troublecauser_MPI_4
Zoltan2_TpetraCrsColorer_west0067_MPI_4
Zoltan2_TpetraCrsColorer_west0067_nodistrib_MPI_4
Zoltan2_XpetraCrsMatrixInput_MPI_4
Zoltan2_XpetraTraits_MPI_4

With this PR I only see the following test from the above list continuing to segfault:

  • Amesos2_SolverFactory_UnitTests_MPI_4
root@17e849900a29:/build# ctest --timeout 180 --output-on-failure -R "Amesos2_SolverFactory_UnitTests_MPI_4"
Test project /build
    Start 785: Amesos2_SolverFactory_UnitTests_MPI_4
1/1 Test #785: Amesos2_SolverFactory_UnitTests_MPI_4 ...***Failed  Required regular expression not found. Regex=[End Result: TEST PASSED
]  4.15 sec
Teuchos::GlobalMPISession::GlobalMPISession(): started processor with name 17e849900a29 and rank 0!

***
*** Unit test suite ...
***


Sorting tests by group name then by the order they were added ... (time = 2.58e-06)

Running unit tests ...

0. SolverFactory_double_int_longlong_Tpetra_KokkosCompat_KokkosCudaWrapperNode_Solve_UnitTest ... Teuchos::GlobalMPISession::GlobalMPISession(): started processor with name 17e849900a29 and rank 1!
Teuchos::GlobalMPISession::GlobalMPISession(): started processor with name 17e849900a29 and rank 2!
Teuchos::GlobalMPISession::GlobalMPISession(): started processor with name 17e849900a29 and rank 3!

===================================================================================
=   BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
=   PID 1346602 RUNNING AT 17e849900a29
=   EXIT CODE: 139
=   CLEANING UP REMAINING PROCESSES
=   YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
===================================================================================
YOUR APPLICATION TERMINATED WITH THE EXIT STRING: Segmentation fault (signal 11)
This typically refers to a problem with your application.
Please see the FAQ page for debugging suggestions


0% tests passed, 1 tests failed out of 1

Subproject Time Summary:
Amesos2    =  16.61 sec*proc (1 test)

Total Test time (real) =   4.72 sec

The following tests FAILED:
	785 - Amesos2_SolverFactory_UnitTests_MPI_4 (Failed)
Errors while running CTest

@eugeneswalker Hi Eugene, can you inform me of how you got these errors so I can recreate and fix them? A reproducer and information about your configuration would be helpful. Thanks.

@eugeneswalker
Copy link

eugeneswalker commented Nov 22, 2024 •
edited
Loading

@eugeneswalker Hi Eugene, can you inform me of how you got these errors so I can recreate and fix them? A reproducer and information about your configuration would be helpful. Thanks.

Yes, absolutely.

We do our Trilinos builds inside Docker with GPU mapped in via nvidia-container-toolkit at the University of Oregon.

Here is how you could reproduce it. The cmake.sh is baked into the image, as are all build dependencies.

$> docker run -it --name trici-reproducer --gpus all esw123/trilinos-ci-cuda12.2.2:2024.11.05

# Clone source
root@460687cf30e1:/build# git clone https://github.com/trilinos/Trilinos /Trilinos
root@460687cf30e1:/build# git -C /Trilinos checkout d7d7ee234aaecf6fbed4bf3360d34770adc5d0d1

# CMake
root@17e849900a29:/build# export SOURCE_DIR=/Trilinos
root@17e849900a29:/build# export MPICH_CXX=$SOURCE_DIR/packages/kokkos/bin/nvcc_wrapper
root@17e849900a29:/build# export KOKKOS_ARCH=AMPERE80
root@460687cf30e1:/build# ./cmake.sh 2>&1 | tee cmake.output

# Build
root@460687cf30e1:/build# time ninja -j32
...

# Run tests
ctest --timeout 180 --output-on-failure -R "TpetraCore_BlockCrsMatrix_MPI_4|TpetraCore_Bug10008_MPI_4|TpetraCore_CrsMatrix_Bug8447_MPI_2|TpetraCore_ImportExport2_UnitTests_Send_MPI_4|TpetraCore_ImportExport2_UnitTests_ISend_MPI_4|TpetraCore_ImportExport2_UnitTests_Alltoall_MPI_4|TpetraCore_AsyncTransfer_UnitTests_MPI_4|TpetraCore_MatrixMatrix_UnitTests_MPI_4|TpetraCore_FECrs_MatrixMatrix_UnitTests_MPI_4|TpetraCore_RowMatrixTransposer_test_MPI_4|TpetraCore_RowMatrixTransposer_UnitTests_MPI_4|TpetraCore_CrsMatrix_transpose_sortedRows_MPI_4|TpetraCore_AdditiveSchwarzHalo_MPI_4|Amesos2_KLU2_UnitTests_MPI_2|Amesos2_KLU2_Solver_Test_MPI_2|Amesos2_SolverFactory_UnitTests_MPI_4|Amesos2_Tpetra_CrsMatrix_Adapter_UnitTests_MPI_4|Zoltan2_XpetraTraits_MPI_4|Zoltan2_XpetraCrsMatrixInput_MPI_4|Zoltan2_GraphModel_MPI_4|Zoltan2_Partitioning1_ParMETIS_MPI_4|Zoltan2_Partitioning1_ParMETIS_OneProc_MPI_4|Zoltan2_Partitioning1_ParMETIS_VWeights_MPI_4|Zoltan2_Partitioning1_ParMETIS_OneProc_VWeights_MPI_4|Zoltan2_Partitioning1_ParMETIS_EWeights_MPI_4|Zoltan2_Partitioning1_ParMETIS_OneProc_EWeights_MPI_4|Zoltan2_Partitioning1_Quotient_MPI_4|Zoltan2_Partitioning1_Quotient_OneProc_MPI_4|Zoltan2_Partitioning1_Quotient_Threshold1_MPI_4|Zoltan2_Partitioning1_Quotient_Threshold2_MPI_4|Zoltan2_Partitioning1_Quotient_OneProc_Threshold1_MPI_4|Zoltan2_Partitioning1_Quotient_OneProc_Threshold2_MPI_4|Zoltan2_TpetraCrsColorer_simple_MPI_4|Zoltan2_TpetraCrsColorer_simple_nodistrib_MPI_4|Zoltan2_TpetraCrsColorer_west0067_MPI_4|Zoltan2_TpetraCrsColorer_west0067_nodistrib_MPI_4|Zoltan2_TpetraCrsColorer_galeri1_MPI_4|Zoltan2_TpetraCrsColorer_galeri2_MPI_4|Zoltan2_TpetraCrsColorer_troublecauser_MPI_4|Zoltan2_Coloring1_simple_D1_rows_MPI_4|Zoltan2_Coloring1_simple_D1_nonzeros_MPI_4|Zoltan2_Coloring1_commanchedual_D1_rows_MPI_4|Zoltan2_Coloring1_commanchedual_D1_nonzeros_MPI_4|Zoltan2_Coloring1_simple_D1-2GL_rows_MPI_4|Zoltan2_Coloring1_simple_D1-2GL_nonzeros_MPI_4|Zoltan2_Coloring1_commanchedual_D1-2GL_rows_MPI_4|Zoltan2_Coloring1_commanchedual_D1-2GL_nonzeros_MPI_4|Zoltan2_Coloring1_simple_D2_MPI_4|Zoltan2_Coloring1_simple_D2_recolor_degrees_MPI_4|Zoltan2_Coloring1_simple_D2_serial_threshold_25_MPI_4|Zoltan2_Coloring1_simple_D2_rows_MPI_4|Zoltan2_Coloring1_simple_D2_nonzeros_MPI_4|Zoltan2_Coloring1_commanchedual_D2_MPI_4|Zoltan2_Coloring1_commanchedual_D2_rows_MPI_4|Zoltan2_Coloring1_commanchedual_D2_nonzeros_MPI_4|Zoltan2_Coloring1_complete_D2_MPI_4|Zoltan2_Coloring1_simple_PD2_MPI_4|Zoltan2_Coloring1_simple_PD2_recolor_degrees_MPI_4|Zoltan2_Coloring1_simple_PD2_serial_threshold_25_MPI_4|Zoltan2_Coloring1_simple_PD2_rows_MPI_4|Zoltan2_Coloring1_simple_PD2_nonzeros_MPI_4|Zoltan2_Coloring1_commanchedual_PD2_MPI_4|Zoltan2_Coloring1_commanchedual_PD2_rows_MPI_4|Zoltan2_Coloring1_commanchedual_PD2_nonzeros_MPI_4|Zoltan2_Coloring1_complete_PD2_MPI_4"
...
0% tests passed, 65 tests failed out of 65

Subproject Time Summary:
Amesos2    =  40.32 sec*proc (4 tests)
Tpetra     = 183.10 sec*proc (13 tests)
Zoltan2    = 696.32 sec*proc (48 tests)

Total Test time (real) = 234.73 sec

I shared this with @kuberry and I believe he shared with @ndellingwood and they were able to reproduce it. They may have used podman instead of Docker, but same concept.

Here is a failed pipeline run that shows the error:

@jhux2
Copy link
Member Author

jhux2 commented Nov 22, 2024

@kuberry @ndellingwood Is there an image that @NyquilDreams could use on the CEE lan?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@cgcgcg cgcgcg cgcgcg approved these changes

@brian-kelley brian-kelley Awaiting requested review from brian-kelley

@csiefer2 csiefer2 Awaiting requested review from csiefer2

@tjfulle tjfulle Awaiting requested review from tjfulle

Assignees
No one assigned
Labels
pkg: Tpetra
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@jhux2 @trilinos-autotester @eugeneswalker @NyquilDreams @cgcgcg