Reduce redundant GPU allocations #744

Job	Run time
CMake Matrix Test. (Linux Min GCC, ubuntu-22.04, gcc-12, g++-12, 3.9, 3.19.x, ON, OFF, static)	18m 20s
CMake Matrix Test. (Linux Min GCC, ubuntu-22.04, gcc-12, g++-12, 3.9, 3.19.x, ON, OFF, shared)	13m 42s
CMake Matrix Test. (Linux Min Clang, ubuntu-22.04, clang-12, clang++-12, 3.9, 3.19.x, ON, OFF, st...	14m 11s
CMake Matrix Test. (Linux Min Clang, ubuntu-22.04, clang-12, clang++-12, 3.9, 3.19.x, ON, OFF, sh...	14m 34s
CMake Matrix Test. (MacOS Min, macos-13, clang, clang++, 3.9, 3.19.x, ON, OFF, static)	14m 55s
CMake Matrix Test. (MacOS Min, macos-13, clang, clang++, 3.9, 3.19.x, ON, OFF, shared)	12m 44s
CMake Matrix Test. (Linux Max GCC, ubuntu-24.04, gcc-14, g++-14, 3.12, 3.22.x, ON, OFF, static)	31m 51s
CMake Matrix Test. (Linux Max GCC, ubuntu-24.04, gcc-14, g++-14, 3.12, 3.22.x, ON, OFF, shared)	22m 21s
CMake Matrix Test. (Linux SIMD, ubuntu-24.04, gcc-14, g++-14, 3.12, 3.22.x, OFF, ON, static)	31m 22s
CMake Matrix Test. (Linux SIMD, ubuntu-24.04, gcc-14, g++-14, 3.12, 3.22.x, OFF, ON, shared)	22m 49s
CMake Matrix Test. (Linux Max Clang, ubuntu-24.04, clang-18, clang++-18, 3.12, 3.22.x, ON, OFF, s...	18m 38s
CMake Matrix Test. (Linux Max Clang, ubuntu-24.04, clang-18, clang++-18, 3.12, 3.22.x, ON, OFF, s...	15m 17s
CMake Matrix Test. (MacOS Max, macos-14, clang, clang++, 3.12, 3.22.x, ON, OFF, static)	9m 19s
CMake Matrix Test. (MacOS Max, macos-14, clang, clang++, 3.12, 3.22.x, ON, OFF, shared)	8m 6s
	4h 8m 9s

Provide feedback