[Build] New docker image with GCC 14 and CUDA 12.8/13.0 (#26349) #6946
linux_cuda_ci.yml
on: push
Build Linux CUDA x64 Release
/
build_test_pipeline
53m 0s
Test Linux CUDA x64 Release
27m 32s
Annotations
8 warnings
Build Linux CUDA x64 Release / build_test_pipeline
Wheel output directory /mnt/vss/_work/_temp/Release/dist does not exist.
|
Build Linux CUDA x64 Release / build_test_pipeline
stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/local/dotnet:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/lib/jvm/msopenjdk-17/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+ python3 -m pip install --user -r tools/ci_build/github/linux/python/requirements.txt
WARNING: The script isympy is installed in '/home/onnxruntimedev/.local/bin' which is not on PATH.
Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
WARNING: The script pygmentize is installed in '/home/onnxruntimedev/.local/bin' which is not on PATH.
Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
WARNING: The scripts f2py and numpy-config are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH.
Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
WARNING: The scripts dmypy, mypy, mypyc, stubgen and stubtest are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH.
Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
WARNING: The scripts py.test and pytest are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH.
Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
WARNING: The scripts backend-test-tools, check-model and check-node are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH.
Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[notice] A new release of pip is available: 25.1.1 -> 25.2
[notice] To update, run: pip install --upgrade pip
+ python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_cuda --use_binskim_compliant_compile_flags --build_wheel --cuda_version=12.8 --cuda_home=/usr/local/cuda-12.8 --cudnn_home=/usr/local/cuda-12.8 --enable_cuda_profiling --build_java --cmake_extra_defines CMAKE_CUDA_ARCHITECTURES=90 onnxruntime_BUILD_UNIT_TESTS=ON onnxruntime_ENABLE_CUDA_EP_INTERNAL_TESTS=ON --build
2025-10-21 16:46:59,855 build [DEBUG] - Command line arguments:
--build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_cuda --use_binskim_compliant_compile_flags --build_wheel --cuda_version=12.8 --cuda_home=/usr/local/cuda-12.8 --cudnn_home=/usr/local/cuda-12.8 --enable_cuda_profiling --build_java --cmake_extra_defines CMAKE_CUDA_ARCHITECTURES=90 onnxruntime_BUILD_UNIT_TESTS=ON onnxruntime_ENABLE_CUDA_EP_INTERNAL_TESTS=ON --build
2025-10-21 16:46:59,858 build [INFO] - Build started
2025-10-21 16:46:59,858 build [INFO] - Building targets for Release configuration
2025-10-21 16:46:59,858 build [INFO] - /usr/bin/cmake --build build/Release/Release --config Release -- -j16
2025-10-21 17:07:22,723 build [INFO] - /opt/python/cp310-cp310/bin/python3 /onnxruntime_src/setup.py bdist_wheel --nightly_build --wheel_name_suffix=gpu --cuda_version=12.8
/opt/python/cp310-cp310/lib/python3.10/site-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated.
!!
********************************************************************************
Please consider removing the following classifiers in favor of a SPDX license expression:
License :: OSI Approved :: MIT License
See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details.
********************************************************************************
!!
self._finalize_license_expression()
/opt/python/cp310-cp310/lib/python3.10/site-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDepre
|
Build Linux CUDA x64 Release / build_test_pipeline
Wheel output directory /mnt/vss/_work/_temp/Release/dist does not exist.
|
Build Linux CUDA x64 Release / build_test_pipeline
stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/local/dotnet:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/lib/jvm/msopenjdk-17/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+ python3 -m pip install --user -r tools/ci_build/github/linux/python/requirements.txt
WARNING: The script isympy is installed in '/home/onnxruntimedev/.local/bin' which is not on PATH.
Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
WARNING: The script pygmentize is installed in '/home/onnxruntimedev/.local/bin' which is not on PATH.
Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
WARNING: The scripts f2py and numpy-config are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH.
Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
WARNING: The scripts dmypy, mypy, mypyc, stubgen and stubtest are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH.
Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
WARNING: The scripts py.test and pytest are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH.
Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
WARNING: The scripts backend-test-tools, check-model and check-node are installed in '/home/onnxruntimedev/.local/bin' which is not on PATH.
Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
[notice] A new release of pip is available: 25.1.1 -> 25.2
[notice] To update, run: pip install --upgrade pip
+ python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_cuda --use_binskim_compliant_compile_flags --build_wheel --cuda_version=12.8 --cuda_home=/usr/local/cuda-12.8 --cudnn_home=/usr/local/cuda-12.8 --enable_cuda_profiling --build_java --cmake_extra_defines CMAKE_CUDA_ARCHITECTURES=90 onnxruntime_BUILD_UNIT_TESTS=ON onnxruntime_ENABLE_CUDA_EP_INTERNAL_TESTS=ON --update
2025-10-21 16:42:41,757 build [DEBUG] - Command line arguments:
--build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_cuda --use_binskim_compliant_compile_flags --build_wheel --cuda_version=12.8 --cuda_home=/usr/local/cuda-12.8 --cudnn_home=/usr/local/cuda-12.8 --enable_cuda_profiling --build_java --cmake_extra_defines CMAKE_CUDA_ARCHITECTURES=90 onnxruntime_BUILD_UNIT_TESTS=ON onnxruntime_ENABLE_CUDA_EP_INTERNAL_TESTS=ON --update
2025-10-21 16:42:41,760 build [INFO] - Build started
2025-10-21 16:42:41,760 build [INFO] - Generating CMake build tree
2025-10-21 16:42:41,778 build [INFO] - /usr/bin/cmake /onnxruntime_src/cmake -Donnxruntime_ENABLE_EXTERNAL_CUSTOM_OP_SCHEMAS=OFF -Donnxruntime_RUN_ONNX_TESTS=ON -Donnxruntime_GENERATE_TEST_REPORTS=ON -DPython_EXECUTABLE=/opt/python/cp310-cp310/bin/python3 -Donnxruntime_USE_VCPKG=ON -Donnxruntime_USE_MIMALLOC=OFF -Donnxruntime_ENABLE_PYTHON=ON -Donnxruntime_BUILD_CSHARP=OFF -Donnxruntime_BUILD_JAVA=ON -Donnxruntime_BUILD_NODEJS=OFF -Donnxruntime_BUILD_OBJC=OFF -Donnxruntime_BUILD_SHARED_LIB=ON -Donnxruntime_BUILD_APPLE_FRAMEWORK=OFF -Donnxruntime_USE_DNNL=OFF -Donnxruntime_USE_NNAPI_BUILTIN=OFF -Donnxruntime_USE_VSINPU=OFF -Donnxruntime_USE_RKNPU=OFF -Donnxruntime_ENABLE_MICROSOFT_INTERNAL=OFF -Donnxruntime_USE_VITISAI=OFF -Donnxruntime_USE_TENSORRT=OFF -Donnxruntime_USE_NV=OFF -Donnxruntime_USE_TENSORRT_BUILTIN_PARSER=ON -Donnxruntime_USE_TENSORRT_INTERFACE=OFF -Donnxruntime_USE_CUDA_INTERFACE=OFF -Donnxruntime_USE_NV_INTERFACE=OFF -Donnxruntime_USE_OPENVINO_INTERFACE=OFF -Donnxruntime_USE_VITISAI_
|
Build Linux CUDA x64 Release / build_test_pipeline
stderr: #0 building with "default" instance using docker driver
#1 [internal] load build definition from Dockerfile.manylinux2_28_cuda
#1 transferring dockerfile: 1.91kB done
#1 DONE 0.1s
#2 [auth] internal/azureml/onnxruntime/build/cuda12_x64_almalinux8_gcc14:pull token for onnxruntimebuildcache.azurecr.io
#2 DONE 0.0s
#3 [internal] load metadata for onnxruntimebuildcache.azurecr.io/internal/azureml/onnxruntime/build/cuda12_x64_almalinux8_gcc14:20251017.1
#3 DONE 0.8s
#4 [internal] load .dockerignore
#4 transferring context: 2B done
#4 DONE 0.0s
#5 [internal] load build context
#5 DONE 0.0s
#6 [1/6] FROM onnxruntimebuildcache.azurecr.io/internal/azureml/onnxruntime/build/cuda12_x64_almalinux8_gcc14:20251017.1@sha256:f9faa2397d114b46b5c281353e2d50ccba0ffce77fde89753bedc07217f7eff2
#6 resolve onnxruntimebuildcache.azurecr.io/internal/azureml/onnxruntime/build/cuda12_x64_almalinux8_gcc14:20251017.1@sha256:f9faa2397d114b46b5c281353e2d50ccba0ffce77fde89753bedc07217f7eff2 0.1s done
#6 ...
#5 [internal] load build context
#5 transferring context: 32.11kB done
#5 DONE 0.2s
#6 [1/6] FROM onnxruntimebuildcache.azurecr.io/internal/azureml/onnxruntime/build/cuda12_x64_almalinux8_gcc14:20251017.1@sha256:f9faa2397d114b46b5c281353e2d50ccba0ffce77fde89753bedc07217f7eff2
#6 sha256:280e919120c7240e5d6cbce7ba54f263e0ce9ca9da22a223dcce8e4c38505041 0B / 742B 0.1s
#6 sha256:8a4684f9f44bcb04a432c59bef9b77c2aa66415af8f29d8f88377a62d9a8b5c9 7.53kB / 7.53kB done
#6 sha256:f9faa2397d114b46b5c281353e2d50ccba0ffce77fde89753bedc07217f7eff2 856B / 856B done
#6 sha256:722bd50a5a3dba3c560ea4be52692938a869437ddfb12fde54b83ca584e5fc86 34.18kB / 34.18kB done
#6 sha256:d7fbbb453e2be563bc646353df2b7286e129ed2b883580d9a8dc9f033e343282 0B / 71.82MB 0.1s
#6 sha256:280e919120c7240e5d6cbce7ba54f263e0ce9ca9da22a223dcce8e4c38505041 742B / 742B 0.3s done
#6 sha256:5c59c7fd50f93cb2fc77a2707a57ce7635278c0da263826011f57e7c70a6776d 0B / 192.09MB 0.2s
#6 sha256:7fe0b806fc088fc4b03f9cdd96355585d832b1ad4e385644b543f18997428c9f 0B / 302B 0.3s
#6 sha256:fce8d7613da682bd058d292ee000de2d586413bdbf616551738839795d669dbd 0B / 1.44kB 0.5s
#6 sha256:d7fbbb453e2be563bc646353df2b7286e129ed2b883580d9a8dc9f033e343282 4.19MB / 71.82MB 0.7s
#6 sha256:7fe0b806fc088fc4b03f9cdd96355585d832b1ad4e385644b543f18997428c9f 302B / 302B 0.5s done
#6 sha256:fce8d7613da682bd058d292ee000de2d586413bdbf616551738839795d669dbd 1.44kB / 1.44kB 0.7s done
#6 sha256:9ff6b18a5c54ca6df7cbfc248396026502361939d73570a154e7eedee8601a4c 0B / 75.92MB 0.7s
#6 sha256:d7fbbb453e2be563bc646353df2b7286e129ed2b883580d9a8dc9f033e343282 16.78MB / 71.82MB 1.0s
#6 sha256:5c59c7fd50f93cb2fc77a2707a57ce7635278c0da263826011f57e7c70a6776d 16.78MB / 192.09MB 1.0s
#6 sha256:d7fbbb453e2be563bc646353df2b7286e129ed2b883580d9a8dc9f033e343282 30.41MB / 71.82MB 1.2s
#6 sha256:5c59c7fd50f93cb2fc77a2707a57ce7635278c0da263826011f57e7c70a6776d 29.36MB / 192.09MB 1.2s
#6 sha256:d7fbbb453e2be563bc646353df2b7286e129ed2b883580d9a8dc9f033e343282 46.14MB / 71.82MB 1.4s
#6 sha256:5c59c7fd50f93cb2fc77a2707a57ce7635278c0da263826011f57e7c70a6776d 45.09MB / 192.09MB 1.4s
#6 sha256:9ff6b18a5c54ca6df7cbfc248396026502361939d73570a154e7eedee8601a4c 8.39MB / 75.92MB 1.4s
#6 sha256:d7fbbb453e2be563bc646353df2b7286e129ed2b883580d9a8dc9f033e343282 54.53MB / 71.82MB 1.6s
#6 sha256:9ff6b18a5c54ca6df7cbfc248396026502361939d73570a154e7eedee8601a4c 14.68MB / 75.92MB 1.6s
#6 sha256:d7fbbb453e2be563bc646353df2b7286e129ed2b883580d9a8dc9f033e343282 67.11MB / 71.82MB 1.7s
#6 sha256:5c59c7fd50f93cb2fc77a2707a57ce7635278c0da263826011f57e7c70a6776d 65.01MB / 192.09MB 1.7s
#6 sha256:9ff6b18a5c54ca6df7cbfc248396026502361939d73570a154e7eedee8601a4c 24.12MB / 75.92MB 1.7s
#6 sha256:d7fbbb453e2be563bc646353df2b7286e129ed2b883580d9a8dc9f033e343282 71.82MB / 71.82MB 1.9s
#6 sha256:5c59c7fd50f93cb2fc77a2707a57ce7635278c0da263826011f57e7c70a6776d 77.59MB / 192.09MB 1.9s
#6 sha256:9ff6b18a5c54ca6df7cbfc248396026502361939d73570a154e7eedee8601a4c 37.75MB / 75.92MB 1.9s
#6 sha256:9ff6b18a5c54ca6df7cbfc248396026502361939d73570a154e7eedee8601a4c 46.14MB / 75.92MB 2.0s
#6 sha256:
|
Build Linux CUDA x64 Release / build_test_pipeline
stderr: WARNING! Your credentials are stored unencrypted in '/home/cloudtest/.docker/config.json'.
Configure a credential helper to remove this warning. See
https://docs.docker.com/go/credential-store/
|
Test Linux CUDA x64 Release
stderr: + PATH=/opt/python/cp310-cp310/bin:/usr/local/dotnet:/opt/rh/gcc-toolset-14/root/usr/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/lib/jvm/msopenjdk-17/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+ python3 tools/ci_build/build.py --build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_cuda --use_binskim_compliant_compile_flags --cuda_version=12.8 --cuda_home=/usr/local/cuda-12.8 --cudnn_home=/usr/local/cuda-12.8 --enable_cuda_profiling --cmake_extra_defines CMAKE_CUDA_ARCHITECTURES=90 onnxruntime_BUILD_UNIT_TESTS=ON onnxruntime_ENABLE_CUDA_EP_INTERNAL_TESTS=ON --test
2025-10-21 17:31:29,842 tools_python_utils [INFO] - flatbuffers module is not installed. parse_config will not be available
2025-10-21 17:31:29,876 build [DEBUG] - Command line arguments:
--build_dir build/Release --config Release --cmake_generator Ninja --skip_submodule_sync --build_shared_lib --parallel --use_vcpkg --use_vcpkg_ms_internal_asset_cache --enable_onnx_tests --use_cuda --use_binskim_compliant_compile_flags --cuda_version=12.8 --cuda_home=/usr/local/cuda-12.8 --cudnn_home=/usr/local/cuda-12.8 --enable_cuda_profiling --cmake_extra_defines CMAKE_CUDA_ARCHITECTURES=90 onnxruntime_BUILD_UNIT_TESTS=ON onnxruntime_ENABLE_CUDA_EP_INTERNAL_TESTS=ON --test
2025-10-21 17:31:29,880 build [INFO] - Build started
2025-10-21 17:31:29,880 build [DEBUG] - create symlink /data/models -> build/Release/models
2025-10-21 17:31:29,880 build [INFO] - Running tests for Release configuration
2025-10-21 17:31:29,880 build [INFO] - /usr/bin/ctest --build-config Release --verbose --timeout 10800
2025-10-21 17:42:36,588 build [INFO] - Build complete
|
Test Linux CUDA x64 Release
stderr: WARNING! Your credentials are stored unencrypted in '/home/cloudtest/.docker/config.json'.
Configure a credential helper to remove this warning. See
https://docs.docker.com/go/credential-store/
|
Artifacts
Produced during runtime
Name | Size | Digest | |
---|---|---|---|
build-output-x64-Release
|
1.15 GB |
sha256:5b5e9c84272efd4b58e6f7bfaaa94f6d1ac1a33b2c2da67016f9e6fbdd02f94c
|
|