[RISC-V] Increase timeouts in CustomConverterTests #108879

yurai007 · 2024-10-15T09:55:40Z

This patch fixes System.Text.Json.Serialization.Tests.CustomConverterTests on Debug build.

Part of #84834
cc @dotnet/samsung

This patch fixes System.Text.Json.Serialization.Tests.CustomConverterTests on Debug build.

dotnet-policy-service · 2024-10-15T09:56:12Z

Tagging subscribers to this area: @dotnet/area-system-text-json, @gregsdennis
See info in area-owners.md if you want to be subscribed.

risc-vv · 2024-10-15T10:01:02Z

RISC-V Release-CLR-VF2: 9419 / 9439 (99.79%)

=======================
      passed: 9419
      failed: 3
     skipped: 107
      killed: 17
------------------------
  TOTAL libs: 9546
 TOTAL tests: 9546
   REAL time: 3h 0min 45s 87ms
=======================

Release-CLR-VF2.md, Release-CLR-VF2.xml, testclr_output.tar.gz

RISC-V Release-FX-VF2: 569483 / 611129 (93.19%)

=======================
      passed: 569483
      failed: 15
     skipped: 1466
      killed: 41631
------------------------
  TOTAL libs: 257
 TOTAL tests: 612595
   REAL time: 2h 31min 33s 359ms
=======================

Release-FX-VF2.md, Release-FX-VF2.xml, testfx_output.tar.gz

Build information and commands

GIT: 71892ea0cf288b5ab11937ac5c2fdc31010168ff
CI: c7fa7b3fb1ac2f82b97f2b3fba8ce3376ca76561
REPO: dotnet/runtime
BRANCH: main
CONFIG: Release
LIB_CONFIG: Release

# CORE_LIBS_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -s libs /p:EnableSourceLink=false
# CORE_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -s clr+libs+host /p:EnableSourceLink=false

# TESTCLR_BUILD_CMD
runtime/src/tests/build.sh -riscv64 -cross -Release -priority1 -p:UsePublishedCrossgen2=false -p:UseLocalAppHostPack=true
# TESTCLR_CMD
python3 riscv-CI/goci/agent/TestRunner/run.py --core_root ./coreclr.Release/Tests/Core_Root --testhost ./testhost.Release --atest ./coreclr.Release --test ./ --log_dir ./logs  --timeout 2700 --log_level DEBUG --xunit xunit.Release
# TESTCLR_RUN
/var/lib/go-agent/pipelines/Release-CLR-VF2/logs/run_tests.log
cp -R /var/lib/go-agent/pipelines/Release-CLR-VF2/xunit.Release "/_PATH_/_WITH_/_TEST_"/ ; cd "/_PATH_/_WITH_/_TEST_" && __TestDotNetCmd=/var/lib/go-agent/pipelines/Release-CLR-VF2/testhost.Release/dotnet CORE_ROOT=/var/lib/go-agent/pipelines/Release-CLR-VF2/coreclr.Release/Tests/Core_Root  /usr/bin/time -f "exec_time: %e" ./_TEST_BINARY_

# TESTFX_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -rc Release -hc Release -lc Release -s libs.tests --testscope innerloop /p:EnableSourceLink=false /p:UseLocalAppHostPack=true
# TESTFX_CMD
python3 riscv-CI/goci/agent/TestRunner/run.py --corefx --testhost ./testhost.Release --atest ./corefx.Release --log_dir ./logs  --timeout 6000 --memlimit 4096 --jobs 8 --log_level DEBUG --xunit xunit.Release
# TESTFX_RUN
/var/lib/go-agent/pipelines/Release-FX-VF2/logs/run_tests.log
cp -R /var/lib/go-agent/pipelines/Release-FX-VF2/xunit.Release "/_PATH_/_WITH_/_TEST_"/ ; cd "/_PATH_/_WITH_/_TEST_" && __TestDotNetCmd=/var/lib/go-agent/pipelines/Release-FX-VF2/testhost.Release/dotnet  /usr/bin/time -f "exec_time: %e" /var/lib/go-agent/pipelines/Release-FX-VF2/testhost.Release/dotnet exec   xunit.console.dll _TEST_BINARY_ -nologo -nocolor -notrait category=failing

# TEST_ENV
DOTNET_JitStress=;DOTNET_JitStressRegs=;DOTNET_GCStress=;DOTNET_JITMinOpts=;DOTNET_TailcallStress=;DOTNET_TieredCompilation=

RISC-V Release-CLR-QEMU: 9419 / 9439 (99.79%)

=======================
      passed: 9419
      failed: 3
     skipped: 107
      killed: 17
------------------------
  TOTAL libs: 9546
 TOTAL tests: 9546
   REAL time: 57min 57s 282ms
=======================

Release-CLR-QEMU.md, Release-CLR-QEMU.xml, testclr_output.tar.gz

RISC-V Release-FX-QEMU: 580866 / 617147 (94.12%)

=======================
      passed: 580866
      failed: 228
     skipped: 1582
      killed: 36053
------------------------
  TOTAL libs: 257
 TOTAL tests: 618729
   REAL time: 2h 21min 51s 752ms
=======================

Release-FX-QEMU.md, Release-FX-QEMU.xml, testfx_output.tar.gz

Build information and commands

GIT: 71892ea0cf288b5ab11937ac5c2fdc31010168ff
CI: c7fa7b3fb1ac2f82b97f2b3fba8ce3376ca76561
REPO: dotnet/runtime
BRANCH: main
CONFIG: Release
LIB_CONFIG: Release

# CORE_LIBS_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -s libs /p:EnableSourceLink=false
# CORE_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -s clr+libs+host /p:EnableSourceLink=false

# TESTCLR_BUILD_CMD
runtime/src/tests/build.sh -riscv64 -cross -Release -priority1 -p:UsePublishedCrossgen2=false -p:UseLocalAppHostPack=true
# TESTCLR_CMD
python3 riscv-CI/goci/agent/TestRunner/run.py --core_root ./coreclr.Release/Tests/Core_Root --testhost ./testhost.Release --atest ./coreclr.Release --test ./ --log_dir ./logs  --timeout 2700 --log_level DEBUG --xunit xunit.Release
# TESTCLR_RUN
/godata/pipelines/Release-CLR-QEMU/logs/run_tests.log
cp -R /godata/pipelines/Release-CLR-QEMU/xunit.Release "/_PATH_/_WITH_/_TEST_"/ ; cd "/_PATH_/_WITH_/_TEST_" && ROOTFS_DIR=/crossrootfs/riscv64 QEMU_LD_PREFIX=/crossrootfs/riscv64 __TestDotNetCmd=/godata/pipelines/Release-CLR-QEMU/testhost.Release/dotnet CORE_ROOT=/godata/pipelines/Release-CLR-QEMU/coreclr.Release/Tests/Core_Root  /usr/bin/time -f "exec_time: %e" ./_TEST_BINARY_

# TESTFX_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -rc Release -hc Release -lc Release -s libs.tests --testscope innerloop /p:EnableSourceLink=false /p:UseLocalAppHostPack=true
# TESTFX_CMD
python3 riscv-CI/goci/agent/TestRunner/run.py --corefx --testhost ./testhost.Release --atest ./corefx.Release --log_dir ./logs  --timeout 6000 --memlimit 4096 --jobs 16 --log_level DEBUG --xunit xunit.Release
# TESTFX_RUN
/godata/pipelines/Release-FX-QEMU/logs/run_tests.log
cp -R /godata/pipelines/Release-FX-QEMU/xunit.Release "/_PATH_/_WITH_/_TEST_"/ ; cd "/_PATH_/_WITH_/_TEST_" && ROOTFS_DIR=/crossrootfs/riscv64 QEMU_LD_PREFIX=/crossrootfs/riscv64 __TestDotNetCmd=/godata/pipelines/Release-FX-QEMU/testhost.Release/dotnet  /usr/bin/time -f "exec_time: %e" /godata/pipelines/Release-FX-QEMU/testhost.Release/dotnet exec   xunit.console.dll _TEST_BINARY_ -nologo -nocolor -notrait category=failing

# TEST_ENV
DOTNET_JitStress=;DOTNET_JitStressRegs=;DOTNET_GCStress=;DOTNET_JITMinOpts=;DOTNET_TailcallStress=;DOTNET_TieredCompilation=

RISC-V Release-CLR-QEMU: 9419 / 9439 (99.79%)

=======================
      passed: 9419
      failed: 3
     skipped: 107
      killed: 17
------------------------
  TOTAL libs: 9546
 TOTAL tests: 9546
   REAL time: 57min 57s 121ms
=======================

Release-CLR-QEMU.md, Release-CLR-QEMU.xml, testclr_output.tar.gz

RISC-V Release-FX-QEMU: 580866 / 617147 (94.12%)

=======================
      passed: 580866
      failed: 228
     skipped: 1582
      killed: 36053
------------------------
  TOTAL libs: 257
 TOTAL tests: 618729
   REAL time: 2h 21min 51s 752ms
=======================

Release-FX-QEMU.md, Release-FX-QEMU.xml, testfx_output.tar.gz

Build information and commands

GIT: 71892ea0cf288b5ab11937ac5c2fdc31010168ff
CI: c7fa7b3fb1ac2f82b97f2b3fba8ce3376ca76561
REPO: dotnet/runtime
BRANCH: main
CONFIG: Release
LIB_CONFIG: Release

# CORE_LIBS_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -s libs /p:EnableSourceLink=false
# CORE_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -s clr+libs+host /p:EnableSourceLink=false

# TESTCLR_BUILD_CMD
runtime/src/tests/build.sh -riscv64 -cross -Release -priority1 -p:UsePublishedCrossgen2=false -p:UseLocalAppHostPack=true
# TESTCLR_CMD
python3 riscv-CI/goci/agent/TestRunner/run.py --core_root ./coreclr.Release/Tests/Core_Root --testhost ./testhost.Release --atest ./coreclr.Release --test ./ --log_dir ./logs  --timeout 2700 --log_level DEBUG --xunit xunit.Release
# TESTCLR_RUN
/godata/pipelines/Release-CLR-QEMU/logs/run_tests.log
cp -R /godata/pipelines/Release-CLR-QEMU/xunit.Release "/_PATH_/_WITH_/_TEST_"/ ; cd "/_PATH_/_WITH_/_TEST_" && ROOTFS_DIR=/crossrootfs/riscv64 QEMU_LD_PREFIX=/crossrootfs/riscv64 __TestDotNetCmd=/godata/pipelines/Release-CLR-QEMU/testhost.Release/dotnet CORE_ROOT=/godata/pipelines/Release-CLR-QEMU/coreclr.Release/Tests/Core_Root  /usr/bin/time -f "exec_time: %e" ./_TEST_BINARY_

# TESTFX_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -rc Release -hc Release -lc Release -s libs.tests --testscope innerloop /p:EnableSourceLink=false /p:UseLocalAppHostPack=true
# TESTFX_CMD
python3 riscv-CI/goci/agent/TestRunner/run.py --corefx --testhost ./testhost.Release --atest ./corefx.Release --log_dir ./logs  --timeout 6000 --memlimit 4096 --jobs 16 --log_level DEBUG --xunit xunit.Release
# TESTFX_RUN
/godata/pipelines/Release-FX-QEMU/logs/run_tests.log
cp -R /godata/pipelines/Release-FX-QEMU/xunit.Release "/_PATH_/_WITH_/_TEST_"/ ; cd "/_PATH_/_WITH_/_TEST_" && ROOTFS_DIR=/crossrootfs/riscv64 QEMU_LD_PREFIX=/crossrootfs/riscv64 __TestDotNetCmd=/godata/pipelines/Release-FX-QEMU/testhost.Release/dotnet  /usr/bin/time -f "exec_time: %e" /godata/pipelines/Release-FX-QEMU/testhost.Release/dotnet exec   xunit.console.dll _TEST_BINARY_ -nologo -nocolor -notrait category=failing

# TEST_ENV
DOTNET_JitStress=;DOTNET_JitStressRegs=;DOTNET_GCStress=;DOTNET_JITMinOpts=;DOTNET_TailcallStress=;DOTNET_TieredCompilation=

RISC-V Release-CLR-VF2: 9419 / 9439 (99.79%)

=======================
      passed: 9419
      failed: 3
     skipped: 107
      killed: 17
------------------------
  TOTAL libs: 9546
 TOTAL tests: 9546
   REAL time: 3h 0min 7s 874ms
=======================

Release-CLR-VF2.md, Release-CLR-VF2.xml, testclr_output.tar.gz

RISC-V Release-FX-VF2: 569483 / 611129 (93.19%)

=======================
      passed: 569483
      failed: 15
     skipped: 1466
      killed: 41631
------------------------
  TOTAL libs: 257
 TOTAL tests: 612595
   REAL time: 2h 31min 33s 359ms
=======================

Release-FX-VF2.md, Release-FX-VF2.xml, testfx_output.tar.gz

Build information and commands

GIT: 71892ea0cf288b5ab11937ac5c2fdc31010168ff
CI: c7fa7b3fb1ac2f82b97f2b3fba8ce3376ca76561
REPO: dotnet/runtime
BRANCH: main
CONFIG: Release
LIB_CONFIG: Release

# CORE_LIBS_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -s libs /p:EnableSourceLink=false
# CORE_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -s clr+libs+host /p:EnableSourceLink=false

# TESTCLR_BUILD_CMD
runtime/src/tests/build.sh -riscv64 -cross -Release -priority1 -p:UsePublishedCrossgen2=false -p:UseLocalAppHostPack=true
# TESTCLR_CMD
python3 riscv-CI/goci/agent/TestRunner/run.py --core_root ./coreclr.Release/Tests/Core_Root --testhost ./testhost.Release --atest ./coreclr.Release --test ./ --log_dir ./logs  --timeout 2700 --log_level DEBUG --xunit xunit.Release
# TESTCLR_RUN
/var/lib/go-agent/pipelines/Release-CLR-VF2/logs/run_tests.log
cp -R /var/lib/go-agent/pipelines/Release-CLR-VF2/xunit.Release "/_PATH_/_WITH_/_TEST_"/ ; cd "/_PATH_/_WITH_/_TEST_" && __TestDotNetCmd=/var/lib/go-agent/pipelines/Release-CLR-VF2/testhost.Release/dotnet CORE_ROOT=/var/lib/go-agent/pipelines/Release-CLR-VF2/coreclr.Release/Tests/Core_Root  /usr/bin/time -f "exec_time: %e" ./_TEST_BINARY_

# TESTFX_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -rc Release -hc Release -lc Release -s libs.tests --testscope innerloop /p:EnableSourceLink=false /p:UseLocalAppHostPack=true
# TESTFX_CMD
python3 riscv-CI/goci/agent/TestRunner/run.py --corefx --testhost ./testhost.Release --atest ./corefx.Release --log_dir ./logs  --timeout 6000 --memlimit 4096 --jobs 8 --log_level DEBUG --xunit xunit.Release
# TESTFX_RUN
/var/lib/go-agent/pipelines/Release-FX-VF2/logs/run_tests.log
cp -R /var/lib/go-agent/pipelines/Release-FX-VF2/xunit.Release "/_PATH_/_WITH_/_TEST_"/ ; cd "/_PATH_/_WITH_/_TEST_" && __TestDotNetCmd=/var/lib/go-agent/pipelines/Release-FX-VF2/testhost.Release/dotnet  /usr/bin/time -f "exec_time: %e" /var/lib/go-agent/pipelines/Release-FX-VF2/testhost.Release/dotnet exec   xunit.console.dll _TEST_BINARY_ -nologo -nocolor -notrait category=failing

# TEST_ENV
DOTNET_JitStress=;DOTNET_JitStressRegs=;DOTNET_GCStress=;DOTNET_JITMinOpts=;DOTNET_TailcallStress=;DOTNET_TieredCompilation=

risc-vv · 2024-10-15T10:31:06Z

RISC-V Release-CLR-VF2: 9419 / 9439 (99.79%)

=======================
      passed: 9419
      failed: 3
     skipped: 107
      killed: 17
------------------------
  TOTAL libs: 9546
 TOTAL tests: 9546
   REAL time: 3h 0min 7s 874ms
=======================

Release-CLR-VF2.md, Release-CLR-VF2.xml, testclr_output.tar.gz

RISC-V Release-FX-VF2: 576536 / 613833 (93.92%)

=======================
      passed: 576536
      failed: 24
     skipped: 1466
      killed: 37273
------------------------
  TOTAL libs: 257
 TOTAL tests: 615299
   REAL time: 2h 21min 28s 761ms
=======================

Release-FX-VF2.md, Release-FX-VF2.xml, testfx_output.tar.gz

Build information and commands

GIT: cef4dbac8939a44def6ba29c9effe534fecd8e1d
CI: c7fa7b3fb1ac2f82b97f2b3fba8ce3376ca76561
REPO: dotnet/runtime
BRANCH: main
CONFIG: Release
LIB_CONFIG: Release

# CORE_LIBS_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -s libs /p:EnableSourceLink=false
# CORE_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -s clr+libs+host /p:EnableSourceLink=false

# TESTCLR_BUILD_CMD
runtime/src/tests/build.sh -riscv64 -cross -Release -priority1 -p:UsePublishedCrossgen2=false -p:UseLocalAppHostPack=true
# TESTCLR_CMD
python3 riscv-CI/goci/agent/TestRunner/run.py --core_root ./coreclr.Release/Tests/Core_Root --testhost ./testhost.Release --atest ./coreclr.Release --test ./ --log_dir ./logs  --timeout 2700 --log_level DEBUG --xunit xunit.Release
# TESTCLR_RUN
/var/lib/go-agent/pipelines/Release-CLR-VF2/logs/run_tests.log
cp -R /var/lib/go-agent/pipelines/Release-CLR-VF2/xunit.Release "/_PATH_/_WITH_/_TEST_"/ ; cd "/_PATH_/_WITH_/_TEST_" && __TestDotNetCmd=/var/lib/go-agent/pipelines/Release-CLR-VF2/testhost.Release/dotnet CORE_ROOT=/var/lib/go-agent/pipelines/Release-CLR-VF2/coreclr.Release/Tests/Core_Root  /usr/bin/time -f "exec_time: %e" ./_TEST_BINARY_

# TESTFX_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -rc Release -hc Release -lc Release -s libs.tests --testscope innerloop /p:EnableSourceLink=false /p:UseLocalAppHostPack=true
# TESTFX_CMD
python3 riscv-CI/goci/agent/TestRunner/run.py --corefx --testhost ./testhost.Release --atest ./corefx.Release --log_dir ./logs  --timeout 6000 --memlimit 4096 --jobs 8 --log_level DEBUG --xunit xunit.Release
# TESTFX_RUN
/var/lib/go-agent/pipelines/Release-FX-VF2/logs/run_tests.log
cp -R /var/lib/go-agent/pipelines/Release-FX-VF2/xunit.Release "/_PATH_/_WITH_/_TEST_"/ ; cd "/_PATH_/_WITH_/_TEST_" && __TestDotNetCmd=/var/lib/go-agent/pipelines/Release-FX-VF2/testhost.Release/dotnet  /usr/bin/time -f "exec_time: %e" /var/lib/go-agent/pipelines/Release-FX-VF2/testhost.Release/dotnet exec   xunit.console.dll _TEST_BINARY_ -nologo -nocolor -notrait category=failing

# TEST_ENV
DOTNET_JitStress=;DOTNET_JitStressRegs=;DOTNET_GCStress=;DOTNET_JITMinOpts=;DOTNET_TailcallStress=;DOTNET_TieredCompilation=

RISC-V Release-CLR-QEMU: 9419 / 9439 (99.79%)

=======================
      passed: 9419
      failed: 3
     skipped: 107
      killed: 17
------------------------
  TOTAL libs: 9546
 TOTAL tests: 9546
   REAL time: 57min 57s 121ms
=======================

Release-CLR-QEMU.md, Release-CLR-QEMU.xml, testclr_output.tar.gz

RISC-V Release-FX-QEMU: 574303 / 606989 (94.62%)

=======================
      passed: 574303
      failed: 223
     skipped: 1391
      killed: 32463
------------------------
  TOTAL libs: 257
 TOTAL tests: 608380
   REAL time: 2h 23min 37s 502ms
=======================

Release-FX-QEMU.md, Release-FX-QEMU.xml, testfx_output.tar.gz

Build information and commands

GIT: cef4dbac8939a44def6ba29c9effe534fecd8e1d
CI: c7fa7b3fb1ac2f82b97f2b3fba8ce3376ca76561
REPO: dotnet/runtime
BRANCH: main
CONFIG: Release
LIB_CONFIG: Release

# CORE_LIBS_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -s libs /p:EnableSourceLink=false
# CORE_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -s clr+libs+host /p:EnableSourceLink=false

# TESTCLR_BUILD_CMD
runtime/src/tests/build.sh -riscv64 -cross -Release -priority1 -p:UsePublishedCrossgen2=false -p:UseLocalAppHostPack=true
# TESTCLR_CMD
python3 riscv-CI/goci/agent/TestRunner/run.py --core_root ./coreclr.Release/Tests/Core_Root --testhost ./testhost.Release --atest ./coreclr.Release --test ./ --log_dir ./logs  --timeout 2700 --log_level DEBUG --xunit xunit.Release
# TESTCLR_RUN
/godata/pipelines/Release-CLR-QEMU/logs/run_tests.log
cp -R /godata/pipelines/Release-CLR-QEMU/xunit.Release "/_PATH_/_WITH_/_TEST_"/ ; cd "/_PATH_/_WITH_/_TEST_" && ROOTFS_DIR=/crossrootfs/riscv64 QEMU_LD_PREFIX=/crossrootfs/riscv64 __TestDotNetCmd=/godata/pipelines/Release-CLR-QEMU/testhost.Release/dotnet CORE_ROOT=/godata/pipelines/Release-CLR-QEMU/coreclr.Release/Tests/Core_Root  /usr/bin/time -f "exec_time: %e" ./_TEST_BINARY_

# TESTFX_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -rc Release -hc Release -lc Release -s libs.tests --testscope innerloop /p:EnableSourceLink=false /p:UseLocalAppHostPack=true
# TESTFX_CMD
python3 riscv-CI/goci/agent/TestRunner/run.py --corefx --testhost ./testhost.Release --atest ./corefx.Release --log_dir ./logs  --timeout 6000 --memlimit 4096 --jobs 16 --log_level DEBUG --xunit xunit.Release
# TESTFX_RUN
/godata/pipelines/Release-FX-QEMU/logs/run_tests.log
cp -R /godata/pipelines/Release-FX-QEMU/xunit.Release "/_PATH_/_WITH_/_TEST_"/ ; cd "/_PATH_/_WITH_/_TEST_" && ROOTFS_DIR=/crossrootfs/riscv64 QEMU_LD_PREFIX=/crossrootfs/riscv64 __TestDotNetCmd=/godata/pipelines/Release-FX-QEMU/testhost.Release/dotnet  /usr/bin/time -f "exec_time: %e" /godata/pipelines/Release-FX-QEMU/testhost.Release/dotnet exec   xunit.console.dll _TEST_BINARY_ -nologo -nocolor -notrait category=failing

# TEST_ENV
DOTNET_JitStress=;DOTNET_JitStressRegs=;DOTNET_GCStress=;DOTNET_JITMinOpts=;DOTNET_TailcallStress=;DOTNET_TieredCompilation=

risc-vv · 2024-10-28T11:45:58Z

RISC-V Release-CLR-QEMU: 9419 / 9440 (99.78%)

=======================
      passed: 9419
      failed: 4
     skipped: 107
      killed: 17
------------------------
  TOTAL libs: 9547
 TOTAL tests: 9547
   REAL time: 57min 56s 504ms
=======================

Release-CLR-QEMU.md, Release-CLR-QEMU.xml, testclr_output.tar.gz

RISC-V Release-FX-QEMU: 568853 / 597602 (95.19%)

=======================
      passed: 568853
      failed: 1086
     skipped: 1573
      killed: 27663
------------------------
  TOTAL libs: 257
 TOTAL tests: 599175
   REAL time: 2h 25min 55s 463ms
=======================

Release-FX-QEMU.md, Release-FX-QEMU.xml, testfx_output.tar.gz

Build information and commands

GIT: d9ff79b778978486fd042f8897c9c7e0bcf6fe21
CI: 588c31b6ba31e6551a37bfcc7a0421b734da4141
REPO: dotnet/runtime
BRANCH: main
CONFIG: Release
LIB_CONFIG: Release

# CORE_LIBS_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -s libs /p:EnableSourceLink=false
# CORE_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -s clr+libs+host /p:EnableSourceLink=false

# TESTCLR_BUILD_CMD
runtime/src/tests/build.sh -riscv64 -cross -Release -priority1 -p:UsePublishedCrossgen2=false -p:UseLocalAppHostPack=true
# TESTCLR_CMD
python3 riscv-CI/goci/agent/TestRunner/run.py --core_root ./coreclr.Release/Tests/Core_Root --testhost ./testhost.Release --atest ./coreclr.Release --test ./ --log_dir ./logs  --timeout 2700 --log_level DEBUG --xunit xunit.Release
# TESTCLR_RUN
/godata/pipelines/Release-CLR-QEMU/logs/run_tests.log
cp -R /godata/pipelines/Release-CLR-QEMU/xunit.Release "/_PATH_/_WITH_/_TEST_"/ ; cd "/_PATH_/_WITH_/_TEST_" && ROOTFS_DIR=/crossrootfs/riscv64 QEMU_LD_PREFIX=/crossrootfs/riscv64 __TestDotNetCmd=/godata/pipelines/Release-CLR-QEMU/testhost.Release/dotnet CORE_ROOT=/godata/pipelines/Release-CLR-QEMU/coreclr.Release/Tests/Core_Root  /usr/bin/time -f "exec_time: %e" ./_TEST_BINARY_

# TESTFX_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -rc Release -hc Release -lc Release -s libs.tests --testscope innerloop /p:EnableSourceLink=false /p:UseLocalAppHostPack=true
# TESTFX_CMD
unknown command
# TESTFX_RUN
unknown command

# TEST_ENV
DOTNET_JitStress=;DOTNET_JitStressRegs=;DOTNET_GCStress=;DOTNET_JITMinOpts=;DOTNET_TailcallStress=;DOTNET_TieredCompilation=

RISC-V Release-CLR-QEMU: 9419 / 9440 (99.78%)

=======================
      passed: 9419
      failed: 4
     skipped: 107
      killed: 17
------------------------
  TOTAL libs: 9547
 TOTAL tests: 9547
   REAL time: 57min 56s 170ms
=======================

Release-CLR-QEMU.md, Release-CLR-QEMU.xml, testclr_output.tar.gz

RISC-V Release-FX-QEMU: 568853 / 597602 (95.19%)

=======================
      passed: 568853
      failed: 1086
     skipped: 1573
      killed: 27663
------------------------
  TOTAL libs: 257
 TOTAL tests: 599175
   REAL time: 2h 25min 55s 463ms
=======================

Release-FX-QEMU.md, Release-FX-QEMU.xml, testfx_output.tar.gz

Build information and commands

GIT: d9ff79b778978486fd042f8897c9c7e0bcf6fe21
CI: 588c31b6ba31e6551a37bfcc7a0421b734da4141
REPO: dotnet/runtime
BRANCH: main
CONFIG: Release
LIB_CONFIG: Release

# CORE_LIBS_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -s libs /p:EnableSourceLink=false
# CORE_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -s clr+libs+host /p:EnableSourceLink=false

# TESTCLR_BUILD_CMD
runtime/src/tests/build.sh -riscv64 -cross -Release -priority1 -p:UsePublishedCrossgen2=false -p:UseLocalAppHostPack=true
# TESTCLR_CMD
python3 riscv-CI/goci/agent/TestRunner/run.py --core_root ./coreclr.Release/Tests/Core_Root --testhost ./testhost.Release --atest ./coreclr.Release --test ./ --log_dir ./logs  --timeout 2700 --log_level DEBUG --xunit xunit.Release
# TESTCLR_RUN
/godata/pipelines/Release-CLR-QEMU/logs/run_tests.log
cp -R /godata/pipelines/Release-CLR-QEMU/xunit.Release "/_PATH_/_WITH_/_TEST_"/ ; cd "/_PATH_/_WITH_/_TEST_" && ROOTFS_DIR=/crossrootfs/riscv64 QEMU_LD_PREFIX=/crossrootfs/riscv64 __TestDotNetCmd=/godata/pipelines/Release-CLR-QEMU/testhost.Release/dotnet CORE_ROOT=/godata/pipelines/Release-CLR-QEMU/coreclr.Release/Tests/Core_Root  /usr/bin/time -f "exec_time: %e" ./_TEST_BINARY_

# TESTFX_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -rc Release -hc Release -lc Release -s libs.tests --testscope innerloop /p:EnableSourceLink=false /p:UseLocalAppHostPack=true
# TESTFX_CMD
unknown command
# TESTFX_RUN
unknown command

# TEST_ENV
DOTNET_JitStress=;DOTNET_JitStressRegs=;DOTNET_GCStress=;DOTNET_JITMinOpts=;DOTNET_TailcallStress=;DOTNET_TieredCompilation=

RISC-V Release-CLR-VF2: 9419 / 9440 (99.78%)

=======================
      passed: 9419
      failed: 4
     skipped: 107
      killed: 17
------------------------
  TOTAL libs: 9547
 TOTAL tests: 9547
   REAL time: 3h 3min 0s 234ms
=======================

Release-CLR-VF2.md, Release-CLR-VF2.xml, testclr_output.tar.gz

RISC-V Release-FX-VF2: 570769 / 615029 (92.80%)

=======================
      passed: 570769
      failed: 870
     skipped: 1470
      killed: 43390
------------------------
  TOTAL libs: 257
 TOTAL tests: 616499
   REAL time: 2h 17min 16s 368ms
=======================

Release-FX-VF2.md, Release-FX-VF2.xml, testfx_output.tar.gz

Build information and commands

GIT: d9ff79b778978486fd042f8897c9c7e0bcf6fe21
CI: 588c31b6ba31e6551a37bfcc7a0421b734da4141
REPO: dotnet/runtime
BRANCH: main
CONFIG: Release
LIB_CONFIG: Release

# CORE_LIBS_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -s libs /p:EnableSourceLink=false
# CORE_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -s clr+libs+host /p:EnableSourceLink=false

# TESTCLR_BUILD_CMD
runtime/src/tests/build.sh -riscv64 -cross -Release -priority1 -p:UsePublishedCrossgen2=false -p:UseLocalAppHostPack=true
# TESTCLR_CMD
python3 riscv-CI/goci/agent/TestRunner/run.py --core_root ./coreclr.Release/Tests/Core_Root --testhost ./testhost.Release --atest ./coreclr.Release --test ./ --log_dir ./logs  --timeout 2700 --log_level DEBUG --xunit xunit.Release
# TESTCLR_RUN
/var/lib/go-agent/pipelines/Release-CLR-VF2/logs/run_tests.log
cp -R /var/lib/go-agent/pipelines/Release-CLR-VF2/xunit.Release "/_PATH_/_WITH_/_TEST_"/ ; cd "/_PATH_/_WITH_/_TEST_" && __TestDotNetCmd=/var/lib/go-agent/pipelines/Release-CLR-VF2/testhost.Release/dotnet CORE_ROOT=/var/lib/go-agent/pipelines/Release-CLR-VF2/coreclr.Release/Tests/Core_Root  /usr/bin/time -f "exec_time: %e" ./_TEST_BINARY_

# TESTFX_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -rc Release -hc Release -lc Release -s libs.tests --testscope innerloop /p:EnableSourceLink=false /p:UseLocalAppHostPack=true
# TESTFX_CMD
unknown command
# TESTFX_RUN
unknown command

# TEST_ENV
DOTNET_JitStress=;DOTNET_JitStressRegs=;DOTNET_GCStress=;DOTNET_JITMinOpts=;DOTNET_TailcallStress=;DOTNET_TieredCompilation=

RISC-V Release-CLR-VF2: 9419 / 9440 (99.78%)

=======================
      passed: 9419
      failed: 4
     skipped: 107
      killed: 17
------------------------
  TOTAL libs: 9547
 TOTAL tests: 9547
   REAL time: 3h 3min 32s 501ms
=======================

Release-CLR-VF2.md, Release-CLR-VF2.xml, testclr_output.tar.gz

RISC-V Release-FX-VF2: 570769 / 615029 (92.80%)

=======================
      passed: 570769
      failed: 870
     skipped: 1470
      killed: 43390
------------------------
  TOTAL libs: 257
 TOTAL tests: 616499
   REAL time: 2h 17min 16s 368ms
=======================

Release-FX-VF2.md, Release-FX-VF2.xml, testfx_output.tar.gz

Build information and commands

GIT: d9ff79b778978486fd042f8897c9c7e0bcf6fe21
CI: 588c31b6ba31e6551a37bfcc7a0421b734da4141
REPO: dotnet/runtime
BRANCH: main
CONFIG: Release
LIB_CONFIG: Release

# CORE_LIBS_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -s libs /p:EnableSourceLink=false
# CORE_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -s clr+libs+host /p:EnableSourceLink=false

# TESTCLR_BUILD_CMD
runtime/src/tests/build.sh -riscv64 -cross -Release -priority1 -p:UsePublishedCrossgen2=false -p:UseLocalAppHostPack=true
# TESTCLR_CMD
python3 riscv-CI/goci/agent/TestRunner/run.py --core_root ./coreclr.Release/Tests/Core_Root --testhost ./testhost.Release --atest ./coreclr.Release --test ./ --log_dir ./logs  --timeout 2700 --log_level DEBUG --xunit xunit.Release
# TESTCLR_RUN
/var/lib/go-agent/pipelines/Release-CLR-VF2/logs/run_tests.log
cp -R /var/lib/go-agent/pipelines/Release-CLR-VF2/xunit.Release "/_PATH_/_WITH_/_TEST_"/ ; cd "/_PATH_/_WITH_/_TEST_" && __TestDotNetCmd=/var/lib/go-agent/pipelines/Release-CLR-VF2/testhost.Release/dotnet CORE_ROOT=/var/lib/go-agent/pipelines/Release-CLR-VF2/coreclr.Release/Tests/Core_Root  /usr/bin/time -f "exec_time: %e" ./_TEST_BINARY_

# TESTFX_BUILD_CMD
runtime/build.sh --arch riscv64 --cross -c Release -rc Release -hc Release -lc Release -s libs.tests --testscope innerloop /p:EnableSourceLink=false /p:UseLocalAppHostPack=true
# TESTFX_CMD
unknown command
# TESTFX_RUN
unknown command

# TEST_ENV
DOTNET_JitStress=;DOTNET_JitStressRegs=;DOTNET_GCStress=;DOTNET_JITMinOpts=;DOTNET_TailcallStress=;DOTNET_TieredCompilation=

yurai007 · 2024-10-28T15:03:04Z

@jkotas: Could you please take a look on this PR?

jkotas · 2024-10-28T15:17:38Z

What makes this test too slow? The test does very little

jkotas · 2024-10-28T15:19:40Z

Can we also delete [ActiveIssue("https://github.com/dotnet/runtime/issues/66371", typeof(PlatformDetection), nameof(PlatformDetection.IsMonoInterpreter))] that was working around the test being too slow?

yurai007 · 2024-10-28T19:15:09Z

What makes this test too slow? The test does very little

If I remember correctly it's about JsonSerializer.Serialize call that consume lot of cycles on Debug build. I can provide much more details on Wednesday (I'm off tomorrow) if you want.

yurai007 · 2024-10-30T13:53:08Z

If I remember correctly it's about JsonSerializer.Serialize call that consume lot of cycles on Debug build. I can provide much more details on Wednesday (I'm off tomorrow) if you want.

Ok, so I double checked this and actually I remembered wrong :( It turns out that although JsonSerializer.Serialize is slow (9s), execution time is dominated by RemoteExecutor.Invoke that takes ~30s. Original timeout was set to 60s.
The root cause is similar like in the problem addressed in the past by #96187. It seems that overhead from corerun startup is still significant in Debug mode even with crossgened SPC.dll.

jkotas · 2024-10-30T14:20:50Z

execution time is dominated by RemoteExecutor.Invoke that takes ~30s.

Yes, it looks like every test that uses RemoteExecutor has problems with timeouts in RiscV test environment based on the fixes that you are submitting (e.g. #108702 cc @sirntar). Would it be better to make a central fix in RemoteExecutor instead of trying to fix RemoteExecutor tests one at a time? There are a lot of RemoteExecutor tests in the repo.

sirntar · 2024-10-30T14:57:26Z

Would it be better to make a central fix in RemoteExecutor instead of trying to fix RemoteExecutor tests one at a time? There are a lot of RemoteExecutor tests in the repo.

What do you mean by central fix? Should we directly change RemoteExecutor.cs#L21C7-L21C66, or should we create one PR with all the time increases needed for rv64?

jkotas · 2024-10-30T23:03:05Z

Should we directly change RemoteExecutor.cs#L21C7-L21C66, or should we create one PR with all the time increases needed for rv64?

@ViktorHofer @dotnet/area-infrastructure-libraries Do you have a preference?

The problem is that RemoteExecutor needs much higher timeout in RiscV test environment. Here are a few options:

(1) Change the implementation of RemoteExecutor to read a timeout multiplier from env. variable that will be set in the RiscV test environment. This is my personal preference.
or
(2) Change the implementation of RemoteExecutor to use a different timeout default for RiscV.
or
(3) Change every instance of RemoteExecutor in this repo to go through a RemoteExecutor factory in TestUtils that will adjust RemoteExecutor timeout for RiscV.

ViktorHofer · 2024-10-31T07:21:57Z

Yes, reading from a new env var in RemoteExecutor makes most sense and is the easiest option. Just make sure that the env var is respected in both CI (helix) and locally (xunit.console & vstest).

This patch implements solution suggested in dotnet/runtime#108879

yurai007 · 2024-11-04T15:00:51Z

Yes, reading from a new env var in RemoteExecutor makes most sense and is the easiest option. Just make sure that the env var is respected in both CI (helix) and locally (xunit.console & vstest).

@ViktorHofer:

I think dotnet/arcade#15215 works fine locally but I'm not very familiar with rest of what you suggested. Could you please give me some tips what actually should be done for helix and vstest?

ViktorHofer · 2024-11-04T18:22:05Z

For VSTest, set the env var here:

runtime/eng/testing/.runsettings

Line 21 in 2bb4bb7

If you need to pass a non static value in, use the $$ approach same with the other settings and overwrite that marker in runsettings.targets:

runtime/eng/testing/runsettings.targets

Line 39 in 2bb4bb7

    
           <RunSettingsFileContent>$(RunSettingsFileContent.Replace('$$COVERAGE_INCLUDE$$', '$(CoverageIncludeFilter)')

For xunit.console (which is invoked via the RunTests.cmd/sh script), you want to add SetScriptCommands msbuild items, similar as this one:

runtime/eng/testing/tests.targets

Lines 73 to 74 in 2bb4bb7

    
           <SetScriptCommands Condition="'$(TargetOS)' == 'windows'" Include="set __IsXUnitLogCheckerSupported=1" /> 
        
           <SetScriptCommands Condition="'$(TargetOS)' != 'windows'" Include="export __IsXUnitLogCheckerSupported=1" />

They then get encoded into the RunTests script. You can find that script in the output directory of a test app.

Helix invokes the test via the RunTests script so this should automatically work with the above work. Double check that test console log on AzDO in the PR contains the set/export line. Just to make sure that this works.

jkotas · 2024-11-04T18:42:52Z

@ViktorHofer This is not going to be used by Helix or vstest currently. It is only going to be only used by Samsung when running risc-v tests under qemu or on risc-v boards. I would expect that they can just set this in the environment.

ViktorHofer · 2024-11-04T19:01:09Z

If they aren't going through RunTests.cmd/sh (dotnet build /t:Test), dotnet test or Helix then yes, none of that is needed initially. But I wouldn't be surprised if others would like to make use of that Remote Executor feature nob, eventually.

yurai007 · 2024-11-06T07:49:10Z

Closing after dotnet/arcade#15215 merge.

[RISC-V] Increase timeouts in CustomConverterTests

71892ea

This patch fixes System.Text.Json.Serialization.Tests.CustomConverterTests on Debug build.

dotnet-issue-labeler bot added the area-System.Text.Json label Oct 15, 2024

dotnet-policy-service bot added the community-contribution Indicates that the PR has been added by a community member label Oct 15, 2024

Merge branch 'main' into increase-custom-converter-tests-timeouts

cef4dba

Bajtazar approved these changes Oct 15, 2024

View reviewed changes

tomeksowi approved these changes Oct 15, 2024

View reviewed changes

sirntar approved these changes Oct 15, 2024

View reviewed changes

build-analysis bot mentioned this pull request Oct 15, 2024

System.Runtime.Tests.WorkItemExecution "crash" on tvOS #106319

Open

clamp03 assigned yurai007 Oct 16, 2024

Merge branch 'main' into increase-custom-converter-tests-timeouts

d9ff79b

build-analysis bot mentioned this pull request Oct 28, 2024

restarted. Azure DevOps can't recover from restarts. dotnet/dnceng#3879

Open

3 tasks

eiriktsarpalis approved these changes Oct 28, 2024

View reviewed changes

sirntar mentioned this pull request Oct 29, 2024

[RISC-V] Increase timeouts in System.Text.Json.Serialization.Tests.OptionsTests #108702

Closed

yurai007 added a commit to yurai007/arcade that referenced this pull request Nov 4, 2024

Add support for environment timeout multiplier in remote operation

448533b

This patch implements solution suggested in dotnet/runtime#108879

yurai007 mentioned this pull request Nov 4, 2024

Add support for environment timeout multiplier in remote operation dotnet/arcade#15215

Merged

yurai007 closed this Nov 6, 2024

github-actions bot locked and limited conversation to collaborators Dec 6, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[RISC-V] Increase timeouts in CustomConverterTests #108879

[RISC-V] Increase timeouts in CustomConverterTests #108879

yurai007 commented Oct 15, 2024

dotnet-policy-service bot commented Oct 15, 2024

risc-vv commented Oct 15, 2024 •

edited

Loading

risc-vv commented Oct 15, 2024 •

edited

Loading

risc-vv commented Oct 28, 2024 •

edited

Loading

yurai007 commented Oct 28, 2024

jkotas commented Oct 28, 2024

jkotas commented Oct 28, 2024

yurai007 commented Oct 28, 2024

yurai007 commented Oct 30, 2024

jkotas commented Oct 30, 2024 •

edited

Loading

sirntar commented Oct 30, 2024

jkotas commented Oct 30, 2024

ViktorHofer commented Oct 31, 2024

yurai007 commented Nov 4, 2024

ViktorHofer commented Nov 4, 2024

jkotas commented Nov 4, 2024

ViktorHofer commented Nov 4, 2024 •

edited

Loading

yurai007 commented Nov 6, 2024

[RISC-V] Increase timeouts in CustomConverterTests #108879

[RISC-V] Increase timeouts in CustomConverterTests #108879

Conversation

yurai007 commented Oct 15, 2024

dotnet-policy-service bot commented Oct 15, 2024

risc-vv commented Oct 15, 2024 • edited Loading

risc-vv commented Oct 15, 2024 • edited Loading

risc-vv commented Oct 28, 2024 • edited Loading

yurai007 commented Oct 28, 2024

jkotas commented Oct 28, 2024

jkotas commented Oct 28, 2024

yurai007 commented Oct 28, 2024

yurai007 commented Oct 30, 2024

jkotas commented Oct 30, 2024 • edited Loading

sirntar commented Oct 30, 2024

jkotas commented Oct 30, 2024

ViktorHofer commented Oct 31, 2024

yurai007 commented Nov 4, 2024

ViktorHofer commented Nov 4, 2024

jkotas commented Nov 4, 2024

ViktorHofer commented Nov 4, 2024 • edited Loading

yurai007 commented Nov 6, 2024

risc-vv commented Oct 15, 2024 •

edited

Loading

risc-vv commented Oct 15, 2024 •

edited

Loading

risc-vv commented Oct 28, 2024 •

edited

Loading

jkotas commented Oct 30, 2024 •

edited

Loading

ViktorHofer commented Nov 4, 2024 •

edited

Loading