Failure on Helix tests - Tests timing out

[MiYanni]

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=635799
Build error leg or test failing: Microsoft.DotNet.MSBuildSdkResolver.Tests.dll.3.WorkItemExecution
Pull request: #40059

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "END OF WORK ITEM LOG: Command timed out, and was killed",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=635799
Error message validated: [END OF WORK ITEM LOG: Command timed out, and was killed]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 4/9/2024 5:21:23 PM UTC

Report

Build	Definition	Test	Pull Request
872715	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.3.WorkItemExecution	#44899
872916	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44934
872904	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44939
872895	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tests.dll.13.WorkItemExecution	#44805
872885	dotnet/sdk	dotnet-watch.Tests.dll.4.WorkItemExecution	#44786
872868	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#44802
872760	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#44938
872812	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44924
872692	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44934
872634	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#44810
872547	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44829
872435	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#44928
872434	dotnet/sdk	dotnet.Tests.dll.15.WorkItemExecution	#44927
872392	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44801
872357	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#44691
872286	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution	#44805
872222	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44924
872207	dotnet/sdk	dotnet-watch.Tests.dll.2.WorkItemExecution	#44801
872042	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#44810
872031	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44861
871967	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44918
871957	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution	#44866
871938	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44916
871873	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution	#44810
871858	dotnet/sdk	dotnet-watch.Tests.dll.2.WorkItemExecution	#44786
871782	dotnet/sdk	Microsoft.NET.ToolPack.Tests.dll.3.WorkItemExecution	#44810
871563	dotnet/sdk	dotnet-watch.Tests.dll.2.WorkItemExecution	#44786
871531	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution	#44802
871345	dotnet/sdk	Microsoft.NET.Build.Tests.dll.5.WorkItemExecution	#44691
871339	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#44899
871296	dotnet/sdk	dotnet-watch.Tests.dll.4.WorkItemExecution	#44691
871002	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44808
871083	dotnet/sdk	dotnet.Tests.dll.15.WorkItemExecution	#44802
871054	dotnet/sdk	Microsoft.NET.Build.Tests.dll.24.WorkItemExecution	#44765
871038	dotnet/sdk	dotnet-watch.Tests.dll.3.WorkItemExecution	#44834
871017	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44849
871013	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44815
871010	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44813
870971	dotnet/sdk	Microsoft.NET.Build.Tests.dll.24.WorkItemExecution	#44810
870893	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44890
870741	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44816
870714	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#44802
870716	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44803
869655	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44864
870458	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	#44691
870523	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#44882
870258	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.2.WorkItemExecution	#44807
869940	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44876
869884	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44871
869653	dotnet/sdk	dotnet-watch.Tests.dll.2.WorkItemExecution	#44866
869600	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#44540
869570	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44861
869535	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#44810
869469	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44804
869461	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	#44757
869404	dotnet/sdk	dotnet.Tests.dll.6.WorkItemExecution	#44786
869397	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44855
869322	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	#44834
869324	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44804
869306	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44803
869305	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution	#44802
869059	dotnet/sdk	dotnet.Tests.dll.15.WorkItemExecution	#44850
869041	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44804
868896	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44757
868784	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44816
868773	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44815
868628	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#44810
868411	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44803
867682	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	#44809
867645	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44814
867642	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44813
867632	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44812
867649	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44815
868410	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	#44802
868415	dotnet/sdk	Microsoft.NET.Build.Tests.dll.23.WorkItemExecution	#44805
868202	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44828
868087	dotnet/sdk	dotnet-watch.Tests.dll.2.WorkItemExecution	#44802
868044	dotnet/sdk	dotnet-watch.Tests.dll.2.WorkItemExecution	#44824
867981	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44820
867734	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	#44805
867685	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44816
867420	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#44764
867301	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44807
867379	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#44802
867326	dotnet/sdk	Microsoft.NET.Build.Tests.dll.23.WorkItemExecution	#44810
867321	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44803
867320	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution	#44802
867221	dotnet/sdk	dotnet-watch.Tests.dll.2.WorkItemExecution	#44805
866658	dotnet/sdk	Microsoft.NET.Build.Tests.dll.23.WorkItemExecution	#44795
867202	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44570
867060	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#44802
866618	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution	#44791
866933	dotnet/sdk	dotnet.Tests.dll.15.WorkItemExecution	#44699
866598	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution	#44785
866566	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44790
866495	dotnet/sdk	Microsoft.NET.Build.Tests.dll.23.WorkItemExecution	#44786
866309	dotnet/sdk	Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.5.WorkItemExecution	#44785
866190	dotnet/sdk	Microsoft.NET.Build.Tests.dll.24.WorkItemExecution	#44764
866133	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#44540
866136	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#44779
Displaying 100 of 300 results

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
25	88	300

[nagilson]

@tmat May you please look at this dotnet watch failure?

[tmat]

@nagilson I checked a few logs from above and it looks like the failures are in release/8.0.1xx branch. That wouldn't have various test infra fixes.

[nagilson]

Thank you for checking :) @tmat, which test infra fixes are you referring to? It may be worth porting them over to 8.0.1xx. Any disagreements @marcpopMSFT?

[nagilson]

We also just hit it in main, so there might be another existing problem: #41045

[baronfel]

@tmat this is popping up again in the rc1 branches, when you get back can you take a look?

[tmat]

@baronfel I can take a look. Do you have a link to the failed run? The test log should be good enough to determine the issue on main/rc1 branches.

[baronfel]

The helix timeouts are most of the failed tests in this pipeline, but you can't access them right now due to helix auth issues.