Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The active test run was aborted. Reason: Test host process crashed #451

Open
3 tasks
fanyang-mono opened this issue Jul 25, 2023 · 8 comments
Open
3 tasks

Comments

@fanyang-mono
Copy link
Member

fanyang-mono commented Jul 25, 2023

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=351450

Build leg reported

chrome-DebuggerTests.EvaluateOnCallFrameTests.WorkItemExecution

Pull Request

dotnet/runtime#89217

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The active test run was aborted. Reason: Test host process crashed",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

  • Feature changes/additions
  • Bug fixes
  • Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Report

Build Definition Step Name Console log Pull Request
893668 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76235
893200 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76387
893046 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76384
892987 dotnet/roslyn Run Integration Tests Log
892776 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76357
892595 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76375
891923 dotnet/roslyn Run Integration Tests Log
891892 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76352
891503 dotnet/roslyn Run Integration Tests Log
891036 dotnet/roslyn Run Integration Tests Log
890631 dotnet/roslyn Run Integration Tests Log
890433 dotnet/roslyn Run Integration Tests Log
2597946 dotnet-interactive Test / Blame Log
889144 dotnet/roslyn Run Integration Tests Log
888914 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76321
888839 dotnet/roslyn Run Integration Tests Log
888829 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76318
888714 dotnet/roslyn Run Integration Tests Log
888602 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76309
887757 dotnet/roslyn Run Integration Tests Log
887746 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76291
887749 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76276
887732 dotnet/roslyn Run Integration Tests Log
887658 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76286
887405 dotnet/roslyn Run Integration Tests Log
887402 dotnet/roslyn Run Integration Tests Log
886534 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76269
886460 dotnet/roslyn Run Integration Tests Log
885670 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76254
885664 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76253
885460 dotnet/roslyn Run Integration Tests Log
885199 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76185
884735 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76233
884729 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#69804
884674 dotnet/roslyn Run Integration Tests Log
884480 dotnet/roslyn Run Integration Tests Log
884436 dotnet/roslyn Run Integration Tests Log
884349 dotnet/roslyn Run Integration Tests Log
884247 dotnet/roslyn Run Integration Tests Log
884156 dotnet/roslyn Run Integration Tests Log
884153 dotnet/roslyn Run Integration Tests Log
884066 dotnet/roslyn Run Integration Tests Log
883939 dotnet/roslyn Run Integration Tests Log
883917 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76149
883921 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76150
883855 dotnet/roslyn Run Integration Tests Log
883730 dotnet/roslyn Run Integration Tests Log
883251 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76219
883223 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#65830
883178 dotnet/roslyn Run Integration Tests Log
883165 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#74623
883049 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#65829
883096 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#65830
883085 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#65773
882545 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76163
881649 dotnet/roslyn Run Integration Tests Log
881631 dotnet/roslyn Run Integration Tests Log
881488 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76128
881439 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76125
881422 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76124
881369 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76066
881248 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76119
880727 dotnet/roslyn Run Integration Tests Log
880199 dotnet/roslyn Run Integration Tests Log
880164 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76076
879799 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76098
879768 dotnet/roslyn Run Integration Tests Log
879714 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76096
879404 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76086
879336 dotnet/roslyn Run Integration Tests Log
879257 dotnet/roslyn Run Integration Tests Log
879141 dotnet/roslyn Run Integration Tests Log
879112 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76044
879087 dotnet/roslyn Run Integration Tests Log
878679 dotnet/roslyn Run Integration Tests Log
878606 dotnet/roslyn Run Integration Tests Log
878330 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76068
878196 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76067
877667 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76054
877534 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76035
877373 dotnet/roslyn Run Integration Tests Log
877203 dotnet/roslyn Run Integration Tests Log
877201 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76043
877116 dotnet/roslyn Run Integration Tests Log
877081 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75493
877079 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76039
876714 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#76035
876277 dotnet/roslyn Run Integration Tests Log
876129 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75684
875864 dotnet/roslyn Run Integration Tests Log
875842 dotnet/roslyn Run Integration Tests Log
875756 dotnet/roslyn Run Integration Tests Log
875616 dotnet/roslyn Run Integration Tests Log
875244 dotnet/roslyn Run Integration Tests Log
875097 dotnet/roslyn Run Integration Tests Log
875034 dotnet/roslyn Run Integration Tests Log
874624 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75971
873798 dotnet/roslyn Run Integration Tests Log
873255 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75970
872954 dotnet/roslyn Run Integration Tests Log
Displaying 100 of 131 results
Build Definition Test Pull Request
893828 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.1.WorkItemExecution dotnet/sdk#45380
893783 dotnet/sdk Microsoft.DotNet.Watch.UnitTests.ApplyDeltaTests.Microsoft.DotNet.Watch.UnitTests.ApplyDeltaTests.BlazorWasm dotnet/sdk#45427
893430 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#45293
2600389 dotnet-roslyn Microsoft.CodeAnalysis.CSharp.CodeStyle.UnitTests_5.WorkItemExecution
893691 dotnet/sdk dotnet-watch.Tests.dll.3.WorkItemExecution dotnet/sdk#45397
893447 dotnet/sdk Microsoft.DotNet.Watch.UnitTests.ApplyDeltaTests.Microsoft.DotNet.Watch.UnitTests.ApplyDeltaTests.BlazorWasm dotnet/sdk#45427
893379 dotnet/aspnetcore Templates.Mvc.Tests--net8.0.WorkItemExecution
892151 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution dotnet/sdk#45392
893220 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#45293
893123 dotnet/sdk Microsoft.NET.Build.Tests.dll.25.WorkItemExecution dotnet/sdk#45274
893019 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution dotnet/sdk#45293
892856 dotnet/sdk dotnet-watch.Tests.dll.6.WorkItemExecution dotnet/sdk#45131
892858 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.4.WorkItemExecution dotnet/sdk#45317
892613 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution dotnet/sdk#45408
2599614 dotnet-aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
892334 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution dotnet/sdk#45293
892260 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.4.WorkItemExecution dotnet/sdk#45405
892196 dotnet/roslyn Microsoft.CodeAnalysis.CSharp.EndToEnd.UnitTests_0.WorkItemExecution dotnet/roslyn#75581
891808 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#45405
892114 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.4.WorkItemExecution dotnet/sdk#45293
892061 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#45410
891986 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#45274
891971 dotnet/sdk Microsoft.NET.Build.Tests.dll.6.WorkItemExecution dotnet/sdk#45265
891844 dotnet/sdk Microsoft.NET.Build.Tests.dll.1.WorkItemExecution dotnet/sdk#45317
891845 dotnet/sdk EndToEnd.Tests.dll.2.WorkItemExecution dotnet/sdk#45298
891765 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#45293
891594 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution dotnet/sdk#45265
891652 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#45339
891647 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#45343
891653 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#45298
891640 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#45293
891425 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#45274
890849 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.1.WorkItemExecution dotnet/sdk#45327
890761 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution dotnet/sdk#45274
890296 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#45351
890888 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#45293
890878 dotnet/sdk dotnet.Tests.dll.11.WorkItemExecution dotnet/sdk#44958
886687 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.3.WorkItemExecution dotnet/sdk#45274
890810 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.4.WorkItemExecution dotnet/sdk#45380
890683 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
890700 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#45265
890575 dotnet/sdk dotnet.Tests.dll.11.WorkItemExecution dotnet/sdk#45384
890259 dotnet/sdk dotnet-watch.Tests.dll.4.WorkItemExecution dotnet/sdk#45369
890364 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution dotnet/sdk#45380
890335 dotnet/roslyn Microsoft.CodeAnalysis.CSharp.EndToEnd.UnitTests_0.WorkItemExecution dotnet/roslyn#75581
889105 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#45343
885704 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#45144
890129 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#45380
889696 dotnet/aspnetcore Templates.Mvc.Tests--net8.0.WorkItemExecution
888116 dotnet/sdk Microsoft.NET.Build.Tests.dll.1.WorkItemExecution dotnet/sdk#45351
888124 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#45327
889207 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#45293
889460 dotnet/sdk dotnet-watch.Tests.dll.4.WorkItemExecution dotnet/sdk#45369
888027 dotnet/sdk EndToEnd.Tests.dll.2.WorkItemExecution dotnet/sdk#45278
889410 dotnet/sdk dotnet-watch.Tests.dll.3.WorkItemExecution dotnet/sdk#44958
889295 dotnet/aspnetcore Templates.Mvc.Tests--net8.0.WorkItemExecution
889205 dotnet/roslyn Microsoft.CodeAnalysis.CSharp.EditorFeatures.UnitTests_20.WorkItemExecution dotnet/roslyn#76329
889175 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#45293
2597311 dotnet-roslyn Microsoft.CodeAnalysis.CSharp.Features.UnitTests_113.WorkItemExecution
889108 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#45298
2597180 dotnet-aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
888915 dotnet/aspnetcore Templates.Mvc.Tests--net8.0.WorkItemExecution
888891 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#45293
888713 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
888674 dotnet/sdk Microsoft.NET.Sdk.Web.Tests.dll.WorkItemExecution dotnet/sdk#45345
888524 dotnet/sdk Microsoft.NET.Build.Tests.dll.13.WorkItemExecution dotnet/sdk#45345
888361 dotnet/sdk dotnet-watch.Tests.dll.6.WorkItemExecution dotnet/sdk#45131
888285 dotnet/sdk Microsoft.NET.Build.Tests.dll.1.WorkItemExecution dotnet/sdk#45356
887885 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#45293
887726 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
887666 dotnet/sdk Microsoft.NET.Build.Tests.dll.1.WorkItemExecution dotnet/sdk#45339
887663 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#45317
887660 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.4.WorkItemExecution dotnet/sdk#45259
887559 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution dotnet/sdk#45293
887550 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#44956
887549 dotnet/sdk Microsoft.NET.Build.Tests.dll.1.WorkItemExecution dotnet/sdk#45151
885360 dotnet/sdk dotnet.Tests.dll.11.WorkItemExecution dotnet/sdk#45263
886824 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#45317
887404 dotnet/roslyn Microsoft.CodeAnalysis.CSharp.Features.UnitTests_36.WorkItemExecution
887092 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#45293
887064 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#45265
887086 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#45327
886812 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution dotnet/sdk#45265
886911 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.4.WorkItemExecution dotnet/sdk#45293
886932 dotnet/aspnetcore Templates.Mvc.Tests--net8.0.WorkItemExecution
885537 dotnet/sdk Microsoft.NET.Build.Tests.dll.11.WorkItemExecution dotnet/sdk#44958
885494 dotnet/sdk EndToEnd.Tests.dll.2.WorkItemExecution dotnet/sdk#45179
886668 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.4.WorkItemExecution dotnet/sdk#45293
886325 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution dotnet/sdk#45298
886628 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution dotnet/sdk#45159
886412 dotnet/sdk dotnet-watch.Tests.dll.6.WorkItemExecution dotnet/sdk#45131
885091 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution dotnet/sdk#45278
886269 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution dotnet/sdk#44974
885699 dotnet/sdk EndToEnd.Tests.dll.2.WorkItemExecution dotnet/sdk#45259
886062 dotnet/sdk Microsoft.NET.Publish.Tests.dll.6.WorkItemExecution dotnet/sdk#45293
885686 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.1.WorkItemExecution dotnet/sdk#45274
885912 dotnet/aspnetcore Templates.Mvc.Tests--net8.0.WorkItemExecution
885809 dotnet/sdk dotnet-watch.Tests.dll.5.WorkItemExecution dotnet/sdk#45265
885830 dotnet/sdk Microsoft.NET.Publish.Tests.dll.3.WorkItemExecution dotnet/sdk#45293
885793 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution dotnet/sdk#45131
Displaying 100 of 153 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
18 103 284

Known issue validation

Build: 🔎
Result validation: ⚠️ Validation could not be done without an Azure DevOps build URL on the issue. Please add it to the "Build: 🔎" line.
Validation performed at: 2/8/2024 9:24:30 PM UTC

@andriipatsula
Copy link
Member

Hello @fanyang-mono, could you please update the "ErrorMessage" : "" by following the step by step documentation on how to create a known issue

@fanyang-mono
Copy link
Member Author

Updated.

@pavelsavara
Copy link
Member

pavelsavara commented Nov 7, 2023

This is duplicate of dotnet/runtime#89409, except here it's not only wasm debugger

@dougbu
Copy link
Member

dougbu commented Nov 23, 2023

@pavelsavara and @fanyang-mono, should this issue be closed in favour of dotnet/runtime#94560❔ if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

@pavelsavara
Copy link
Member

@pavelsavara and @fanyang-mono, should this issue be closed in favour of

You mean dotnet/runtime#89409

I think we should keep this one, because this one has some hits which are not just wasm debugger related.
Here we see other repo failures, on roslyn and aspnetcore CI.

if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

I have not investigated it myself yet. But got questions which could help to narrow it down

  • are there crash dump files on the machine ?
  • are there some hints on what's going on in the log files before crash ?
  • is this OOM or stack overflow in disguise ?
  • did we run out of disk space or number of inodes ?
  • hit some limit in docker container ?
  • is this always the same OS, version, image ?
  • could this be hardware issue ?

@fanyang-mono
Copy link
Member Author

This issue was originally created to track issues happened to wasm debugger tests (belonging to dotnet/runtime repo). However, the error message was generic enough to include issues from other repos, such as dotnet/roslyn and dotnet/aspnetcore. We need insights from owners from dotnet/roslyn and dotnet/aspnetcore to confirm that they are aware of these issue. And if they are okay to close this issue as well. We could close then.

@mitchdenny
Copy link
Member

We just got an instance of this in the dotnet/aspire repo. It wasn't a WASM related failure for us. Just looks like the test process crashed and took a few tests with it.

@nagilson
Copy link
Member

nagilson commented Dec 3, 2024

@marcpopMSFT was working on getting the test infrastructure to generate crash dumps when it times out to help with investigation. I think it was generating the dumps but not yet correctly uploading them to the artifacts.

We are waiting to hear from the infra team on an issue with this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

8 participants