D issues are now tracked on GitHub. This Bugzilla instance remains as a read-only archive.
Issue 21130 - Test Suite: C++ interop tests / Run (macOS-10.15, clang-4.0.0) fails with X Setup job
Summary: Test Suite: C++ interop tests / Run (macOS-10.15, clang-4.0.0) fails with X S...
Status: RESOLVED WONTFIX
Alias: None
Product: D
Classification: Unclassified
Component: dmd (show other issues)
Version: D2
Hardware: x86_64 Mac OS X
: P1 normal
Assignee: No Owner
URL:
Keywords: TestSuite
Depends on:
Blocks:
 
Reported: 2020-08-06 23:33 UTC by Walter Bright
Modified: 2020-08-16 17:39 UTC (History)
2 users (show)

See Also:


Attachments

Note You need to log in before you can comment on or make changes to this issue.
Description Walter Bright 2020-08-06 23:33:26 UTC
The log file:

-----------------
C++ interop tests / Run (macOS-10.15, clang-4.0.0)
failed 4 minutes ago in 6m 39s
Set up job
-----------------

No further information.
Comment 1 Mathias LANG 2020-08-09 08:23:34 UTC
Please don't open bugs for testsuite transient failure without identifying them.
What can one do here to fix this bug ? Absolutely nothing. There's no information, so this will either get ignored or closed, but never fixed.

For reference, we know that the Github actions job sometimes have some random failures, but they are trivial to re-trigger, and it's rather rare. We took steps to reduce it (by introducing caching, and hence reducing network load) but there's only so much we can do (some failures are on Github side).
Comment 2 Walter Bright 2020-08-10 02:39:40 UTC
(In reply to Mathias LANG from comment #1)
> [...]

There being "no information" is part of the bug report. That's all the log says. The logger can do better.

Secondly, these networking errors can be detected, and when they happen, the test script can "sleep" for a minute or two and then retry it. If it continues to fail after N times, then the script can give up and quit.

After all, if the user can re-start the script, so can the script. The script ought to be able to distinguish between an environmental error and a failure of whatever is being tested.
Comment 3 moonlightsentinel 2020-08-16 17:39:08 UTC
There is nothing we can do here due to the missing log (which seems to be an issue inside of GitHub Actions).

Note that https://github.com/dlang/dmd/pull/11537 dropped the support for older llvms which should improve caching and reduce the chance of network error (which predominantly happened for those older versions).