Improve test flakiness #274
waliidAnnotations
32 errors
|
PlayerTrackingTests.testTrackingDisabledDuringPlayback():
Tests/PlayerTests/Tracking/PlayerTrackingTests.swift#L1
XCTAssertTrue failed - Different count:
| Received: (3) [PlayerTests.PlayerItemTrackerMock.State.initialized, PlayerTests.PlayerItemTrackerMock.State.enabled, PlayerTests.PlayerItemTrackerMock.State.metricEvents]
| Expected: (4) [PlayerTests.PlayerItemTrackerMock.State.initialized, PlayerTests.PlayerItemTrackerMock.State.enabled, PlayerTests.PlayerItemTrackerMock.State.metricEvents, PlayerTests.PlayerItemTrackerMock.State.metricEvents]
(/Users/runner/work/pillarbox-apple-github-runner-poc/pillarbox-apple-github-runner-poc/Tests/PlayerTests/Tracking/PlayerTrackingTests.swift#EndingLineNumber=62&StartingLineNumber=62)
|
|
PlayerTrackingTests.testTrackingEnabledTwice():
Tests/PlayerTests/Tracking/PlayerTrackingTests.swift#L1
XCTAssertTrue failed - Different count:
| Received: (1) [PlayerTests.PlayerItemTrackerMock.State.metricEvents]
| Expected: (2) [PlayerTests.PlayerItemTrackerMock.State.metricEvents, PlayerTests.PlayerItemTrackerMock.State.metricEvents]
(/Users/runner/work/pillarbox-apple-github-runner-poc/pillarbox-apple-github-runner-poc/Tests/PlayerTests/Tracking/PlayerTrackingTests.swift#EndingLineNumber=88&StartingLineNumber=88)
|
|
🧪 Tests (tvos)
testBuffering on 'Clone 1 of Apple TV - xctest (13088)' (2.389 seconds)
|
|
🧪 Tests (tvos)
testTrackingDisabledDuringPlayback on 'Clone 1 of Apple TV - xctest (16424)' (1.031 seconds)
|
|
🧪 Tests (tvos)
testTrackingDisabledDuringPlayback on 'Clone 1 of Apple TV - xctest (16424)' (1.017 seconds)
|
|
🧪 Tests (tvos)
testTrackingDisabledDuringPlayback on 'Clone 1 of Apple TV - xctest (16424)' (1.013 seconds)
|
|
🧪 Tests (tvos)
testTrackingDisabledDuringPlayback on 'Clone 1 of Apple TV - xctest (16424)' (1.013 seconds)
|
|
🧪 Tests (tvos)
testTrackingEnabledTwice on 'Clone 1 of Apple TV - xctest (16424)' (1.013 seconds)
|
|
🧪 Tests (tvos)
testTrackingEnabledTwice on 'Clone 1 of Apple TV - xctest (16424)' (1.015 seconds)
|
|
🧪 Tests (tvos)
testTrackingEnabledTwice on 'Clone 1 of Apple TV - xctest (16424)' (1.012 seconds)
|
|
🧪 Tests (tvos)
testTrackingEnabledTwice on 'Clone 1 of Apple TV - xctest (16424)' (1.015 seconds)
|
|
🧪 Tests (tvos)
testTrackingEnabledDuringPlayback on 'Clone 1 of Apple TV - xctest (16424)' (1.688 seconds)
|
|
🧪 Tests (tvos)
❌ Tests reported 2 failures
|
|
RepeatModeTests.testRepeatOne():
Tests/PlayerTests/Playlist/RepeatModeTests.swift#L1
expected to eventually equal <55DB988B-FF29-4AB2-B744-ED3A9BC8B75C>, got <D835786D-4132-4743-ACBD-92215E33B098>
(/Users/runner/work/pillarbox-apple-github-runner-poc/pillarbox-apple-github-runner-poc/Tests/PlayerTests/Playlist/RepeatModeTests.swift#EndingLineNumber=20&StartingLineNumber=20)
|
|
RepeatModeTests.testRepeatAll():
Tests/PlayerTests/Playlist/RepeatModeTests.swift#L1
expected to eventually equal <6220DBF9-4B7C-4021-AC8F-BAC843E2D2AB>, got <00F71B7D-EA09-4474-97B4-A49A3B1070CD>
(/Users/runner/work/pillarbox-apple-github-runner-poc/pillarbox-apple-github-runner-poc/Tests/PlayerTests/Playlist/RepeatModeTests.swift#EndingLineNumber=30&StartingLineNumber=30)
|
|
RepeatModeTests.testRepeatModeUpdateDoesNotReplay():
Tests/PlayerTests/Playlist/RepeatModeTests.swift#L1
expected to eventually be nil, got <EA49E1F8-FB68-4BC0-8AB2-7DC8D01BC1EF>
(/Users/runner/work/pillarbox-apple-github-runner-poc/pillarbox-apple-github-runner-poc/Tests/PlayerTests/Playlist/RepeatModeTests.swift#EndingLineNumber=48&StartingLineNumber=48)
|
|
ProgressTrackerTimeTests.testEntirePlayback():
Tests/PlayerTests/ProgressTracker/ProgressTrackerTimeTests.swift#L1
XCTAssertTrue failed - Expected: [__C.CMTime(value: 0, timescale: 0, flags: __C.CMTimeFlags(rawValue: 0), epoch: 0), __C.CMTime(value: 0, timescale: 1, flags: __C.CMTimeFlags(rawValue: 1), epoch: 0), __C.CMTime(value: 1, timescale: 4, flags: __C.CMTimeFlags(rawValue: 1), epoch: 0), __C.CMTime(value: 1, timescale: 2, flags: __C.CMTimeFlags(rawValue: 1), epoch: 0), __C.CMTime(value: 3, timescale: 4, flags: __C.CMTimeFlags(rawValue: 1), epoch: 0), __C.CMTime(value: 1, timescale: 1, flags: __C.CMTimeFlags(rawValue: 1), epoch: 0), __C.CMTime(value: 0, timescale: 0, flags: __C.CMTimeFlags(rawValue: 0), epoch: 0)], actual: [__C.CMTime(value: 0, timescale: 0, flags: __C.CMTimeFlags(rawValue: 0), epoch: 0), __C.CMTime(value: 0, timescale: 1000, flags: __C.CMTimeFlags(rawValue: 1), epoch: 0)] (/Users/runner/work/pillarbox-apple-github-runner-poc/pillarbox-apple-github-runner-poc/Tests/PlayerTests/ProgressTracker/ProgressTrackerTimeTests.swift#EndingLineNumber=52&StartingLineNumber=52)
|
|
SpeedTests.testSpeedUpdateWhenApproachingLiveEdge():
Tests/PlayerTests/Player/SpeedTests.swift#L1
expected to eventually equal <1>, got <2>
(/Users/runner/work/pillarbox-apple-github-runner-poc/pillarbox-apple-github-runner-poc/Tests/PlayerTests/Player/SpeedTests.swift#EndingLineNumber=120&StartingLineNumber=120)
|
|
SpeedTests.testPlaylistEnd():
Tests/PlayerTests/Player/SpeedTests.swift#L1
expected to eventually be nil, got <A9EDDC03-1928-48EA-843E-E5C2143C8D76>
(/Users/runner/work/pillarbox-apple-github-runner-poc/pillarbox-apple-github-runner-poc/Tests/PlayerTests/Player/SpeedTests.swift#EndingLineNumber=128&StartingLineNumber=128)
|
|
ReplayChecksTests.testWithOneGoodItemPlayedEntirely():
Tests/PlayerTests/Player/ReplayChecksTests.swift#L1
expected to eventually be true, got <false>
(/Users/runner/work/pillarbox-apple-github-runner-poc/pillarbox-apple-github-runner-poc/Tests/PlayerTests/Player/ReplayChecksTests.swift#EndingLineNumber=25&StartingLineNumber=25)
|
|
ReplayChecksTests.testWithManyGoodItems():
Tests/PlayerTests/Player/ReplayChecksTests.swift#L1
expected to eventually be true, got <false>
(/Users/runner/work/pillarbox-apple-github-runner-poc/pillarbox-apple-github-runner-poc/Tests/PlayerTests/Player/ReplayChecksTests.swift#EndingLineNumber=46&StartingLineNumber=46)
|
|
🧪 Tests (ios)
❌ Tests reported 8 failures
|
|
🧪 Tests (ios)
testWithMultipleEvents on 'Clone 1 of iPhone 16 - xctest (12861)' (27.258 seconds)
|
|
🧪 Tests (ios)
testWithMultipleEvents on 'Clone 1 of iPhone 16 - xctest (12861)' (1.028 seconds)
|
|
🧪 Tests (ios)
testPauseDuringPlayback on 'Clone 1 of iPhone 16 - xctest (13229)' (90.876 seconds)
|
|
🧪 Tests (ios)
testRepeatOne on 'Clone 1 of iPhone 16 - xctest (14792)' (23.639 seconds)
|
|
🧪 Tests (ios)
testEntirePlayback on 'Clone 1 of iPhone 16 - xctest (18021)' (3.023 seconds)
|
|
🧪 Tests (ios)
testEntirePlayback on 'Clone 1 of iPhone 16 - xctest (18021)' (2.078 seconds)
|
|
🧪 Tests (ios)
testEntirePlayback on 'Clone 1 of iPhone 16 - xctest (18021)' (2.064 seconds)
|
|
🧪 Tests (ios)
testEntirePlayback on 'Clone 1 of iPhone 16 - xctest (18021)' (2.040 seconds)
|
|
🧪 Tests (ios)
testRepeatOne on 'Clone 1 of iPhone 16 - xctest (14792)' (22.097 seconds)
|
|
🧪 Tests (ios)
testRepeatOne on 'Clone 1 of iPhone 16 - xctest (14792)' (22.036 seconds)
|