Skip to content
CI

Increase tolerance to improve test stability #272

Sign in to view logs

Increase tolerance to improve test stability

Increase tolerance to improve test stability #272

Triggered via push December 7, 2024 19:12
@waliidwaliid
pushed 701997c
fix-tests
Status Failure
Total duration 9m 23s
Artifacts –

ci.yml

on: push
🔎 Check quality
28s
🔎 Check quality
Matrix: 📦 Archives
Matrix: 🧪 Tests
Fit to window
Zoom out
Zoom in

Annotations

21 errors
PlayerItemTrackerMetricPublisherTests.testPlaylist(): Tests/PlayerTests/Tracking/PlayerItemTrackerMetricPublisherTests.swift#L1
XCTAssertTrue failed - Different count: | Received: (3) [[], [12/7/24, 19:16 - Metadata: 0.000000s (experience), 0.000022s (service)], [12/7/24, 19:16 - Metadata: 0.000000s (experience), 0.000022s (service), [00:00:00] 12/7/24, 19:16 - Asset: 0.490553s (experience)]] | Expected: (4) [[], [12/7/24, 19:16 - Metadata: 0.000000s (experience), 0.000000s (service)], [12/7/24, 19:16 - Metadata: 0.000000s (experience), 0.000000s (service), 12/7/24, 19:16 - Asset: 0.000000s (experience)], [12/7/24, 19:16 - Metadata: 0.000000s (experience), 0.000000s (service), 12/7/24, 19:16 - Asset: 0.000000s (experience)]] (/Users/runner/work/pillarbox-apple-github-runner-poc/pillarbox-apple-github-runner-poc/Tests/PlayerTests/Tracking/PlayerItemTrackerMetricPublisherTests.swift#EndingLineNumber=40&StartingLineNumber=40)
CurrentItemTests.testCurrentItemWithMiddleFailedItem(): Tests/PlayerTests/Playlist/CurrentItemTests.swift#L1
XCTAssertTrue failed - Different count: | Received: (1) [Optional(E1CD8F58-18CF-42DB-9384-78AB85C84745)] | Expected: (2) [Optional(E1CD8F58-18CF-42DB-9384-78AB85C84745), Optional(830DDDDE-090C-4B09-8EEA-C8EC82FDFEC0)] (/Users/runner/work/pillarbox-apple-github-runner-poc/pillarbox-apple-github-runner-poc/Tests/PlayerTests/Playlist/CurrentItemTests.swift#EndingLineNumber=44&StartingLineNumber=44)
🧪 Tests (tvos)
testPlaylist on 'Clone 1 of Apple TV - xctest (14085)' (2.871 seconds)
🧪 Tests (tvos)
testPlaylist on 'Clone 1 of Apple TV - xctest (14085)' (2.024 seconds)
🧪 Tests (tvos)
testPlaylist on 'Clone 1 of Apple TV - xctest (14085)' (2.027 seconds)
🧪 Tests (tvos)
testPlaylist on 'Clone 1 of Apple TV - xctest (14085)' (2.020 seconds)
🧪 Tests (tvos)
testEntirePlayback on 'Clone 1 of Apple TV - xctest (14085)' (2.016 seconds)
🧪 Tests (tvos)
testCurrentItemWithMiddleFailedItem on 'Clone 1 of Apple TV - xctest (14085)' (2.020 seconds)
🧪 Tests (tvos)
testCurrentItemWithMiddleFailedItem on 'Clone 1 of Apple TV - xctest (14085)' (2.020 seconds)
🧪 Tests (tvos)
testCurrentItemWithMiddleFailedItem on 'Clone 1 of Apple TV - xctest (14085)' (2.033 seconds)
🧪 Tests (tvos)
testCurrentItemWithMiddleFailedItem on 'Clone 1 of Apple TV - xctest (14085)' (2.018 seconds)
🧪 Tests (tvos)
Process completed with exit code 2.
🧪 Tests (tvos)
❌ Tests reported 2 failures
ProgressTrackerTimeTests.testEntirePlayback(): Tests/PlayerTests/ProgressTracker/ProgressTrackerTimeTests.swift#L1
XCTAssertTrue failed - Expected: [__C.CMTime(value: 0, timescale: 0, flags: __C.CMTimeFlags(rawValue: 0), epoch: 0), __C.CMTime(value: 0, timescale: 1, flags: __C.CMTimeFlags(rawValue: 1), epoch: 0), __C.CMTime(value: 1, timescale: 4, flags: __C.CMTimeFlags(rawValue: 1), epoch: 0), __C.CMTime(value: 1, timescale: 2, flags: __C.CMTimeFlags(rawValue: 1), epoch: 0), __C.CMTime(value: 3, timescale: 4, flags: __C.CMTimeFlags(rawValue: 1), epoch: 0), __C.CMTime(value: 1, timescale: 1, flags: __C.CMTimeFlags(rawValue: 1), epoch: 0), __C.CMTime(value: 0, timescale: 0, flags: __C.CMTimeFlags(rawValue: 0), epoch: 0)], actual: [__C.CMTime(value: 0, timescale: 0, flags: __C.CMTimeFlags(rawValue: 0), epoch: 0)] (/Users/runner/work/pillarbox-apple-github-runner-poc/pillarbox-apple-github-runner-poc/Tests/PlayerTests/ProgressTracker/ProgressTrackerTimeTests.swift#EndingLineNumber=52&StartingLineNumber=52)
🧪 Tests (ios)
❌ Tests reported 1 failures
🧪 Tests (ios)
testDestroyDuringDvrPlayback on 'Clone 1 of iPhone 16 - xctest (13297)' (43.433 seconds)
🧪 Tests (ios)
testEntirePlayback on 'Clone 1 of iPhone 16 - xctest (21479)' (2.841 seconds)
🧪 Tests (ios)
testEntirePlayback on 'Clone 1 of iPhone 16 - xctest (21479)' (2.019 seconds)
🧪 Tests (ios)
testEntirePlayback on 'Clone 1 of iPhone 16 - xctest (21479)' (2.010 seconds)
🧪 Tests (ios)
testEntirePlayback on 'Clone 1 of iPhone 16 - xctest (21479)' (2.010 seconds)
🧪 Tests (ios)
Process completed with exit code 2.