Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add new 2023Q3 4K SDR 240FPS Scenes #55

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

kubedzero
Copy link
Contributor

NOTE: NOT READY FOR RELEASE

After Apple's September keynote, I saw some updates in a conversation https://gist.github.com/theothernt/57a51cade0c12c407f48a5121e0939d5 showing a new Resources TAR, in which is a new entries.json file. http://sylvan.apple.com/itunes-assets/Aerials126/v4/82/2e/34/822e344c-f5d2-878c-3d56-508d5b09ed61/resources-14-0-10.tar is the link to this file

The file is not a direct replacement for https://sylvan.apple.com/Aerials/resources-15.tar as it only includes links to 4K SDR 240FPS videos, tagged url-4K-SDR-240FPS and containing none of old url-4K-SDR or url-1080-H264 and the like.

That said, it does introduce 20 new scenes, totaling 134 videos and ~64GB, specifically 64676.105332 MB:

  • New AccessibilityLabel values: {'California Wildflowers', 'Coal Mine Canyon, Arizona', 'California State Route 58, Carrizo Plain, California', 'Secret Beach, Brookings, Oregon', 'Redwoods', 'Factory Butte, Wayne County, Utah', 'Olympia Bar, Lake Powell, Utah', 'Monument Valley, Utah', 'Cazadero', 'Cathedral Canyon, Lake Powell, Utah', 'Del Norte Coast Redwoods State Park, California', 'Twilight, Forbidding, and Cascade Canyon, Lake Powell, Utah', 'China Beach, Curry County, Oregon'}
  • New ShotID values: {'W010_C003_F01', 'M007_C007_F01', 'M012_C023_S04', 'S005_C013_F01', 'M005_C017_F01', 'W015_C010_F01', 'R004_C012_F01', 'S011_C003_F01', 'R010_C003_F01', 'W014_C018_F01', 'M010_C009_F01', 'R006_C013_S05', 'S013_C001_F01', 'M010_C005_F01', 'I003_C005', 'S009_C018_F01', 'M013_C012_F01', 'M012_C065_S04', 'W015_C006_F01', 'R013_C039_F01'}

The new Entries file also introduces some new metadata fields: ['localizedNameKey', 'showInTopLevel', 'preferredOrder', 'previewImage', 'id', 'includeInShuffle', 'subcategories']

Changes in this PR:

  • I've updated the helper tools to download and checksum all these new files.
  • Consequently, the checksums.json file now has checksums for all 134 new files in addition to all the old files
  • The entries.json file has been augmented with the new metadata and the 134 new videos
    • I also formatted the entries.json file with Prettier https://prettier.io/ prettier entries.json > newEntries.json && mv newEntries.json entries.json to get a reliable, repeatable output formatting for easier future diffing. The two commits in this PR show the difference.
  • A helper script updateEntriesJson.py was added to assist in merging the existing, manually curated entries.json and any new JSON Apple decides to release
  • The offline.py and commonatv.py files have been updated to download the new 4K SDR 240FPS files, ranking them above the 30FPS 4K SDR files.
    • NOTE: This seems to break playback on some hardware. There's nothing special with the encoding of the new files, it just seems to be that 240FPS playback is unachievable for many types of hardware, or the software decoders. In Kodi I was able to see playback, but hundreds to thousands of frames were dropping/skipping, leading to choppy results. Playing the 240FPS videos in VLC led to the first frame being shown, and then nothing afterwards. It could just be my old hardware (Intel 6600K and Nvidia GTX 970), but I'm not sure. Playing the same content on an M1 Macbook Pro results in flawless playback.

TODOs:

  • I think it would be responsible to add the new 240FPS files under a new settings HFR (high-refresh-rate) toggle, so Aerials users with older or slower hardware can avoid the potentially-breaking videos. I do not have the time at the moment to add the new toggles and all the localizations, but the bones of the video fetching are ready to go.

Bonus: MediaInfo snippets from a 4K SDR 30FPS file downloaded from Apple, and its 240FPS equivalent:

Format                                   : HEVC
Format/Info                              : High Efficiency Video Coding
Format profile                           : Main 10@L5@High
Codec ID                                 : hvc1
Codec ID/Info                            : High Efficiency Video Coding
Duration                                 : 4 min 1 s
Bit rate                                 : 12.3 Mb/s
Width                                    : 3 840 pixels
Height                                   : 2 160 pixels
Frame rate mode                          : Constant
Frame rate                               : 29.970 (30000/1001) FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 10 bits
Bits/(Pixel*Frame)                       : 0.050
Stream size                              : 354 MiB (100%)
Tagged date                              : UTC 2019-07-24 10:21:28
Color range                              : Limited
Color primaries                          : BT.709

______

ID                                       : 1
Format                                   : HEVC
Format/Info                              : High Efficiency Video Coding
Format profile                           : Main [email protected]@High
Codec ID                                 : hvc1
Codec ID/Info                            : High Efficiency Video Coding
Duration                                 : 4 min 1 s
Bit rate                                 : 14.2 Mb/s
Width                                    : 3 840 pixels
Height                                   : 2 160 pixels
Display aspect ratio                     : 16:9
Frame rate mode                          : Constant
Frame rate                               : 239.760 (239760/1000) FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 10 bits
Bits/(Pixel*Frame)                       : 0.007
Stream size                              : 409 MiB (100%)
Title                                    : Core Media Video
Encoded date                             : UTC 2023-07-21 16:47:06
Tagged date                              : UTC 2023-07-21 16:54:27
Color range                              : Limited
Color primaries                          : BT.709
Transfer characteristics                 : sRGB/sYCC
transfer_characteristics_Original        : BT.709
Matrix coefficients                      : BT.709
Codec configuration box                  : hvcC

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant