Usage and support of AV1

[firstdorsal]

Hi there!

Using ffmpeg I could convert a test video to multiple resolution AV1 webm videos that I wanted to server with dashjs.
I tried it but the player refuses to play it because some browser feature check fails.

AV1 is supported by chromium and the manifest looks the same for vp9 video or similar so it seems unintuitive that this does not work.

Why is it that AV1 is not supported by dashjs?

[dsilhavy]

Please provide your manifest and also dash.js log outputs. Is your content DRM protected?

[firstdorsal]

Content is not DRM protected.

Audio plays fine.

Manifest:

<?xml version="1.0" encoding="UTF-8"?>
<MPD
  xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
  xmlns="urn:mpeg:DASH:schema:MPD:2011"
  xsi:schemaLocation="urn:mpeg:DASH:schema:MPD:2011"
  type="static"
  mediaPresentationDuration="PT39.992S"
  minBufferTime="PT1S"
  profiles="urn:mpeg:dash:profile:webm-on-demand:2012">
<Period id="0" start="PT0S" duration="PT39.992S" >
<AdaptationSet id="0" mimeType="video/webm" codecs="av1" bitstreamSwitching="false" subsegmentAlignment="true" subsegmentStartsWithSAP="1">
<Representation id="0" bandwidth="1432323" width="640" height="360">
<BaseURL>360.webm</BaseURL>
<SegmentBase
  indexRange="6269245-6269400">
<Initialization
  range="0-707" />
</SegmentBase>
</Representation>
<Representation id="1" bandwidth="5073052" width="1280" height="720">
<BaseURL>720.webm</BaseURL>
<SegmentBase
  indexRange="22989462-22989619">
<Initialization
  range="0-707" />
</SegmentBase>
</Representation>
<Representation id="2" bandwidth="9659282" width="1920" height="1080">
<BaseURL>1080.webm</BaseURL>
<SegmentBase
  indexRange="45052574-45052734">
<Initialization
  range="0-707" />
</SegmentBase>
</Representation>
</AdaptationSet>
<AdaptationSet id="1" mimeType="audio/webm" codecs="opus" lang="eng" audioSamplingRate="48000" bitstreamSwitching="true" subsegmentAlignment="true" subsegmentStartsWithSAP="1">
<Representation id="3" bandwidth="132969">
<BaseURL>audio.webm</BaseURL>
<SegmentBase
  indexRange="677558-677713">
<Initialization
  range="0-689" />
</SegmentBase>
</Representation>
</AdaptationSet>
</Period>
</MPD>

Debug:

[0] Stopping the gap controller 
Debug.js:169 [15][Protection] EME detected on this user agent! (ProtectionModel_21Jan2015) 
Debug.js:169 [15][MediaPlayer] Streaming Initialized 
Debug.js:169 [15][EventController] Start Event Controller 
Debug.js:169 [16][MediaPlayer] Playback Initialized 
Debug.js:169 [16][MediaPlayer] [dash.js 4.5.2] MediaPlayer has been initialized 
Debug.js:169 [32][DashParser] Parsing complete: ( xml2json: 1.00ms, objectiron: 1.00ms, total: 0.00200s) 
Debug.js:169 [33][StreamController] Manifest updated... updating data system wide. 
Debug.js:169 [33][ManifestUpdater] Manifest has been refreshed at Tue Mar 21 2023 18:25:53 GMT+0100 (Central European Standard Time)[1679419553.306]  
3Debug.js:169 [34][CapabilitiesFilter] [Stream] Codec video/webm;codecs="av1" not supported  
Debug.js:169 [34][CapabilitiesFilter] AdaptationSet has been removed because of no supported Representation 
doLog @ Debug.js:169
warn @ Debug.js:132
(anonymous) @ CapabilitiesFilter.js:106
(anonymous) @ CapabilitiesFilter.js:99
Promise.then (async)
(anonymous) @ CapabilitiesFilter.js:98
_filterUnsupportedAdaptationSetsOfPeriod @ CapabilitiesFilter.js:83
(anonymous) @ CapabilitiesFilter.js:76
_filterUnsupportedCodecs @ CapabilitiesFilter.js:75
(anonymous) @ CapabilitiesFilter.js:51
filterUnsupportedFeatures @ CapabilitiesFilter.js:48
_onManifestUpdated @ StreamController.js:1272
(anonymous) @ EventBus.js:124
trigger @ EventBus.js:124
update @ ManifestUpdater.js:222
onManifestLoaded @ ManifestUpdater.js:243
(anonymous) @ EventBus.js:124
trigger @ EventBus.js:124
onXlinkReady @ ManifestLoader.js:91
(anonymous) @ EventBus.js:124
trigger @ EventBus.js:124
onXlinkAllElementsLoaded @ XlinkController.js:193
resolve @ XlinkController.js:128
onXlinkAllElementsLoaded @ XlinkController.js:189
resolve @ XlinkController.js:128
resolveManifestOnLoad @ XlinkController.js:103
success @ ManifestLoader.js:215
onload @ HTTPLoader.js:228
load (async)
request @ XHRLoader.js:94
load @ XHRLoader.js:53
internalLoad @ HTTPLoader.js:310
load @ HTTPLoader.js:356
load @ URLLoader.js:67
load @ ManifestLoader.js:115
load @ StreamController.js:190
_initializePlayback @ MediaPlayer.js:2362
attachSource @ MediaPlayer.js:1864
initialize @ MediaPlayer.js:404
componentDidMount @ Video.tsx:30
await in componentDidMount (async)
(anonymous) @ index.js:301
(anonymous) @ index.js:299
z @ index.js:294
(anonymous) @ component.js:143
g @ component.js:211
(anonymous) @ debounceRendering.js?v=74f6fd22:13
Promise.then (async)
options.debounceRendering @ debounceRendering.js?v=74f6fd22:11
b @ component.js:199
d.setState @ component.js:53
d.setState @ debug.js:382
fileDoubleClick @ App.tsx:259
onDblClick @ File.tsx:30
I @ props.js:150
Show 2 more frames
Debug.js:169 [36][GapController] Starting the gap controller 
Debug.js:169 [37][StreamController] Switch to stream 0. Seektime is 0, current playback time is null. Seamless period switch is set to false 
Debug.js:169 [37][StreamController] MediaSource attached to element.  Waiting on open... 
Debug.js:169 [63][StreamController] MediaSource is open! 
Debug.js:169 [63][MediaSourceController] Set MediaSource duration:39.992 
Debug.js:169 [63][Stream] No video data. 
Debug.js:169 [66][WebmSegmentBaseLoader] Parsing ebml header 
Debug.js:169 [66][Stream] No text data. 
Debug.js:169 [66][Stream] No muxed data. 
Debug.js:169 [66][Stream] No image data. 
Debug.js:169 [68][SourceBufferSink][audio] Updated append window for audio. Set start to 0 and end to 40.001999999999995 

[dsilhavy]

Your codecs string in the manifest looks wrong. The string typically includes a profile and a level, for instance:

MediaSource.isTypeSupported('video/webm;codecs="av01.0.00M.08"')
true
MediaSource.isTypeSupported('video/webm;codecs="av1"')
false

The concrete string depends on the profile and the level you chose and probably also the bit depth: 8bits,10bits,12bits

[firstdorsal]

Thank you! This works! I wonder why ffmpeg only outputs av1 then.

<AdaptationSet id="0" mimeType="video/webm" codecs="av01.0.00M.08" bitstreamSwitching="false" subsegmentAlignment="true" subsegmentStartsWithSAP="1">