Not working! #1305

leote2001 · 2024-07-26T12:48:32Z

Error when I try to download video.

Dmytro-Tihunov · 2024-07-26T17:40:24Z

the same here #1295

corwin-of-amber · 2024-07-26T17:54:17Z

FWIW A fix was found by this developer, although it would need porting:
https://github.com/distubejs/ytdl-core

Dmytro-Tihunov · 2024-07-26T17:57:59Z

@corwin-of-amber have you managed to implement it ? do you mean ip rotation ? but it works for one ip for once for me

corwin-of-amber · 2024-07-26T18:11:17Z

Interesting, @Dmytro-Tihunov; I have not investigated the fix yet, but it looks like it involves some regex updates, I did not see anything about IPs being mentioned in the commits. I was able to download multiple videos with this, although there seems to be some problem with the sound.
distubejs@3df824e

corwin-of-amber · 2024-07-26T19:29:25Z

Ok, the problem is definitely the nTransform function:

node-ytdl-core/lib/sig.js

Line 57 in 9e15c73

const extractNCode = () => {

which can be extracted with this regexp:
https://github.com/distubejs/ytdl-core/blob/7f7db1062069f13063cf0ee5d652ed33b42e28cb/lib/sig.js#L56

N_TRANSFORM_REGEXP = 'function\\(\\s*(\\w+)\\s*\\)\\s*\\{' +
  'var\\s*(\\w+)=(?:\\1\\.split\\(""\\)|String\\.prototype\\.split\\.call\\(\\1,""\\)),' +
  '\\s*(\\w+)=(\\[.*?]);\\s*\\3\\[\\d+]' +
  '(.*?try)(\\{.*?})catch\\(\\s*(\\w+)\\s*\\)\\s*\\' +
  '{\\s*return"enhanced_except_([A-z0-9-]+)"\\s*\\+\\s*\\1\\s*}' +
  '\\s*return\\s*(\\2\\.join\\(""\\)|Array\\.prototype\\.join\\.call\\(\\2,""\\))};';

corwin-of-amber · 2024-07-26T19:39:14Z

I was able to get the correct sig by replacing the function extractNCode above with:

  const extractNCode = () => {
    const N_TRANSFORM_REGEXP = 'function\\(\\s*(\\w+)\\s*\\)\\s*\\{' +
      'var\\s*(\\w+)=(?:\\1\\.split\\(""\\)|String\\.prototype\\.split\\.call\\(\\1,""\\)),' +
      '\\s*(\\w+)=(\\[.*?]);\\s*\\3\\[\\d+]' +
      '(.*?try)(\\{.*?})catch\\(\\s*(\\w+)\\s*\\)\\s*\\' +
      '{\\s*return"enhanced_except_([A-z0-9-]+)"\\s*\\+\\s*\\1\\s*}' +
      '\\s*return\\s*(\\2\\.join\\(""\\)|Array\\.prototype\\.join\\.call\\(\\2,""\\))};';

    let mo = body.match(new RegExp(N_TRANSFORM_REGEXP, 's'));
    if (mo) {
      let fnbody = mo[0];
      functions.push('var nxx=' + fnbody + 'nxx(ncode);');
    }
  };

Although this is a crude patch and is not idiomatic to this library. Should think of something cleaner.

corwin-of-amber · 2024-07-26T19:53:25Z

Better patch (although I am not sure how robust) — replace

node-ytdl-core/lib/sig.js

Line 58 in 9e15c73

let functionName = utils.between(body, `&&(b=a.get("n"))&&(b=`, `(b)`);

with

    let functionName = utils.between(body, 'c=a.get(b))&&(c=', '(c)');

…issues/1305\#issuecomment-2253373635 and rebuild

benkaiser · 2024-07-28T23:37:31Z

Sadly the above patches seem to fix some low quality formats but not others. On an example video (v=1ec4gu5uJ6U) I was able to load the 360p mp4 and the 144p mp4, but all others returned a 403.

AnneAlbert-wt · 2024-07-29T10:03:51Z

Better patch (although I am not sure how robust) — replace

node-ytdl-core/lib/sig.js

Line 58 in 9e15c73

let functionName = utils.between(body, `&&(b=a.get("n"))&&(b=`, `(b)`);

with
    let functionName = utils.between(body, 'c=a.get(b))&&(c=', '(c)');

This one works for me, thanks. Last time this 403 errors were thrown I switched to the distube fork of ytdl ([https://github.com/distubejs/ytdl-core]), which worked but now throws 403 errors as well. Switching back to ytdl-core with this functionName fix works.

…y code. See fent/node-ytdl-core#1305

hextor1 · 2024-08-01T04:13:52Z

again not working, youtube again updated their algorithm. @corwin-of-amber
suddenly stop working to download youtube videos and audio

gatecrasher777 · 2024-08-02T10:55:23Z

The n code extraction is one issue.
The 403 on GET method requests which affects videos longer than 1 minute is another issue.
GET requests still work on 360p default format streams (with audio included) but not on adaptive formats.
The challenge seems to be to convert GET requests to POST requests, otherwise the best quality you will get is 360p.

hextor1 · 2024-08-02T10:58:12Z

The n code extraction is one issue. The 403 on GET method requests which affects videos longer than 1 minute is another issue. GET requests still work on 360p default format streams (with audio included) but not on adaptive formats. The challenge seems to be to convert GET requests to POST requests, otherwise, the best quality you will get is 360p.

SO whats should we do now? is there any solution?

gatecrasher777 · 2024-08-02T11:44:00Z

SO whats should we do now? is there any solution?

There will always be a solution. The solution here will be to emulate what the YouTube site code does in the browser to fetch the streams. But that could take awhile to figure out and code. The POST requests also seem to include some encrypted payload, so a tricky exercise.

AnneAlbert-wt · 2024-08-02T21:29:37Z

Using @distube/ytdl-core (v 4.13.7) works for us on some devices but not all... someone suggested that google is doing some A/B testing

corwin-of-amber · 2024-08-03T14:39:04Z

Regarding the nTransform function:
Using the Wayback Machine (https://web.archive.org/) I was able to look at previous versions of the player. The assignment syntax varies, but in the 6 versions I observed at least two things remain constant:

The function containing the invocation has some recognizable string literals, notably "index.m3u8".
The call is followed by a .set(. E.g., c=BDa[0](c),a.set(b,c). The variable names may change, and b is usually just "n", but the .set( remains.

Given this, I propose using a regex to capture this convention, in the hopes that it will give us some breathing space for the near future. WDYT?

hextor1 · 2024-08-03T14:47:45Z

So what's the solution? @corwin-of-amber

corwin-of-amber · 2024-08-03T14:55:44Z

Currently, it looks like this:

    let mo = body.match(/index\.m3u8".*=(.*?)[.]set\(/);
    let functionName = mo && mo[1].split('(')[0];

hextor1 · 2024-08-03T15:06:14Z

Hello can you tell me which line i need to be replaced? And also let me know the file name where i add this? Please share the full code here and also add this? @corwin-of-amber

corwin-of-amber · 2024-08-03T15:41:38Z

Same as here @hextor1
#1305 (comment)

I.e. this is the line that needs to be replaced with the two lines above:

node-ytdl-core/lib/sig.js

Line 58 in 9e15c73

let functionName = utils.between(body, `&&(b=a.get("n"))&&(b=`, `(b)`);

↓

    let mo = body.match(/index\.m3u8".*=(.*?)[.]set\(/);
    let functionName = mo && mo[1].split('(')[0];

I want to see that it keeps working at least for a few days before suggesting this is a patch.

hextor1 · 2024-08-03T15:45:34Z

Hello this line i need to be add it here
let functionName = mo && mo[1].split('(')[0];

Will i need to be replaced 58 line?
@corwin-of-amber

hextor1 · 2024-08-03T16:32:31Z

Here is my previous code please tell me where I do replace this code:

let mo = body.match(/index.m3u8".=(.?)[.]set(/);
let functionName = mo && mo[1].split('(')[0];

Old code
const extractNCode = () => {
let functionName = utils.between(body, 'b=a.j.n||null)&&(b=', '(b)');
if (functionName.includes('[')) functionName = utils.between(body, var ${functionName.split('[')[0]}=[, ]);
if (functionName && functionName.length) {
const functionStart = ${functionName}=function(a);
const ndx = body.indexOf(functionStart);
if (ndx >= 0) {
const subBody = body.slice(ndx + functionStart.length);
const functionBody = var ${functionStart}${utils.cutAfterJS(subBody)};${functionName}(ncode);;
functions.push(functionBody);
}
}
};

gatecrasher777 · 2024-08-03T17:05:54Z

In #1301 I did propose the following which avoids the problem of the nCode function name being obfuscated in everchanging layers of difficulty, by identifying the nCode block directly and thus determining its function name.

 const extractNCode = () => {
    const alphanum = 'abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTVUWXYZ.$_0123456789';
    let functionName = '';
    let clue = body.indexOf('enhanced_except');
    if (clue < 0) clue = body.indexOf('String.prototype.split.call(a,"")');
    if (clue < 0) clue = body.indexOf('Array.prototype.join.call(b,"")');
    if (clue > 0) {
        let nstart = body.lastIndexOf('=function(a){', clue) - 1;
        while (nstart && alphanum.includes(body.charAt(nstart))) {
	    functionName = body.charAt(nstart) + functionName;
	    nstart--;
        }
    }
    if (functionName && functionName.length) {
      const functionStart = `${functionName}=function(a)`;
      const ndx = body.indexOf(functionStart);
      if (ndx >= 0) {
        const subBody = body.slice(ndx + functionStart.length);
        const functionBody = `var ${functionStart}${utils.cutAfterJS(subBody)};${functionName}(ncode);`;
        functions.push(functionBody);
      }
    }
  };

To reiterate: the 403 errors have nothing to do with the n transformation.

hextor1 · 2024-08-03T18:13:04Z

This one little bit better patch than previous
@corwin-of-amber @gatecrasher777
const extractNCode = () => {
let functionName = utils.between(body, 'b=a.j.n||null)&&(b=', '(b)');
if (functionName.includes('[')) functionName = utils.between(body, var ${functionName.split('[')[0]}=[, ]);
if (functionName && functionName.length) {
const functionStart = ${functionName}=function(a);
const ndx = body.indexOf(functionStart);
if (ndx >= 0) {
const subBody = body.slice(ndx + functionStart.length);
const functionBody = var ${functionStart}${utils.cutAfterJS(subBody)};${functionName}(ncode);;
functions.push(functionBody);
}
}
};

gatecrasher777 · 2024-08-03T18:37:24Z

This one little bit better patch than previous

Sure, it will give the right result for now, but it is still trying to find the function name from a moving target.

hextor1 · 2024-08-03T18:47:30Z

You right sometime its find the function when I will refresh the page then its work. i hope in future some found better and accurate solution? @gatecrasher777

corwin-of-amber · 2024-08-03T20:31:03Z

I agree with @gatecrasher777, my last patch is still heuristic, but I have tried it against the last 6 versions of player_ias (dates 05-28, 06-04, 06-05, 07-05, 07-15, 08-03) and it works consistently on all of them. The "clue" approach that is based on knowing a piece of the function code is also something that I considered. It is hard to say which is more robust/less brittle. Perhaps we need to try both and collect statistics?

Also, I would like to state that failing to find the n-transform function does indeed result in a 403 error; although, there may be other 403 errors that occur even with the right n-transform (esp. with high-bitrate formats).

gatecrasher777 · 2024-08-07T14:42:49Z

@corwin-of-amber
Another breaking change occurred today.
Your code in jsfiddle...

let utils = {
	between: (haystack, left, right) => {
    let pos;
    if (left instanceof RegExp) {
      const match = haystack.match(left);
      if (!match) { return ''; }
      pos = match.index + match[0].length;
    } else {
      pos = haystack.indexOf(left);
      if (pos === -1) { return ''; }
      pos += left.length;
    }
    haystack = haystack.slice(pos);
    pos = haystack.indexOf(right);
    if (pos === -1) { return ''; }
    haystack = haystack.slice(0, pos);
    return haystack;
  }
}
let body = `
var zDa=[Ema];
a.j.file==="index.m3u8"&&(delete a.j.file,a.path+="/file/index.m3u8");a.B="";a.url="";a.D&&(b="nn"[+a.D],vL(a),c=a.j[b]||null)&&(c=zDa[0](c),a.set(b,c),zDa.length||Ema(""))}};
`;
let mo = body.match(/index\.m3u8".*=(.*?)[.]set\(/);
let functionName = mo && mo[1].split('(')[0];
if (functionName.includes('[')) functionName = utils.between(body, `var ${functionName.split('[')[0]}=[`, `]`);
console.log(functionName);

Outputs Ema which is correct. The clue method also worked btw.

hextor1 · 2024-08-07T16:30:24Z

@corwin-of-amber Another breaking change occurred today. Your code in jsfiddle...

let utils = {
	between: (haystack, left, right) => {
    let pos;
    if (left instanceof RegExp) {
      const match = haystack.match(left);
      if (!match) { return ''; }
      pos = match.index + match[0].length;
    } else {
      pos = haystack.indexOf(left);
      if (pos === -1) { return ''; }
      pos += left.length;
    }
    haystack = haystack.slice(pos);
    pos = haystack.indexOf(right);
    if (pos === -1) { return ''; }
    haystack = haystack.slice(0, pos);
    return haystack;
  }
}
let body = `
var zDa=[Ema];
a.j.file==="index.m3u8"&&(delete a.j.file,a.path+="/file/index.m3u8");a.B="";a.url="";a.D&&(b="nn"[+a.D],vL(a),c=a.j[b]||null)&&(c=zDa[0](c),a.set(b,c),zDa.length||Ema(""))}};
`;
let mo = body.match(/index\.m3u8".*=(.*?)[.]set\(/);
let functionName = mo && mo[1].split('(')[0];
if (functionName.includes('[')) functionName = utils.between(body, `var ${functionName.split('[')[0]}=[`, `]`);
console.log(functionName);

Outputs Ema which is correct. The clue method also worked btw.

Where is placed? share file location with line no

gatecrasher777 · 2024-08-07T18:31:39Z

Where is placed? share file location with line no

There is no file. It is just some shorthand code to test @corwin-of-amber's functionName extraction method.
You can paste it into the javascript box on https://jsfiddle.net/ and run it.

This was referenced Jul 26, 2024

403 error it stopped working #1295

Open

Unable to extract nCode from base.js #1301

Open

benkaiser referenced this issue in benkaiser/ytdl-core-info-browser Jul 28, 2024

Manually patch ytdl-core from https://github.com/fent/node-ytdl-core/…

a748a00

…issues/1305\#issuecomment-2253373635 and rebuild

mjasiukiewicz mentioned this issue Jul 29, 2024

Not working - Erro 403 1Marcuth/ytdl-native#1

Open

RafRunner added a commit to RafRunner/Sophi that referenced this issue Jul 30, 2024

fix: going back to using ytdl-core. It needs direct changes in librar…

a14669c

…y code. See fent/node-ytdl-core#1305

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Not working! #1305

Not working! #1305

leote2001 commented Jul 26, 2024

Dmytro-Tihunov commented Jul 26, 2024 •

edited

Loading

corwin-of-amber commented Jul 26, 2024

Dmytro-Tihunov commented Jul 26, 2024

corwin-of-amber commented Jul 26, 2024

corwin-of-amber commented Jul 26, 2024 •

edited

Loading

corwin-of-amber commented Jul 26, 2024

corwin-of-amber commented Jul 26, 2024

benkaiser commented Jul 28, 2024

AnneAlbert-wt commented Jul 29, 2024

hextor1 commented Aug 1, 2024

gatecrasher777 commented Aug 2, 2024

hextor1 commented Aug 2, 2024

gatecrasher777 commented Aug 2, 2024

AnneAlbert-wt commented Aug 2, 2024

corwin-of-amber commented Aug 3, 2024

hextor1 commented Aug 3, 2024

corwin-of-amber commented Aug 3, 2024 •

edited

Loading

hextor1 commented Aug 3, 2024 •

edited

Loading

corwin-of-amber commented Aug 3, 2024 •

edited

Loading

hextor1 commented Aug 3, 2024

hextor1 commented Aug 3, 2024

gatecrasher777 commented Aug 3, 2024

hextor1 commented Aug 3, 2024

gatecrasher777 commented Aug 3, 2024

hextor1 commented Aug 3, 2024

corwin-of-amber commented Aug 3, 2024

gatecrasher777 commented Aug 7, 2024

hextor1 commented Aug 7, 2024

gatecrasher777 commented Aug 7, 2024

Not working! #1305

Not working! #1305

Comments

leote2001 commented Jul 26, 2024

Dmytro-Tihunov commented Jul 26, 2024 • edited Loading

corwin-of-amber commented Jul 26, 2024

Dmytro-Tihunov commented Jul 26, 2024

corwin-of-amber commented Jul 26, 2024

corwin-of-amber commented Jul 26, 2024 • edited Loading

corwin-of-amber commented Jul 26, 2024

corwin-of-amber commented Jul 26, 2024

benkaiser commented Jul 28, 2024

AnneAlbert-wt commented Jul 29, 2024

hextor1 commented Aug 1, 2024

gatecrasher777 commented Aug 2, 2024

hextor1 commented Aug 2, 2024

gatecrasher777 commented Aug 2, 2024

AnneAlbert-wt commented Aug 2, 2024

corwin-of-amber commented Aug 3, 2024

hextor1 commented Aug 3, 2024

corwin-of-amber commented Aug 3, 2024 • edited Loading

hextor1 commented Aug 3, 2024 • edited Loading

corwin-of-amber commented Aug 3, 2024 • edited Loading

hextor1 commented Aug 3, 2024

hextor1 commented Aug 3, 2024

gatecrasher777 commented Aug 3, 2024

hextor1 commented Aug 3, 2024

gatecrasher777 commented Aug 3, 2024

hextor1 commented Aug 3, 2024

corwin-of-amber commented Aug 3, 2024

gatecrasher777 commented Aug 7, 2024

hextor1 commented Aug 7, 2024

gatecrasher777 commented Aug 7, 2024

Dmytro-Tihunov commented Jul 26, 2024 •

edited

Loading

corwin-of-amber commented Jul 26, 2024 •

edited

Loading

corwin-of-amber commented Aug 3, 2024 •

edited

Loading

hextor1 commented Aug 3, 2024 •

edited

Loading

corwin-of-amber commented Aug 3, 2024 •

edited

Loading