Exception: it seems 'yarn' is not installed/available on your system

[modmt]

Hello all,

I have a problem compiling the .bin for WT32-ETH01 to update my old firmware from last year.

In Visual Studio Code I get an error that yarn is missing. But yarn is installed on the computer. By entering yarn -v i get the version 4.4.1. Also the right folder is added to the system nvironment variables (PATH).

I checked it on two computers, but always got the same error.
When I compiled the old firmware mid 2023 i had no problems with it.

Also the build of the webApp seems to work (?).
I also can find yarn -v inside the PlatformIO Terminal or the shell environment (s. Screenshot).

Only the compiliation does not work.

Does someone has an idea what could be the problem?

Unfortunately there is no precompiled firmware that I can use on github for the WT32-ETH01, so there is no way around for me to compile.

Or would it be possible to also put the pre-compiled bins for the WT32-ETH01 on github?

Thank you.
Matthias

[spcqike]

When I compiled the old firmware mid 2023 i had no problems with it.

because the pre:script wasn't there at this time.

if you have a working webapp, you can simply disable said pre:script
https://github.com/helgeerbe/OpenDTU-OnBattery/blob/9067acdab768b5581c28dd4288c595693c8d1dab/platformio.ini#L53

which was introduces one or two weeks ago, because of several "firmware not working" issues, where the webapp wasn't compiled beforehand by the user.

[modmt]

Thank you spcqike for your quick reply!
I commented out the line 53 and now compiling works without problems :-)

Problem solved! Thanks again :-)

[schlimmchen]

Hold on... So the script prevented you from building a firmware with an outdated webapp and complaining that the webapp/firmware would not work as expected. Good for us. spcqike helped you work around the issue. Good for you.

However, the pre-script should work inside vscode as well. That's expected. So how can this be a problem?

Please tell me: Does the issue persist after you restarted vscode after installing yarn? How did you install yarn/nodejs and did you install it "locally" or something like that?

[modmt]

Hello schlimmchen, the issue also persits after i restarted vscode. I also tried different versions of yarn/nodejs, installed it manually with msi files, deinstalled it, installed it globally via npm, checked the system environmentals, restarted system,...nothing worked.

After uncommenting line 53, building the web app and then compiling, everything works as expected.
The new FW is now flashed to the WT32-ETH01 and everything works fine :-)

[spcqike]

everything works as expected.

well, the workaround works as expected.
the intention of said pre:script was to reduce issues and requests about not working, self compiled firmwares (because of outdated webapp, which needed to be compiled beforehand and manually). it shouldn't create new issues :)

@schlimmchen do you have an idea of what could be wrong? we could handle such errors gracefully in the script and create a warning, that something is missing, the webapp probably is outdated and the firmware might not work as expected. but i guess, most users won't read the compiling logs and most likely ignore the warning. would they?

[schlimmchen]

The exception already is explicit about the cause: yarn ist not available. I expect people who try to compile themselves to understand that message.

I dont know whats wrong with his setup... I would assume that yarn is available in vscode if it is available in the PowerShell.

[Snoopy-HSS]

INFO: testing for up-to-date webapp artifacts
INFO: compiling webapp (hang on, this can take a while and there might be little output)...
Traceback (most recent call last):
File "c:\Users\hss\OneDrive\Elektronik\OpenDTU-OnBattery-SBS2\pio-scripts\compile_webapp.py", line 38, in check_files
subprocess.check_output([yarn, "--version"])
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.11_3.11.2544.0_x64__qbz5n2kfra8p0\Lib\subprocess.py", line 466, in check_output
return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.11_3.11.2544.0_x64__qbz5n2kfra8p0\Lib\subprocess.py", line 548, in run
with Popen(*popenargs, **kwargs) as process:
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.11_3.11.2544.0_x64__qbz5n2kfra8p0\Lib\subprocess.py", line 1026, in init
self._execute_child(args, executable, preexec_fn, close_fds,
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.11_3.11.2544.0_x64__qbz5n2kfra8p0\Lib\subprocess.py", line 1538, in _execute_child
hp, ht, pid, tid = _winapi.CreateProcess(executable, args,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
FileNotFoundError: [WinError 2] Das System kann die angegebene Datei nicht finden

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "c:\Users\hss\OneDrive\Elektronik\OpenDTU-OnBattery-SBS2\pio-scripts\compile_webapp.py", line 42, in check_files
subprocess.check_output([yarn, "--version"])
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.11_3.11.2544.0_x64__qbz5n2kfra8p0\Lib\subprocess.py", line 466, in check_output
return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.11_3.11.2544.0_x64__qbz5n2kfra8p0\Lib\subprocess.py", line 548, in run
with Popen(*popenargs, **kwargs) as process:
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.11_3.11.2544.0_x64__qbz5n2kfra8p0\Lib\subprocess.py", line 1026, in init
self._execute_child(args, executable, preexec_fn, close_fds,
File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.11_3.11.2544.0_x64__qbz5n2kfra8p0\Lib\subprocess.py", line 1538, in _execute_child
hp, ht, pid, tid = _winapi.CreateProcess(executable, args,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
FileNotFoundError: [WinError 2] Das System kann die angegebene Datei nicht finden

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "c:\Users\hss\OneDrive\Elektronik\OpenDTU-OnBattery-SBS2\pio-scripts\compile_webapp.py", line 71, in
main()
File "c:\Users\hss\OneDrive\Elektronik\OpenDTU-OnBattery-SBS2\pio-scripts\compile_webapp.py", line 69, in main
check_files(directories, files, hash_file)
File "c:\Users\hss\OneDrive\Elektronik\OpenDTU-OnBattery-SBS2\pio-scripts\compile_webapp.py", line 44, in check_files
raise Exception("it seems neither 'yarn' nor 'yarnpkg' is installed/available on your system")
Exception: it seems neither 'yarn' nor 'yarnpkg' is installed/available on your system

[ghost]

"Exception: it seems 'yarn' is not installed/available on your system:"

I have the same problem, I want to compile my own version and do not even know what to H yarn is !?!?
( I only compile and I am no programmer, I only change something into the Plattform IO Override eg. the use of [env:opendtufusionv2]
or -DBOARD_HAS_PSRAM=1 and so on. )

The Workaround:
"After uncommenting line 53, building the web app and then compiling, everything works as expected."

Do not work....

I get now:

Compiling .pio\build\opendtufusionv2__compiled_constants.c.o
*** [.pio\build\opendtufusionv2\index.html.gz.txt.o] Source webapp_dist\index.html.gz' not found, needed by target .pio\build\opendtufusionv2\index.html.gz.txt.o'.

and

• toolchain-xtensa-esp32s3 @ 8.4.0+2021r2-patch5
  Warning! Could not find file "index.html.gz"
  Warning! Could not find file "zones.json.gz"
  Warning! Could not find file "favicon.ico"
  Warning! Could not find file "favicon.png"
  Warning! Could not find file "app.js.gz"
  Warning! Could not find file "site.webmanifest"

I also tried to install many versions of yarn inside VSC "Extensions"....Yarn installer , Yarn-UI, Yarn build, I also I installed Yarn from the Homepage https://yarnpkg.com/

In the end I uninstalled all this because it do not change anything.

I find this should be installed from VSC automatically, like other packages when they are not allready installed.

I will stay at the current Firmware version untill this problem is solved, because currently there is no need for me to Update.

Currently I am on version 2024.8.18 which I had to install over the webinstaller because the compiling problem.

The only difference is that the systeminfo do not show the ammount of PSRAm because the -DBOARD_HAS_PSRAM=1 switch is not set.

May be I find the way to get YARN working in the future...
EDIT: https://www.npmjs.com/package/vscode-yarn .....muss ich mir später mal anschauen.

EDIT2: war sogar schon installiert geht trotzdem nicht....

[spcqike]

Das Problem:
Viele User (wie du) wollen die Firmware compilieren ohne vorher die Webapp zu bauen. Das ist im Wiki beschrieben.

Ohne aktueller und gültiger Webapp kann es sein, dass man entweder eine Firmware bekommt, die nicht korrekt läuft, oder auch gar keine.

Daher das pre-script, welches die webapp automatisch compiliert, wenn nötig. Dafür braucht es zwingend die Abhängigkeiten (die es auch ohne Skript braucht, nur eben muss man es sonst manuell ausführen)

wenn du keine eigenen Anpassungen vornehmen musst oder willst, brauchst du eigentlich keine Firmware selbst kompilieren. Wenn du es doch willst, musst du die webapp bauen.

[ghost]

Das Problem: Viele User (wie du) wollen die Firmware compilieren ohne vorher die Webapp zu bauen. Das ist im Wiki beschrieben.

Ohne aktueller und gültiger Webapp kann es sein, dass man entweder eine Firmware bekommt, die nicht korrekt läuft, oder auch gar keine.

Daher das pre-script, welches die webapp automatisch compiliert, wenn nötig. Dafür braucht es zwingend die Abhängigkeiten (die es auch ohne Skript braucht, nur eben muss man es sonst manuell ausführen)

wenn du keine eigenen Anpassungen vornehmen musst oder willst, brauchst du eigentlich keine Firmware selbst kompilieren. Wenn du es doch willst, musst du die webapp bauen.

Daher werde ich das erstmal liegen lassen bis ich Zeit habe mich ernsthaft damit zu beschäftigen, ich denke das ich das schon irgendwie hinbekommen. Wenn das in der Wiki drin ist dann wäre das schonmal eine große Hilfe ;)

[ghost]

EDIT: https://opendtu-onbattery.net/firmware/compile_webapp/

Ich vermute das das die Lösung ist.

[Snoopy-HSS]

Habe das gleiche Problem
Yarn funktioniert wenn ich yarn build ausführe, aber das PRE-Script meint, yarn wäre nicht installiert...

VS Code
Windows 11
Yarn 1.22 nuestes node

[schlimmchen]

Das müssen wir definitiv in den Griff kriegen. Ich werde meine VM bemühen und den Fehler reproduzieren, und dann hoffentlich beheben. Ich hab schon erste Versuche mit ChatGPT und Google hinter mit, das Problem zu verstehen, was aber leider nicht geklappt hat. Es ist merkwürdig, dass yarn zwar installiert ist und in cmd/powershell verfügbar ist, aber im environment innerhalb von vscode plötzlich nicht mehr...

[ghost]

My Solution: I go back to 24.6.3. if I want to change something for my needs.

The description in https://opendtu-onbattery.net/firmware/compile_webapp/
is useless for me as an Windows User....it is made for linux it seems.

"Afterwards the app will be build. Start a Terminal of your choice and enter the following commands:

cd webapp
yarn install
yarn build"

"Start the Terminal of your choice" great all for Linux....only Linux has this kind of terminals, in windows there is only the command prompt CMD and this is not the same as in Linux. I will wait until this is working all inside VSC directly and not over several Tools you have to install externally. It is super frustrating if you have many How to's and nothing works . I will now uninstall all the yarn tools in VSC and Python again until there is an better solution to use this under Windows.

[spcqike]

in windows there is only the command prompt CMD and this is not the same as in Linux

have you ever heard of powershell?

It is super frustrating if you have many How to's and nothing works[…]

it’s also super frustrating when there are hundreds of different operating systems and thousands of users with different software installations and just a few freetime and hobby developer shall know and describe everything in detail for everyone.

Come on. You too can use google and try to find out, how to use yarn on your system. If you find a working solution feel free to be part of the community and share your knowledge, describe it in the wiki.

And as I said above: if you don’t need to change anything in the code, I don’t see why you want to compile your own version. Just use the latest release.

And kind of if you know how to change the code and compile, you should know or be able to find out how to compile the webapp

[ghost]

I tryed allredy to google some informations about it, but it doesn't change something because there often HowTo's for Linux and they often do not make any difference between the Operation systems. There is no fast solution for it. Also Snoopy-HSS has the same problem and he allready worked with this yarn. You can not expect that everyone is an perfect programmer which know everything about VSC and all of its Addons. As long there is no good How To for Windows I will let it allone!

"I heard about "powershell" but never use it or read more than the word itself. In the most cases I used CMD Promt for the Windows things I had to do.

Like I said, I will wait until there is some progress in VSC , I also have the option to use the precompiled version in the meantime.

Till now I had never such problems to compile an Github projekt, in the most cases there was an more or less good way out of compiling errors.

I don't want that anyone waste further time on it, I wait some time and I am sure that there comes an better "How To" arround the corner in the future.

[schlimmchen]

As long there is no good How To for Windows I will let it allone!

I don't think it's coming any time soon. The tutorial is good as it is, also for Windows. Your confusion about command line usage not being a thing on Windows is just plain silly. And if I can keep you from trying to build your own firmware and then bitch about it not working smoothly by not making the How-To any more explicit regarding Windows, I think I will do just that 👍

[schlimmchen]

Weiter in #1255.

[github-actions[bot]]

This discussion has been automatically locked since there has not been any recent activity after it was closed. Please open a new discussion for related concerns.