Build issue for UnrealEngine on Mac M1 #4848

shkreza · 2021-11-07T18:37:55Z

shkreza
Nov 7, 2021

I'm getting this linker error when building UnrealEngine for Carla on a Mac (using these instructions). I checked the MTLPP wrapper library which was built earlier in the process. The static lib file does have symbols for x86_64 architecture, which makes this error all more mysterious.

Xcode version: 13.1
Arch: Mac mini M1 (although build architecture below is x86_64)

Build error output:

Showing All Messages
Deploying ShaderCompileWorker Mac Development...
Deploying now!
Total execution time: 2.71 seconds
Running Engine/Binaries/DotNET/UnrealBuildTool.exe UE4Editor Mac Development  -architecture=x86_64
Showing All Messages
Building UE4Editor...
Performing 25 actions (8 in parallel)
Copying RadioEffectUnit.component to app bundle
[1/25] Link UE4Editor-MetalRHI.dylib
Undefined symbols for architecture x86_64:
  "typeinfo for mtlpp::CommandQueue", referenced from:
      typeinfo for ns::AutoReleased<mtlpp::CommandQueue> in Module.MetalRHI.1_of_3.cpp.o
  "typeinfo for mtlpp::ComputeCommandEncoder", referenced from:
      typeinfo for ns::AutoReleased<mtlpp::ComputeCommandEncoder> in Module.MetalRHI.1_of_3.cpp.o
  "typeinfo for mtlpp::ParallelRenderCommandEncoder", referenced from:
      typeinfo for ns::AutoReleased<mtlpp::ParallelRenderCommandEncoder> in Module.MetalRHI.1_of_3.cpp.o
  "typeinfo for mtlpp::CommandBuffer", referenced from:
      typeinfo for ns::AutoReleased<mtlpp::CommandBuffer> in Module.MetalRHI.1_of_3.cpp.o
      typeinfo for ns::AutoReleased<mtlpp::CommandBuffer> in Module.MetalRHI.2_of_3.cpp.o
  "typeinfo for mtlpp::Texture", referenced from:
      typeinfo for FMetalTexture in Module.MetalRHI.1_of_3.cpp.o
      typeinfo for ns::AutoReleased<mtlpp::Texture> in Module.MetalRHI.1_of_3.cpp.o
      typeinfo for FMetalTexture in Module.MetalRHI.2_of_3.cpp.o
      typeinfo for ns::AutoReleased<mtlpp::Texture> in Module.MetalRHI.2_of_3.cpp.o
      typeinfo for FMetalTexture in Module.MetalRHI.3_of_3.cpp.o
  "typeinfo for mtlpp::BlitCommandEncoder", referenced from:
      typeinfo for ns::AutoReleased<mtlpp::BlitCommandEncoder> in Module.MetalRHI.2_of_3.cpp.o
  "typeinfo for mtlpp::RenderCommandEncoder", referenced from:
      typeinfo for ns::AutoReleased<mtlpp::RenderCommandEncoder> in Module.MetalRHI.1_of_3.cpp.o
  "typeinfo for mtlpp::Device", referenced from:
      typeinfo for ns::AutoReleased<mtlpp::Device> in Module.MetalRHI.1_of_3.cpp.o
  "typeinfo for mtlpp::Buffer", referenced from:
      typeinfo for FMetalBuffer in Module.MetalRHI.1_of_3.cpp.o
      typeinfo for ns::AutoReleased<mtlpp::Buffer> in Module.MetalRHI.1_of_3.cpp.o
      typeinfo for ns::AutoReleased<mtlpp::Buffer> in Module.MetalRHI.2_of_3.cpp.o
      typeinfo for ns::AutoReleased<mtlpp::Buffer> in Module.MetalRHI.3_of_3.cpp.o
ld: symbol(s) not found for architecture x86_64
/Users/vsa/Code/UnrealEngine/clang:1:1: linker command failed with exit code 1 (use -v to see invocation)

GustavoSilvera · 2022-01-17T04:46:51Z

GustavoSilvera
Jan 17, 2022

Hi, I've been having this same issue (M1 Max, XCode 12.2.1, x86 target) but I found that I could at least bypass this error by switching to this commit c3caf7b6bf12ae4c8e09b606f10a09776b4d1f38 and making all other critical changes myself. Interestingly the carla changes did not seem like they should cause problems but apparently they do.

Then I could build Carla on my M1 and it runs like a champ

15 replies

chchch981 Jan 20, 2022

[1437/1766] Copy libembree.2.14.0.dylib

MkDir /Users/beckk/UnrealEngine-4.62/Engine/Binaries/Mac/UE4Editor.app (in target 'CarlaUE4' from project 'CarlaUE4')
cd /Users/beckk/carla-mac/Unreal/CarlaUE4/Intermediate/ProjectFiles
/bin/mkdir -p /Users/beckk/UnrealEngine-4.62/Engine/Binaries/Mac/UE4Editor.app

warning: Skipping code signing because the target does not have an Info.plist file and one is not being generated automatically. (in target 'CarlaUE4' from project 'CarlaUE4')
** BUILD FAILED **

The following build commands failed:
ExternalBuildToolExecution CarlaUE4_Build (in target 'CarlaUE4_Build' from project 'CarlaUE4')
(1 failure)
make: *** [launch] Error 65

in my file

(carla) beckk@choebaegjin-ui-MacBookAir carla-mac % ls ./Unreal/CarlaUE4/
Binaries CarlaUE4.xcworkspace Intermediate
CarlaUE4.png Config Plugins
CarlaUE4.uproject Content Source

could you give me hand?

I'm very sorry,,

GustavoSilvera Jan 20, 2022

Hi, no worries. I simplified some of the build process for Unreal in my latest commit to the m1 branch. Take a look here. Notably, you can now build Unreal Engine normally (updated docs in build_mac.md).

GustavoSilvera Jan 20, 2022

Update: See PR here

itserror404 Jun 18, 2023

hey were you able to solve this issue? if yes, can you share please?

svenwinkelmann Jun 19, 2023

I solved the infoplist error with: xcodebuild -scheme UE4 -target UE4 -UseModernBuildSystem=YES GENERATE_INFOPLIST_FILE=YES

GustavoSilvera · 2022-01-20T17:45:48Z

GustavoSilvera
Jan 20, 2022

Hi all, so I've managed to locate the bug and create a solution. Here is the PR to the CarlaUnreal fork. For now, I recommend you use this fork and switch to the mac-dev branch.

1 reply

ghost Nov 1, 2022

Hello Gustavo, it seems like the links aren't working anymore. Could you please update them?

chchch981 · 2022-01-22T01:37:01Z

chchch981
Jan 22, 2022

Hello Thanks for your UE4 building Ive don UE4 build for your helping But I have some problem in “make launch” in rosetta x86 My finder said “ can’t open the application What’s problem with me ? My Mac is Mac book air m1 , 8ram, 256 g But I check 130 + GB my storage

…

2022. 1. 21. 오전 3:46, Gustavo Silvera ***@***.***> 작성: Update: See PR here <CarlaUnreal/UnrealEngine#3> — Reply to this email directly, view it on GitHub <#4848 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ASXRC3FT42GHPYIKJXEDJHDUXBJ6XANCNFSM5HRDHRTQ>. You are receiving this because you commented.

1 reply

GustavoSilvera Jan 22, 2022

When you run make launch the UE4.26 executable should launch on its own. But when you run make package it'll create a .app which is essentially a directory, so you'll need to open it up with open in the terminal.

chchch981 · 2022-01-24T06:31:10Z

chchch981
Jan 24, 2022

Hello there I change my laptop for Carla lol to MacBook 14 m1pro Anyway I have problem in brew install --build-from-source mono ==> Installing dependencies for mono: cmake, pkg-config, gdbm, mpdecimal, ca-certificates, ***@***.***, readline, sqlite, xz and ***@***.*** ==> Installing mono dependency: cmake ==> Pouring cmake--3.22.1.arm64_monterey.bottle.tar.gz 🍺 /opt/homebrew/Cellar/cmake/3.22.1: 2,986 files, 41.6MB ==> Installing mono dependency: pkg-config ==> Pouring pkg-config--0.29.2_3.arm64_monterey.bottle.tar.gz 🍺 /opt/homebrew/Cellar/pkg-config/0.29.2_3: 11 files, 676.4KB ==> Installing mono dependency: gdbm ==> Pouring gdbm--1.22.arm64_monterey.bottle.tar.gz 🍺 /opt/homebrew/Cellar/gdbm/1.22: 24 files, 1MB ==> Installing mono dependency: mpdecimal ==> Pouring mpdecimal--2.5.1.arm64_monterey.bottle.tar.gz 🍺 /opt/homebrew/Cellar/mpdecimal/2.5.1: 71 files, 2.2MB ==> Installing mono dependency: ca-certificates ==> Pouring ca-certificates--2021-10-26.all.bottle.tar.gz ==> Regenerating CA certificate bundle from keychain, this may take a while... 🍺 /opt/homebrew/Cellar/ca-certificates/2021-10-26: 3 files, 208.5KB ==> Installing mono dependency: ***@***.*** ==> Pouring ***@***.***_monterey.bottle.tar.gz 🍺 ***@***.***/1.1.1m: 8,081 files, 18MB ==> Installing mono dependency: readline ==> Pouring readline--8.1.2.arm64_monterey.bottle.tar.gz 🍺 /opt/homebrew/Cellar/readline/8.1.2: 48 files, 1.7MB ==> Installing mono dependency: sqlite ==> Pouring sqlite--3.37.2.arm64_monterey.bottle.tar.gz 🍺 /opt/homebrew/Cellar/sqlite/3.37.2: 11 files, 4.3MB ==> Installing mono dependency: xz ==> Pouring xz--5.2.5.arm64_monterey.bottle.tar.gz 🍺 /opt/homebrew/Cellar/xz/5.2.5: 95 files, 1.4MB ==> Installing mono dependency: ***@***.*** ==> Pouring ***@***.***_monterey.bottle.tar.gz ==> ***@***.***/3.10.1/bin/python3 -m ensurepip ==> ***@***.***/3.10.1/bin/python3 -m pip install -v --no-d 🍺 ***@***.***/3.10.1: 3,134 files, 57.9MB ==> Installing mono ==> Patching ==> Applying 3070886a1c5e3e3026d1077e36e67bd5310e0faa.patch patching file packaging/MacSDK/fsharp-layout.sh ==> Applying configure-big_sur.diff patching file configure Hunk #1 succeeded at 10928 (offset 2195 lines). ==> ./configure --prefix=/opt/homebrew/Cellar/mono/6.12.0.122_1 --enable-nls=no ==> make Last 15 lines from /Users/choebaegjin/Library/Logs/Homebrew/mono/02.make: 6 errors generated. make[5]: *** [libmonoutils_la-mono-context.lo] Error 1 make[5]: *** Waiting for unfinished jobs.... mv -f .deps/libmonoutils_la-mono-property-hash.Tpo .deps/libmonoutils_la-mono-property-hash.Plo mv -f .deps/libmonoutils_la-mono-value-hash.Tpo .deps/libmonoutils_la-mono-value-hash.Plo mv -f .deps/libmonoutils_la-lock-free-queue.Tpo .deps/libmonoutils_la-lock-free-queue.Plo mv -f .deps/libmonoutils_la-lock-free-array-queue.Tpo .deps/libmonoutils_la-lock-free-array-queue.Plo mv -f .deps/libmonoutils_la-hazard-pointer.Tpo .deps/libmonoutils_la-hazard-pointer.Plo mv -f .deps/libmonoutils_la-lock-free-alloc.Tpo .deps/libmonoutils_la-lock-free-alloc.Plo mv -f .deps/libmonoutils_la-mono-error.Tpo .deps/libmonoutils_la-mono-error.Plo make[4]: *** [all-recursive] Error 1 make[3]: *** [all] Error 2 make[2]: *** [all-recursive] Error 1 make[1]: *** [all-recursive] Error 1 make: *** [all] Error 2 Why I have this issue … ?

…

2022. 1. 22. 오전 11:54, Gustavo Silvera ***@***.***> 작성: When you run make launch the UE4.26 executable should launch on its own. But when you run make package it'll create a .app which is essentially a directory, so you'll need to open it up with open in the terminal. — Reply to this email directly, view it on GitHub <#4848 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ASXRC3AIH3FOI3QPVWA3FWLUXIL6VANCNFSM5HRDHRTQ>. You are receiving this because you commented.

1 reply

GustavoSilvera Jan 24, 2022

Not sure. Also unsure if you need mono installed manually or if UE4 brings a version of mono packaged with it. But in any case, try looking at this build documentation.

chchch981 · 2022-01-24T23:52:17Z

chchch981
Jan 24, 2022

Okay I skipped this process , I think UE4 brings a version of mono !! I think almost done lastly I have a question. I run 'make package' in rosetta. But I think it has very long time to compile Does this usually take a long time? How long did it take for you?

…

2022. 1. 25. 오전 1:53, Gustavo Silvera ***@***.***> 작성: Not sure. Also unsure if you need mono installed manually or if UE4 brings a version of mono packaged with it. But in any case, try looking at this build documentation <https://www.mono-project.com/docs/compiling-mono/mac/>. — Reply to this email directly, view it on GitHub <#4848 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ASXRC3AGFPG6XTOIM4YX573UXV7Y3ANCNFSM5HRDHRTQ>. You are receiving this because you commented.

5 replies

GustavoSilvera Jan 25, 2022

Yes, make package takes a while (and sometimes hangs, in which case just press enter on the keyboard). For me it took ~1h the first time and quicker afterwards (once most things were cooked and cached).

chchch981 Jan 25, 2022

hi I think I install almost done !

but I have different egg. not carla-0.9.13-py3.8-macosx-11.0-arm64.egg but in my, carla-0.9.13-py3.8-macosx-10.9-x86_64.egg

Perhaps that's why there was an error.

every pythonAPI has

ImportError: dlopen(/Users/choebaegjin/Library/Caches/Python-Eggs/carla-0.9.13-py3.8-macosx-10.9-x86_64.egg-tmp/carla/libcarla.cpython-38-darwin.so, 0x0002): symbol not found in flat namespace '_png_create_info_struct'

I did make launch in x86, and then changed arm64.
but my egg file is till x86_64
Can this be a problem?

GustavoSilvera Jan 25, 2022

Hm yeah, this is where it gets a bit tricky but what worked for me is having the make launch in x86 mode. This has the make LibCarla dependency which all gets placed into Build/ then I rename that folder to Build.x86 and switch the mode to arm64 in Environment.sh and run make PythonAPI here. This will create a new Build/ folder and should make the python egg be an arm64.egg. Then note that whenever you make launch again you'll need the old(x86) Build/ folder which you can do by renaming the new one to Build.arm64 and renaming the (old) Build.x86 back to Build/

Hope this helps!

chchch981 Jan 25, 2022

hum I tried follow

dir : carla-mac -> make LibCarla in rosetta terminal
dir : carla-mac -> make launch in rosetta termina

dir : Carla-mac/Utils/BuildTools/Enviroment.sh line 19 : x86_64 ->. arm64

dir : carla-mac -> make LibCarla in terminal
dir : carla-mac -> make PythonAPI in terminal

but still x86_64.egg in dir : carla-mac/PythonAPI/dist

is there any wrong ?

I'm sorry, but don't you want to film it?
Like youtube

GustavoSilvera Jan 26, 2022

Did you make sure to rename the old Build/ directory (from the x86 build) to Build.x86 and then do the arm64 build? then once the arm64 .egg is created you can rename it back

chchch981 · 2022-01-26T03:21:29Z

chchch981
Jan 26, 2022

Yep, but It is still x86_64 I don’t know what is wrong lol..

…

2022. 1. 26. 오전 9:50, Gustavo Silvera ***@***.***> 작성: Did you make sure to rename the old Build/ directory (from the x86 build) to Build.x86 and then do the arm64 build? then once the arm64 .egg is created you can rename it back — Reply to this email directly, view it on GitHub <#4848 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ASXRC3A6LWAD6YXTKWZVUHTUX5AMLANCNFSM5HRDHRTQ>. You are receiving this because you commented.

1 reply

GustavoSilvera Jan 26, 2022

That it weird because I tried it again and it worked for me. Ok maybe try this: restart the Carla repo by cloning a fresh copy and FIRST compiling for arm64 (make PythonAPI) (when the environment is set to arm64 mode) then rename that Build folder to Build.arm64 and set the environment back to x86_64 then run make LibCarla (NOT make PythonAPI) and make launch/package should work as well.

Note this should only affect the .egg in Carla/PythonAPI/Carla/dist/` in the main for, not for a packaged build (you'll need to copy it over)

chchch981 · 2022-01-26T23:35:25Z

chchch981
Jan 26, 2022

## you can see my capture in your mail! Hmm.. I think there’s no wrong point with me.. If I want init all process where should I start now? For installing UE4?

…

2022. 1. 26. 오후 3:26, Gustavo Silvera ***@***.***> 작성: That it weird because I tried it again and it worked for me. Ok maybe try this: restart the Carla repo by cloning a fresh copy and FIRt compiling for arm64 (make PythonAPI) (when the environment is set to arm64 mode) then rename that Build folder to Build.arm64 and set the environment back to x86_64 then run make LibCarla (NOT make PythonAPI) and make launch/package should work as well. — Reply to this email directly, view it on GitHub <#4848 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ASXRC3GIJQ66TFVYSLNMTL3UX6HZPANCNFSM5HRDHRTQ>. You are receiving this because you commented.

2 replies

GustavoSilvera Jan 27, 2022

No, once UE4 is working you're good there. The problem is with the PythonAPI apparently so you should just restart the Carla build as described above. (First do PythonAPI in arm64 mode then switch to x86 and do the normal build (without PythonAPI)).

chchch981 Jan 27, 2022

I solved this problem. !
my Conda has the problem I had installed Conda for x86 so that's why.

https://github.com/conda-forge/miniforge/releases/latest/download/Miniforge3-MacOSX-arm64.sh
I install this Conda so I can find arm64.egg !

lokesh-c-das · 2022-02-22T17:04:35Z

lokesh-c-das
Feb 22, 2022

Hi
I am facing this error while importing carla. I did everything in correct and I have also installed Miniforge3-MaxOSX-arm64.sh

dlopen(/Users/ldas/Library/Caches/Python-Eggs/carla-0.9.13-py3.8-macosx-11.0-arm64.egg-tmp/carla/libcarla.cpython-38-darwin.so, 0x0002): symbol not found in flat namespace '_png_create_info_struct'

Any suggestions would be very helpful.

Thanks

0 replies

yhamadi75 · 2022-11-10T10:13:52Z

yhamadi75
Nov 10, 2022

Hello!
This is a pretty old thread, but I want to install Carla on a Mac M1, and no simple way to do that. The links provided in the discussion above are dead, anyone who went through the same issue is welcome to help!
Also considering going through a windows or linux virtual machine if that's easier!
Thanks,

3 replies

GustavoSilvera Nov 10, 2022

Going through a Linux VM would certainly be easier. But the links in this discussion are mostly all alive? (I haven't found a dead one)

Have you made sure to join the Epic Games organization on GitHub to get access to their github repo/fork links?

newgamerboy Dec 14, 2023

Hi,Gustavo.I tried to build ue4 on arm 64,but when i executed setup.sh, an error occurred: ./Setup.sh
Fixing inconsistent case in filenames.
Setting up Mono

Unhandled Exception:
System.TypeInitializationException: The type initializer for 'GitDependencies.Program' threw an exception. ---> System.TypeInitializationException: The type initializer for 'Sys' threw an exception. ---> System.DllNotFoundException: System.Native assembly: type: member:(null)
at (wrapper managed-to-native) Interop+Sys.LChflagsCanSetHiddenFlag()
at Interop+Sys..cctor () [0x00000] in :0
--- End of inner exception stack trace ---
at Interop.GetRandomBytes (System.Byte* buffer, System.Int32 length) [0x00000] in :0
at System.Guid.NewGuid () [0x00000] in :0
at GitDependencies.Program..cctor () [0x00000] in <0916da07a3c04a6aa2e0f66d38c790da>:0
--- End of inner exception stack trace ---
[ERROR] FATAL UNHANDLED EXCEPTION: System.TypeInitializationException: The type initializer for 'GitDependencies.Program' threw an exception. ---> System.TypeInitializationException: The type initializer for 'Sys' threw an exception. ---> System.DllNotFoundException: System.Native assembly: type: member:(null)
at (wrapper managed-to-native) Interop+Sys.LChflagsCanSetHiddenFlag()
at Interop+Sys..cctor () [0x00000] in :0
--- End of inner exception stack trace ---
at Interop.GetRandomBytes (System.Byte* buffer, System.Int32 length) [0x00000] in :0
at System.Guid.NewGuid () [0x00000] in :0
at GitDependencies.Program..cctor () [0x00000] in <0916da07a3c04a6aa2e0f66d38c790da>:0
--- End of inner exception stack trace ---
Result: 1
This seems to be a missing System.Native library, but I don't know how to resolve it.

skylinestars Aug 19, 2024

@newgamerboy I encountered the same problem as you, have you solved it

yhamadi75 · 2022-11-14T08:43:30Z

yhamadi75
Nov 14, 2022

Thanks for the info Gustavo, I have joined the Epic org, and should be able to try an M1 built!
Cheers,

0 replies

svenwinkelmann · 2023-02-16T10:46:18Z

svenwinkelmann
Feb 16, 2023

Thanks @GustavoSilvera for your great work! With your steps I was able to get Unreal and Carla running on my M1 Max, Ventura 13.1, XCode 14.2.

Some remarks I stumbled across:

Unreal build: "Unable to instantiate module 'WebBrowser': System.IO.DirectoryNotFoundException" => create the mentioned folder UnrealCEFSubProcess.app manually
Duplicate HTTP symbols you get rid of with changes in libwebsockets.h
Carla: I used the changes in this commit
Pyenv did not work out, with conda it's fine
I had huge problems with boost-python, because I had installed a global version with brew. Errors where Symbol not found / Expected in: flat namespace and "Error: 540: support for exception handling is disabled; use --exceptions to enable try {" ==> the only solution I have found was to deinstall boost with brew and use the one which is shipped with carla.

I hope these comments help someone. Carla runs like a charm on my M1 :)

1 reply

pixeloverflow Aug 15, 2023

solution magic working for me

SevillaFe · 2023-06-03T13:25:53Z

SevillaFe
Jun 3, 2023

Hello @GustavoSilvera first of all, thank you for your work!!

I'm trying out to follow the steeps from here Mac build but I cannot find your GitHub fork described in this steep git clone https://github.com/GustavoSilvera/UnrealEngine --depth 1 -b mac-dev

did you delete it? or did you rename it? could you help me please.

Thank you

2 replies

SevillaFe Jun 3, 2023

Edit:
I suppose that I have to wait at least 24 hours to get access and to see EpicGames/UnrealEngine repo after I linked my Github account to Epic, isn't?

SevillaFe Jun 3, 2023

Hello again,
it worked like a charm, just waiting a few minutes I got access.

then I can continue with the build .

VitalkaaNX · 2023-07-18T18:57:31Z

VitalkaaNX
Jul 18, 2023

Evre one!

0 replies

ilyLunaa · 2024-01-13T19:58:57Z

ilyLunaa
Jan 13, 2024

This does not work as the output gives me a "remote server returned an error: (403) Forbidden. (WebException)" error while executing the setup.sh file from the fork. I am logged in, everything is correct aswell.

0 replies

newgamerboy · 2024-08-19T08:42:31Z

newgamerboy
Aug 19, 2024

No.I have cancelled this project.

…

---Original--- From: ***@***.***> Date: Mon, Aug 19, 2024 16:38 PM To: ***@***.***>; Cc: ***@***.******@***.***>; Subject: Re: [carla-simulator/carla] Build issue for UnrealEngine on Mac M1(Discussion #4848) @newgamerboy I encountered the same problem as you, have you solved it — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: ***@***.***>

0 replies

Build issue for UnrealEngine on Mac M1 #4848

Replies: 15 comments · 32 replies

Replies: 15 comments 32 replies