[Infra] Only compile core extension headers once

[Infra] Only compile core extension headers once #1348