Fix wheel building and M1 S4 build (#279) #130

Job	Run time
Build source distribution	17s
Build wheel for cp38-manylinux x86_64	59s
Build wheel for cp39-manylinux x86_64	59s
Build wheel for cp310-manylinux x86_64	56s
Build wheel for cp311-manylinux x86_64	57s
Build wheel for cp312-manylinux x86_64	54s
Build wheel for cp38-manylinux i686	4m 55s
Build wheel for cp39-manylinux i686	4m 14s
Build wheel for cp310-manylinux i686	4m 18s
Build wheel for cp311-manylinux i686	4m 24s
Build wheel for cp312-manylinux i686	4m 13s
Build wheel for cp38-macosx x86_64	1m 52s
Build wheel for cp39-macosx x86_64	1m 40s
Build wheel for cp310-macosx x86_64	1m 49s
Build wheel for cp311-macosx x86_64	1m 6s
Build wheel for cp312-macosx x86_64	1m 11s
Build wheel for cp38-macosx arm64	11s
Build wheel for cp39-macosx arm64	10s
Build wheel for cp310-macosx arm64	44s
Build wheel for cp311-macosx arm64	45s
Build wheel for cp312-macosx arm64	47s
Build wheel for cp38-win AMD64	4m 12s
Build wheel for cp39-win AMD64	4m 18s
Build wheel for cp310-win AMD64	4m 21s
Build wheel for cp311-win AMD64	4m 21s
Build wheel for cp312-win AMD64	6m 33s
upload_wheels	27s
	1h 1m 33s

Provide feedback