Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fails to build on 2021 mac m1 pro #857

Open
reubano opened this issue Dec 31, 2021 · 7 comments
Open

Fails to build on 2021 mac m1 pro #857

reubano opened this issue Dec 31, 2021 · 7 comments
Labels
help wanted Extra attention is needed

Comments

@reubano
Copy link

reubano commented Dec 31, 2021

Describe the bug
Running the make command on 2021 mac m1 pro fails with ERROR: Failed building wheel for pyarrow

To Reproduce
Steps to reproduce the behavior:

  1. Run the command make pipelinewise all_connectors
  2. See error
Making Virtual Environment for pipelinewise in /Users/reubano/Documents/Projects/pipelinewise/.virtualenvs... ✔
Looking in links: file:///Users/reubano/.pip/wheels
Requirement already satisfied: pip in ./.virtualenvs/pipelinewise/lib/python3.9/site-packages (21.3.1)
Requirement already satisfied: setuptools in ./.virtualenvs/pipelinewise/lib/python3.9/site-packages (60.2.0)
Requirement already satisfied: wheel in ./.virtualenvs/pipelinewise/lib/python3.9/site-packages (0.37.1)

Python setup tools updated... ✔
Installing the package...

Looking in links: file:///Users/reubano/.pip/wheels
Obtaining file:///Users/reubano/Documents/Projects/pipelinewise
  Preparing metadata (setup.py) ... done
...
Building wheels for collected packages: pyarrow
  Building wheel for pyarrow (pyproject.toml) ... error
  ERROR: Command errored out with exit status 1:
   command: /Users/reubano/Documents/Projects/pipelinewise/.virtualenvs/pipelinewise/bin/python3 /Users/reubano/Documents/Projects/pipelinewise/.virtualenvs/pipelinewise/lib/python3.9/site-packages/pip/_vendor/pep517/in_process/_in_process.py build_wheel /var/folders/m1/z7tt4jpd23z27g6n21yyrh2h0000gp/T/tmpwrrea5_u
       cwd: /private/var/folders/m1/z7tt4jpd23z27g6n21yyrh2h0000gp/T/pip-install-g9_okrb5/pyarrow_de6c4131fd8a4721b80b563dc06564ae
  Complete output (176 lines):
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.macosx-12.0-arm64-3.9
  creating build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/orc.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/_generated_version.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/compat.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/benchmark.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/parquet.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/ipc.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/util.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/flight.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/cffi.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/filesystem.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/__init__.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/plasma.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/types.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/dataset.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/cuda.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/feather.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/pandas_compat.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/fs.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/csv.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/jvm.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/hdfs.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/json.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/serialization.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/compute.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  creating build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_tensor.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_ipc.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/conftest.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_convert_builtin.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_misc.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_gandiva.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/strategies.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_adhoc_memory_leak.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/arrow_7980.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/util.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_orc.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_table.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_array.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_deprecations.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_serialization_deprecated.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/__init__.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_io.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_cuda_numba_interop.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_cffi.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_schema.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_jvm.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_plasma_tf_op.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_fs.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_filesystem.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/pandas_threaded_import.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/pandas_examples.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_cython.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_sparse_tensor.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_dataset.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_builder.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_cuda.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_extension_type.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_feather.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_pandas.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_memory.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_flight.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_json.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_serialization.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_compute.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_hdfs.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/deserialize_buffer.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_strategies.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_csv.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_plasma.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_scalars.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  copying pyarrow/tests/test_types.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  running egg_info
  listing git files failed - pretending there aren't any
  warning: no files found matching '../LICENSE.txt'
  warning: no files found matching '../NOTICE.txt'
  warning: no previously-included files matching '*.so' found anywhere in distribution
  warning: no previously-included files matching '*.pyc' found anywhere in distribution
  warning: no previously-included files matching '*~' found anywhere in distribution
  warning: no previously-included files matching '#*' found anywhere in distribution
  warning: no previously-included files matching '.git*' found anywhere in distribution
  warning: no previously-included files matching '.DS_Store' found anywhere in distribution
  no previously-included directories found matching '.asv'
  writing manifest file 'pyarrow.egg-info/SOURCES.txt'
  copying pyarrow/__init__.pxd -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/_compute.pxd -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/_compute.pyx -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/_csv.pxd -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/_csv.pyx -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/_cuda.pxd -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/_cuda.pyx -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/_dataset.pyx -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/_flight.pyx -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/_fs.pxd -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/_fs.pyx -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/_hdfs.pyx -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/_json.pyx -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/_orc.pxd -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/_orc.pyx -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/_parquet.pxd -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/_parquet.pyx -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/_plasma.pyx -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/_s3fs.pyx -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/array.pxi -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/benchmark.pxi -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/builder.pxi -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/compat.pxi -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/config.pxi -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/error.pxi -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/feather.pxi -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/gandiva.pyx -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/io-hdfs.pxi -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/io.pxi -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/ipc.pxi -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/lib.pxd -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/lib.pyx -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/memory.pxi -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/pandas-shim.pxi -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/public-api.pxi -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/scalar.pxi -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/serialization.pxi -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/table.pxi -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/tensor.pxi -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  copying pyarrow/types.pxi -> build/lib.macosx-12.0-arm64-3.9/pyarrow
  creating build/lib.macosx-12.0-arm64-3.9/pyarrow/includes
  copying pyarrow/includes/__init__.pxd -> build/lib.macosx-12.0-arm64-3.9/pyarrow/includes
  copying pyarrow/includes/common.pxd -> build/lib.macosx-12.0-arm64-3.9/pyarrow/includes
  copying pyarrow/includes/libarrow.pxd -> build/lib.macosx-12.0-arm64-3.9/pyarrow/includes
  copying pyarrow/includes/libarrow_cuda.pxd -> build/lib.macosx-12.0-arm64-3.9/pyarrow/includes
  copying pyarrow/includes/libarrow_dataset.pxd -> build/lib.macosx-12.0-arm64-3.9/pyarrow/includes
  copying pyarrow/includes/libarrow_flight.pxd -> build/lib.macosx-12.0-arm64-3.9/pyarrow/includes
  copying pyarrow/includes/libarrow_fs.pxd -> build/lib.macosx-12.0-arm64-3.9/pyarrow/includes
  copying pyarrow/includes/libgandiva.pxd -> build/lib.macosx-12.0-arm64-3.9/pyarrow/includes
  copying pyarrow/includes/libplasma.pxd -> build/lib.macosx-12.0-arm64-3.9/pyarrow/includes
  creating build/lib.macosx-12.0-arm64-3.9/pyarrow/tensorflow
  copying pyarrow/tensorflow/plasma_op.cc -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tensorflow
  copying pyarrow/tests/pyarrow_cython_example.pyx -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests
  creating build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/data
  creating build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/data/feather
  copying pyarrow/tests/data/feather/v0.17.0.version=2-compression=lz4.feather -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/data/feather
  creating build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/data/orc
  copying pyarrow/tests/data/orc/README.md -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/data/orc
  copying pyarrow/tests/data/orc/TestOrcFile.emptyFile.jsn.gz -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/data/orc
  copying pyarrow/tests/data/orc/TestOrcFile.emptyFile.orc -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/data/orc
  copying pyarrow/tests/data/orc/TestOrcFile.test1.jsn.gz -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/data/orc
  copying pyarrow/tests/data/orc/TestOrcFile.test1.orc -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/data/orc
  copying pyarrow/tests/data/orc/TestOrcFile.testDate1900.jsn.gz -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/data/orc
  copying pyarrow/tests/data/orc/TestOrcFile.testDate1900.orc -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/data/orc
  copying pyarrow/tests/data/orc/decimal.jsn.gz -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/data/orc
  copying pyarrow/tests/data/orc/decimal.orc -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/data/orc
  creating build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/data/parquet
  copying pyarrow/tests/data/parquet/v0.7.1.all-named-index.parquet -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/data/parquet
  copying pyarrow/tests/data/parquet/v0.7.1.column-metadata-handling.parquet -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/data/parquet
  copying pyarrow/tests/data/parquet/v0.7.1.parquet -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/data/parquet
  copying pyarrow/tests/data/parquet/v0.7.1.some-named-index.parquet -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/data/parquet
  creating build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/parquet
  copying pyarrow/tests/parquet/common.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/parquet
  copying pyarrow/tests/parquet/conftest.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/parquet
  copying pyarrow/tests/parquet/test_basic.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/parquet
  copying pyarrow/tests/parquet/test_data_types.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/parquet
  copying pyarrow/tests/parquet/test_dataset.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/parquet
  copying pyarrow/tests/parquet/test_datetime.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/parquet
  copying pyarrow/tests/parquet/test_metadata.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/parquet
  copying pyarrow/tests/parquet/test_pandas.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/parquet
  copying pyarrow/tests/parquet/test_parquet_file.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/parquet
  copying pyarrow/tests/parquet/test_parquet_writer.py -> build/lib.macosx-12.0-arm64-3.9/pyarrow/tests/parquet
  running build_ext
  creating /private/var/folders/m1/z7tt4jpd23z27g6n21yyrh2h0000gp/T/pip-install-g9_okrb5/pyarrow_de6c4131fd8a4721b80b563dc06564ae/build/temp.macosx-12.0-arm64-3.9
  -- Running cmake for pyarrow
  cmake -DPYTHON_EXECUTABLE=/Users/reubano/Documents/Projects/pipelinewise/.virtualenvs/pipelinewise/bin/python3 -DPython3_EXECUTABLE=/Users/reubano/Documents/Projects/pipelinewise/.virtualenvs/pipelinewise/bin/python3 "" -DPYARROW_BUILD_CUDA=off -DPYARROW_BUILD_FLIGHT=off -DPYARROW_BUILD_GANDIVA=off -DPYARROW_BUILD_DATASET=off -DPYARROW_BUILD_ORC=off -DPYARROW_BUILD_PARQUET=off -DPYARROW_BUILD_PLASMA=off -DPYARROW_BUILD_S3=off -DPYARROW_BUILD_HDFS=off -DPYARROW_USE_TENSORFLOW=off -DPYARROW_BUNDLE_ARROW_CPP=off -DPYARROW_BUNDLE_BOOST=off -DPYARROW_GENERATE_COVERAGE=off -DPYARROW_BOOST_USE_SHARED=on -DPYARROW_PARQUET_USE_SHARED=on -DCMAKE_BUILD_TYPE=release /private/var/folders/m1/z7tt4jpd23z27g6n21yyrh2h0000gp/T/pip-install-g9_okrb5/pyarrow_de6c4131fd8a4721b80b563dc06564ae
  error: command 'cmake' failed: No such file or directory
  ----------------------------------------
  ERROR: Failed building wheel for pyarrow
Failed to build pyarrow
ERROR: Could not build wheels for pyarrow, which is required to install pyproject.toml-based projects
make: *** [Makefile:199: pipelinewise] Error 1

Expected behavior
No error
Your environment

$ git show --format="%h" --no-patch
fd6a6ab
$python --version
Python 3.9.9
$ sw_vers
ProductName:	macOS
ProductVersion:	12.0.1
BuildVersion:	21A559
@reubano reubano added the bug Something isn't working label Dec 31, 2021
@Samira-El
Copy link
Contributor

Hey @reubano, this is most probably because you're using Python 3.9, can you downgrade to 3.8?

@Samira-El Samira-El added help wanted Extra attention is needed and removed bug Something isn't working labels Jan 3, 2022
@reubano
Copy link
Author

reubano commented Jan 3, 2022

make pipelinewise connectors -e pw_connector=transform-field

Making Virtual Environment for pipelinewise in /Users/reubano/Documents/Projects/pipelinewise/.virtualenvs... ✔
Looking in links: file:///Users/reubano/.pip/wheels
Requirement already satisfied: pip in ./.virtualenvs/pipelinewise/lib/python3.8/site-packages (21.3.1)
Requirement already satisfied: setuptools in ./.virtualenvs/pipelinewise/lib/python3.8/site-packages (60.2.0)
Requirement already satisfied: wheel in ./.virtualenvs/pipelinewise/lib/python3.8/site-packages (0.37.1)

Python setup tools updated... ✔
Installing the package...

Looking in links: file:///Users/reubano/.pip/wheels
Obtaining file:///Users/reubano/Documents/Projects/pipelinewise
  Preparing metadata (setup.py) ... done
Collecting argparse==1.4.0
  Using cached argparse-1.4.0-py2.py3-none-any.whl (23 kB)
Collecting tabulate==0.8.9
  Using cached tabulate-0.8.9-py3-none-any.whl (25 kB)
Collecting PyYAML==6.0
  Using cached PyYAML-6.0.tar.gz (124 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting ansible==4.7.0
  Using cached ansible-4.7.0.tar.gz (36.0 MB)
  Preparing metadata (setup.py) ... done
Collecting Jinja2==3.0.2
  Using cached Jinja2-3.0.2-py3-none-any.whl (133 kB)
Collecting joblib==1.1.0
  Using cached joblib-1.1.0-py2.py3-none-any.whl (306 kB)
Collecting PyMySQL==0.7.11
  Using cached PyMySQL-0.7.11-py2.py3-none-any.whl (78 kB)
Collecting psycopg2-binary==2.8.6
  Using cached psycopg2-binary-2.8.6.tar.gz (384 kB)
  Preparing metadata (setup.py) ... done
Collecting snowflake-connector-python[pandas]==2.4.6
  Using cached snowflake-connector-python-2.4.6.tar.gz (344 kB)
  Installing build dependencies ... error
  ERROR: Command errored out with exit status 1:
   command: /Users/reubano/Documents/Projects/pipelinewise/.virtualenvs/pipelinewise/bin/python3 /private/var/folders/m1/z7tt4jpd23z27g6n21yyrh2h0000gp/T/pip-standalone-pip-grb9ndsu/__env_pip__.zip/pip install --ignore-installed --no-user --prefix /private/var/folders/m1/z7tt4jpd23z27g6n21yyrh2h0000gp/T/pip-build-env-oz0_7d72/overlay --no-warn-script-location --no-binary :none: --only-binary :none: -i https://pypi.org/simple --find-links file:///Users/reubano/.pip/wheels -- 'setuptools>=40.6.0' wheel cython 'pyarrow>=3.0.0,<3.1.0'
       cwd: None
  Complete output (204 lines):
  Looking in links: file:///Users/reubano/.pip/wheels, file:///Users/reubano/.pip/wheels
  Collecting setuptools>=40.6.0
    Using cached setuptools-60.2.0-py3-none-any.whl (953 kB)
  Collecting wheel
    Using cached wheel-0.37.1-py2.py3-none-any.whl (35 kB)
  Collecting cython
    Using cached Cython-0.29.26-py2.py3-none-any.whl (983 kB)
  Collecting pyarrow<3.1.0,>=3.0.0
    Using cached pyarrow-3.0.0.tar.gz (682 kB)
    Installing build dependencies: started
    Installing build dependencies: finished with status 'done'
    Getting requirements to build wheel: started
    Getting requirements to build wheel: finished with status 'done'
    Preparing metadata (pyproject.toml): started
    Preparing metadata (pyproject.toml): finished with status 'done'
  Collecting numpy>=1.16.6
    Using cached numpy-1.22.0-cp38-cp38-macosx_11_0_arm64.whl (12.7 MB)
  Building wheels for collected packages: pyarrow
    Building wheel for pyarrow (pyproject.toml): started
    Building wheel for pyarrow (pyproject.toml): finished with status 'error'
    ERROR: Command errored out with exit status 1:
     command: /Users/reubano/Documents/Projects/pipelinewise/.virtualenvs/pipelinewise/bin/python3 /var/folders/m1/z7tt4jpd23z27g6n21yyrh2h0000gp/T/tmptvot0j2_ build_wheel /var/folders/m1/z7tt4jpd23z27g6n21yyrh2h0000gp/T/tmp1seukz3p
         cwd: /private/var/folders/m1/z7tt4jpd23z27g6n21yyrh2h0000gp/T/pip-install-mv552d1e/pyarrow_000a759b0d924dc8a6fdeef295457d14
    Complete output (176 lines):
    running bdist_wheel
    running build
    running build_py
    creating build
    creating build/lib.macosx-12.0-arm64-3.8
    creating build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/orc.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/_generated_version.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/compat.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/benchmark.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/parquet.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/ipc.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/util.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/flight.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/cffi.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/filesystem.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/__init__.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/plasma.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/types.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/dataset.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/cuda.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/feather.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/pandas_compat.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/fs.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/csv.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/jvm.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/hdfs.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/json.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/serialization.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/compute.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    creating build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_tensor.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_ipc.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/conftest.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_convert_builtin.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_misc.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_gandiva.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/strategies.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_adhoc_memory_leak.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/arrow_7980.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/util.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_orc.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_table.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_array.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_deprecations.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_serialization_deprecated.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/__init__.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_io.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_cuda_numba_interop.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_cffi.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_schema.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_jvm.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_plasma_tf_op.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_fs.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_filesystem.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/pandas_threaded_import.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/pandas_examples.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_cython.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_sparse_tensor.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_dataset.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_builder.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_cuda.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_extension_type.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_feather.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_pandas.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_memory.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_flight.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_json.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_serialization.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_compute.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_hdfs.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/deserialize_buffer.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_strategies.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_csv.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_plasma.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_scalars.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    copying pyarrow/tests/test_types.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    running egg_info
    listing git files failed - pretending there aren't any
    warning: no files found matching '../LICENSE.txt'
    warning: no files found matching '../NOTICE.txt'
    warning: no previously-included files matching '*.so' found anywhere in distribution
    warning: no previously-included files matching '*.pyc' found anywhere in distribution
    warning: no previously-included files matching '*~' found anywhere in distribution
    warning: no previously-included files matching '#*' found anywhere in distribution
    warning: no previously-included files matching '.git*' found anywhere in distribution
    warning: no previously-included files matching '.DS_Store' found anywhere in distribution
    no previously-included directories found matching '.asv'
    writing manifest file 'pyarrow.egg-info/SOURCES.txt'
    copying pyarrow/__init__.pxd -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/_compute.pxd -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/_compute.pyx -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/_csv.pxd -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/_csv.pyx -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/_cuda.pxd -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/_cuda.pyx -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/_dataset.pyx -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/_flight.pyx -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/_fs.pxd -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/_fs.pyx -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/_hdfs.pyx -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/_json.pyx -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/_orc.pxd -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/_orc.pyx -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/_parquet.pxd -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/_parquet.pyx -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/_plasma.pyx -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/_s3fs.pyx -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/array.pxi -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/benchmark.pxi -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/builder.pxi -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/compat.pxi -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/config.pxi -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/error.pxi -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/feather.pxi -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/gandiva.pyx -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/io-hdfs.pxi -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/io.pxi -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/ipc.pxi -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/lib.pxd -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/lib.pyx -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/memory.pxi -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/pandas-shim.pxi -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/public-api.pxi -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/scalar.pxi -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/serialization.pxi -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/table.pxi -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/tensor.pxi -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    copying pyarrow/types.pxi -> build/lib.macosx-12.0-arm64-3.8/pyarrow
    creating build/lib.macosx-12.0-arm64-3.8/pyarrow/includes
    copying pyarrow/includes/__init__.pxd -> build/lib.macosx-12.0-arm64-3.8/pyarrow/includes
    copying pyarrow/includes/common.pxd -> build/lib.macosx-12.0-arm64-3.8/pyarrow/includes
    copying pyarrow/includes/libarrow.pxd -> build/lib.macosx-12.0-arm64-3.8/pyarrow/includes
    copying pyarrow/includes/libarrow_cuda.pxd -> build/lib.macosx-12.0-arm64-3.8/pyarrow/includes
    copying pyarrow/includes/libarrow_dataset.pxd -> build/lib.macosx-12.0-arm64-3.8/pyarrow/includes
    copying pyarrow/includes/libarrow_flight.pxd -> build/lib.macosx-12.0-arm64-3.8/pyarrow/includes
    copying pyarrow/includes/libarrow_fs.pxd -> build/lib.macosx-12.0-arm64-3.8/pyarrow/includes
    copying pyarrow/includes/libgandiva.pxd -> build/lib.macosx-12.0-arm64-3.8/pyarrow/includes
    copying pyarrow/includes/libplasma.pxd -> build/lib.macosx-12.0-arm64-3.8/pyarrow/includes
    creating build/lib.macosx-12.0-arm64-3.8/pyarrow/tensorflow
    copying pyarrow/tensorflow/plasma_op.cc -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tensorflow
    copying pyarrow/tests/pyarrow_cython_example.pyx -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests
    creating build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/data
    creating build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/data/feather
    copying pyarrow/tests/data/feather/v0.17.0.version=2-compression=lz4.feather -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/data/feather
    creating build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/data/orc
    copying pyarrow/tests/data/orc/README.md -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/data/orc
    copying pyarrow/tests/data/orc/TestOrcFile.emptyFile.jsn.gz -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/data/orc
    copying pyarrow/tests/data/orc/TestOrcFile.emptyFile.orc -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/data/orc
    copying pyarrow/tests/data/orc/TestOrcFile.test1.jsn.gz -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/data/orc
    copying pyarrow/tests/data/orc/TestOrcFile.test1.orc -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/data/orc
    copying pyarrow/tests/data/orc/TestOrcFile.testDate1900.jsn.gz -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/data/orc
    copying pyarrow/tests/data/orc/TestOrcFile.testDate1900.orc -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/data/orc
    copying pyarrow/tests/data/orc/decimal.jsn.gz -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/data/orc
    copying pyarrow/tests/data/orc/decimal.orc -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/data/orc
    creating build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/data/parquet
    copying pyarrow/tests/data/parquet/v0.7.1.all-named-index.parquet -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/data/parquet
    copying pyarrow/tests/data/parquet/v0.7.1.column-metadata-handling.parquet -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/data/parquet
    copying pyarrow/tests/data/parquet/v0.7.1.parquet -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/data/parquet
    copying pyarrow/tests/data/parquet/v0.7.1.some-named-index.parquet -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/data/parquet
    creating build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/parquet
    copying pyarrow/tests/parquet/common.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/parquet
    copying pyarrow/tests/parquet/conftest.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/parquet
    copying pyarrow/tests/parquet/test_basic.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/parquet
    copying pyarrow/tests/parquet/test_data_types.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/parquet
    copying pyarrow/tests/parquet/test_dataset.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/parquet
    copying pyarrow/tests/parquet/test_datetime.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/parquet
    copying pyarrow/tests/parquet/test_metadata.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/parquet
    copying pyarrow/tests/parquet/test_pandas.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/parquet
    copying pyarrow/tests/parquet/test_parquet_file.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/parquet
    copying pyarrow/tests/parquet/test_parquet_writer.py -> build/lib.macosx-12.0-arm64-3.8/pyarrow/tests/parquet
    running build_ext
    creating /private/var/folders/m1/z7tt4jpd23z27g6n21yyrh2h0000gp/T/pip-install-mv552d1e/pyarrow_000a759b0d924dc8a6fdeef295457d14/build/temp.macosx-12.0-arm64-3.8
    -- Running cmake for pyarrow
    cmake -DPYTHON_EXECUTABLE=/Users/reubano/Documents/Projects/pipelinewise/.virtualenvs/pipelinewise/bin/python3 -DPython3_EXECUTABLE=/Users/reubano/Documents/Projects/pipelinewise/.virtualenvs/pipelinewise/bin/python3 "" -DPYARROW_BUILD_CUDA=off -DPYARROW_BUILD_FLIGHT=off -DPYARROW_BUILD_GANDIVA=off -DPYARROW_BUILD_DATASET=off -DPYARROW_BUILD_ORC=off -DPYARROW_BUILD_PARQUET=off -DPYARROW_BUILD_PLASMA=off -DPYARROW_BUILD_S3=off -DPYARROW_BUILD_HDFS=off -DPYARROW_USE_TENSORFLOW=off -DPYARROW_BUNDLE_ARROW_CPP=off -DPYARROW_BUNDLE_BOOST=off -DPYARROW_GENERATE_COVERAGE=off -DPYARROW_BOOST_USE_SHARED=on -DPYARROW_PARQUET_USE_SHARED=on -DCMAKE_BUILD_TYPE=release /private/var/folders/m1/z7tt4jpd23z27g6n21yyrh2h0000gp/T/pip-install-mv552d1e/pyarrow_000a759b0d924dc8a6fdeef295457d14
    error: command 'cmake' failed: No such file or directory
    ----------------------------------------
    ERROR: Failed building wheel for pyarrow
  Failed to build pyarrow
  ERROR: Could not build wheels for pyarrow, which is required to install pyproject.toml-based projects
  ----------------------------------------
WARNING: Discarding https://files.pythonhosted.org/packages/8f/b4/9d1ab566a902e36b9691601140d9c5fde92ccc6ea2af31db8c18518ef19c/snowflake-connector-python-2.4.6.tar.gz#sha256=df84f74ec0154ba41ead7ee09bd1bee9201da7c311e5fcc6dc4b5f256c65d692 (from https://pypi.org/simple/snowflake-connector-python/) (requires-python:>=3.6). Command errored out with exit status 1: /Users/reubano/Documents/Projects/pipelinewise/.virtualenvs/pipelinewise/bin/python3 /private/var/folders/m1/z7tt4jpd23z27g6n21yyrh2h0000gp/T/pip-standalone-pip-grb9ndsu/__env_pip__.zip/pip install --ignore-installed --no-user --prefix /private/var/folders/m1/z7tt4jpd23z27g6n21yyrh2h0000gp/T/pip-build-env-oz0_7d72/overlay --no-warn-script-location --no-binary :none: --only-binary :none: -i https://pypi.org/simple --find-links file:///Users/reubano/.pip/wheels -- 'setuptools>=40.6.0' wheel cython 'pyarrow>=3.0.0,<3.1.0' Check the logs for full command output.
ERROR: Could not find a version that satisfies the requirement snowflake-connector-python[pandas]==2.4.6 (from pipelinewise[test]) (from versions: 1.3.17, 1.3.18, 1.4.0, 1.4.1, 1.4.2, 1.4.3, 1.4.4, 1.4.5, 1.4.6, 1.4.7, 1.4.8, 1.4.9, 1.4.10, 1.4.11, 1.4.12, 1.4.13, 1.4.14, 1.4.15, 1.4.16, 1.4.17, 1.5.0, 1.5.1, 1.5.2, 1.5.3, 1.5.4, 1.5.5, 1.5.6, 1.5.7, 1.5.8, 1.6.0, 1.6.1, 1.6.2, 1.6.3, 1.6.4, 1.6.5, 1.6.6, 1.6.7, 1.6.8, 1.6.9, 1.6.10, 1.6.11, 1.6.12, 1.7.0, 1.7.1, 1.7.2, 1.7.3, 1.7.4, 1.7.5, 1.7.6, 1.7.7, 1.7.8, 1.7.9, 1.7.10, 1.7.11, 1.8.0, 1.8.1, 1.8.2, 1.8.3, 1.8.4, 1.8.5, 1.8.6, 1.8.7, 1.9.1, 2.0.0, 2.0.1, 2.0.2, 2.0.3, 2.0.4, 2.1.0, 2.1.1, 2.1.2, 2.1.3, 2.2.0, 2.2.1, 2.2.2, 2.2.3, 2.2.4, 2.2.5, 2.2.6, 2.2.7, 2.2.8, 2.2.9, 2.2.10, 2.3.0, 2.3.1, 2.3.2, 2.3.3, 2.3.4, 2.3.5, 2.3.6, 2.3.7, 2.3.8, 2.3.9, 2.3.10, 2.4.0, 2.4.1, 2.4.2, 2.4.3, 2.4.4, 2.4.5, 2.4.6, 2.5.0, 2.5.1, 2.6.0, 2.6.1, 2.6.2, 2.7.0, 2.7.1, 2.7.2)
ERROR: No matching distribution found for snowflake-connector-python[pandas]==2.4.6
make: *** [Makefile:199: pipelinewise] Error 1

@Samira-El
Copy link
Contributor

This is an issue with snowflake-python-connector, it doesn't support m1 Mac yet: snowflakedb/snowflake-connector-python#986

I'm afraid that's out of our control, we can't do much until that's fix.

@reubano
Copy link
Author

reubano commented Jan 4, 2022

But according to the command I ran, I didn't install that connector.

@Samira-El
Copy link
Contributor

You installed pipelinewise which has snowflake-python-connector as a dependency here

@ayhanaltunkaynak
Copy link
Contributor

I could run from docker by specifying --platform. I hope this can help.

docker build -t pipelinewise:latest . --platform linux/amd64

@pvonglehn
Copy link

pvonglehn commented Mar 30, 2023

thanks @ayhanaltunkaynak this allowed me to build the pipelinewise image on an Apple M2 chip

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

4 participants