[BUG] pip apex is not nvidia apex

[evelynmitchell]

From container, with pip install zetascale.

In looking at the error, it appears the pip apex is not the package for the nvdia apex[1]
The fix is to install:

git clone https://github.com/NVIDIA/apex
cd apex
pip install -v --disable-pip-version-check --no-cache-dir \
--global-option="--cpp_ext" --global-option="--cuda_ext" ./

following [2]

______________________________ ERROR collecting test_init.py _______________________________
ImportError while importing test module '/usr/src/zeta/tests/test_init.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
/usr/local/lib/python3.10/importlib/__init__.py:126: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
test_init.py:1: in <module>
    import zeta
/usr/local/lib/python3.10/site-packages/zeta/__init__.py:5: in <module>
    from zeta.nn import *  # noqa: F403, E402
/usr/local/lib/python3.10/site-packages/zeta/nn/__init__.py:1: in <module>
    from zeta.nn.attention import *
Te/usr/local/lib/python3.10/site-packages/zeta/nn/attention/__init__.py:14: in <module>
    from zeta.nn.attention.mixture_attention import (
/usr/local/lib/python3.10/site-packages/zeta/nn/attention/mixture_attention.py:8: in <module>
    from zeta.models.vit import exists
/usr/local/lib/python3.10/site-packages/zeta/models/__init__.py:3: in <module>
    from zeta.models.andromeda import Andromeda
/usr/local/lib/python3.10/site-packages/zeta/models/andromeda.py:4: in <module>
    from zeta.structs.auto_regressive_wrapper import AutoregressiveWrapper
/usr/local/lib/python3.10/site-packages/zeta/structs/__init__.py:8: in <module>
    from zeta.structs.local_transformer import LocalTransformer
/usr/local/lib/python3.10/site-packages/zeta/structs/local_transformer.py:8: in <module>
    from zeta.nn.modules import feedforward_network
/usr/local/lib/python3.10/site-packages/zeta/nn/modules/__init__.py:12: in <module>
    from zeta.nn.modules.feedforward_network import FeedForwardNetwork
/usr/local/lib/python3.10/site-packages/zeta/nn/modules/feedforward_network.py:9: in <module>
    from apex.normalization import FusedLayerNorm as LayerNorm
/usr/local/lib/python3.10/site-packages/apex/__init__.py:13: in <module>
    from pyramid.session import UnencryptedCookieSessionFactoryConfig
E   ImportError: cannot import name 'UnencryptedCookieSessionFactoryConfig' from 'pyramid.session' (unknown location)

[1] https://stackoverflow.com/questions/66610378/unencryptedcookiesessionfactoryconfig-error-when-importing-apex
[2] https://stackoverflow.com/a/67188946

Upvote & Fund

• We're using Polar.sh so you can upvote and help fund this issue.
• We receive the funding once the issue is completed & confirmed by you.
• Thank you in advance for helping prioritize & fund our backlog.