[BUG] ModuleNotFoundError: No module named 'zeta.structs.attn_layers'

[Math312]

My zetascale version is:
zetascale 1.2.4
When I run the code in
https://github.com/kyegomez/Fuyu/tree/main/fuyu
The error is:

Traceback (most recent call last):
File "/mnt/sda/shaoyanli/fuyu/Fuyu/example.py", line 2, in
from fuyu.model import Fuyu
File "/mnt/sda/shaoyanli/fuyu/Fuyu/fuyu/init.py", line 1, in
from fuyu.model import Fuyu
File "/mnt/sda/shaoyanli/fuyu/Fuyu/fuyu/model.py", line 3, in
from zeta.structs import AutoregressiveWrapper, Decoder, Transformer
File "/mnt/sda/anaconda3/envs/fuyu/lib/python3.10/site-packages/zeta/init.py", line 5, in
from zeta.nn import * # noqa: F403, E402
File "/mnt/sda/anaconda3/envs/fuyu/lib/python3.10/site-packages/zeta/nn/init.py", line 1, in
from zeta.nn.attention import *
File "/mnt/sda/anaconda3/envs/fuyu/lib/python3.10/site-packages/zeta/nn/attention/init.py", line 14, in
from zeta.nn.attention.mixture_attention import (
File "/mnt/sda/anaconda3/envs/fuyu/lib/python3.10/site-packages/zeta/nn/attention/mixture_attention.py", line 8, in
from zeta.models.vit import exists
File "/mnt/sda/anaconda3/envs/fuyu/lib/python3.10/site-packages/zeta/models/init.py", line 3, in
from zeta.models.andromeda import Andromeda
File "/mnt/sda/anaconda3/envs/fuyu/lib/python3.10/site-packages/zeta/models/andromeda.py", line 4, in
from zeta.structs.auto_regressive_wrapper import AutoregressiveWrapper
File "/mnt/sda/anaconda3/envs/fuyu/lib/python3.10/sit/mnt/sda/anaconda3/envs/fuyu/lib/python3.10/site-packages/zeta/structs/e-packages/zeta/structs/init.py", line 4, in
from zeta.structs.hierarchical_transformer import (
File "/mnt/sda/anaconda3/envs/fuyu/lib/python3.10/site-packages/zeta/structs/hierarchical_transformer.py", line 13, in
from zeta.structs.attn_layers import rotate_half
ModuleNotFoundError: No module named 'zeta.structs.attn_layers'

so I go to the package path of zeta, but I can't find the File zeta/structs/attn_layers

Upvote & Fund

• We're using Polar.sh so you can upvote and help fund this issue.
• We receive the funding once the issue is completed & confirmed by you.
• Thank you in advance for helping prioritize & fund our backlog.

[Math312]

These are the files in zeta/structs
(fuyu) lab414@lab414:/mnt/sda/anaconda3/envs/fuyu/lib/python3.10/site-packages/zeta/structs$ ls -alh
total 160K
drwxrwxr-x 3 lab414 lab414 4.0K 12月 24 11:46 .
drwxrwxr-x 15 lab414 lab414 4.0K 12月 24 11:45 ..
-rw-rw-r-- 1 lab414 lab414 12K 12月 24 11:24 auto_regressive_wrapper.py
-rw-rw-r-- 1 lab414 lab414 3.5K 12月 24 11:24 clip_encoder.py
-rw-rw-r-- 1 lab414 lab414 6.6K 12月 24 11:24 efficient_net.py
-rw-rw-r-- 1 lab414 lab414 3.2K 12月 24 11:24 encoder_decoder.py
-rw-rw-r-- 1 lab414 lab414 28K 12月 24 11:24 hierarchical_transformer.py
-rw-rw-r-- 1 lab414 lab414 1.3K 12月 24 11:24 init.py
-rw-rw-r-- 1 lab414 lab414 5.8K 12月 24 11:24 local_transformer.py
-rw-rw-r-- 1 lab414 lab414 1.7K 12月 24 11:24 multi_modal_projector.py
drwxrwxr-x 2 lab414 lab414 4.0K 12月 24 11:24 pycache
-rw-rw-r-- 1 lab414 lab414 11K 12月 24 11:24 simple_transformer.py
-rw-rw-r-- 1 lab414 lab414 4.4K 12月 24 11:24 transformer_block.py
-rw-rw-r-- 1 lab414 lab414 53K 12月 24 11:24 transformer.py

[kyegomez]

@Math312 I've just updated it and fixed these errors remind me if they are any more errors please