Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support generic data types in OpMeta #380

Closed
2 tasks
jiazhihao opened this issue Oct 27, 2022 · 2 comments
Closed
2 tasks

Support generic data types in OpMeta #380

jiazhihao opened this issue Oct 27, 2022 · 2 comments
Assignees
Labels
enhancement New feature or request

Comments

@jiazhihao
Copy link
Collaborator

FlexFlow currently assumes that the input/output tensors of some operators are 32-bit floating points. This issues tracks the progress of supporting general data types for FlexFlow's operators. The list of todos:

  • Add input/output/weight data type as properties in OpMeta. This allows forward/backward tasks to know the data types of the input/weight/output tensors
  • Use GenericTensorAccessor in forward/backward tasks
@lockshaw
Copy link
Collaborator

@jiazhihao The instructions above are out of date, especially after #622. Can you convert this into a list of which operators to which we still want to add multi-precision support?

@lockshaw lockshaw added the enhancement New feature or request label Jun 16, 2023
@lockshaw
Copy link
Collaborator

Actually, let's move the list over to #408

@lockshaw lockshaw closed this as not planned Won't fix, can't repro, duplicate, stale Jun 16, 2023
@github-project-automation github-project-automation bot moved this from Backlog to Done in FlexFlow Development Jun 16, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
No open projects
Status: Done
Development

No branches or pull requests

2 participants