Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🌤🌤 Kernel Trace & 目标 & 代码规范 & 致谢 🎉🎉 #50

Open
33 of 43 tasks
DefTruth opened this issue Sep 26, 2024 · 0 comments
Open
33 of 43 tasks

🌤🌤 Kernel Trace & 目标 & 代码规范 & 致谢 🎉🎉 #50

DefTruth opened this issue Sep 26, 2024 · 0 comments
Assignees
Labels
contribute documentation Improvements or additions to documentation good first issue Good for newcomers

Comments

@DefTruth
Copy link
Owner

DefTruth commented Sep 26, 2024

🌤🌤目标

首先,任何kernel实现都欢迎,本仓库学习/练习为主,性能最优非本仓库最终目标,先会用,然后再用好。性能最优推荐直接使用cuBLAS, cuDNN, FlashAttention, TensorRT等官方实现。如果有感兴趣的kernel希望在本仓库实现,可以评论本issue(虽然我不一定有能力实现🌚),比如:

☕️☕️Kernel Trace

  • xxx kernel
  • ...

👨‍💻👨‍💻代码规范

提交代码需要遵循以下规范:

  • 每个算子/kernel使用单独的目录,参考relu, gelu等
  • 参考任一现有kernel,使用torch验证结果正确性
  • 本仓库使用2空格作为缩进
  • { }使用非上下对齐风格
  • pragma unroll和当前for loop代码对齐
  • 一行代码尽量不超过100字符
  • 不使用/未ready的代码删除
  • 其他想到再写🌚......

🎉🎉 致谢

感谢 @bear-zd, @wangzijian1010等为本仓库提供大量kernel实现 ~

☕️☕️Kernel Trace

@DefTruth DefTruth changed the title Kernel Trace Issue Kernel Trace issue Sep 26, 2024
@DefTruth DefTruth pinned this issue Sep 26, 2024
@DefTruth DefTruth self-assigned this Oct 9, 2024
@DefTruth DefTruth changed the title Kernel Trace issue Kernel Trace & 贡献代码规范 Oct 18, 2024
@DefTruth DefTruth changed the title Kernel Trace & 贡献代码规范 🌤🌤 Kernel Trace & 目标 & 贡献代码规范 & 致谢 🎉🎉 Oct 18, 2024
@DefTruth DefTruth changed the title 🌤🌤 Kernel Trace & 目标 & 贡献代码规范 & 致谢 🎉🎉 🌤🌤 Kernel Trace & 目标 & 代码规范 & 致谢 🎉🎉 Oct 18, 2024
@DefTruth DefTruth added documentation Improvements or additions to documentation good first issue Good for newcomers contribute labels Oct 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
contribute documentation Improvements or additions to documentation good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

1 participant