clean up

kyegomez · Oct 2, 2023 · e6f3b29 · e6f3b29
1 parent f517684
commit e6f3b29
Showing 1 changed file with 1 addition and 1 deletion.
diff --git a/README.md b/README.md
@@ -105,4 +105,4 @@ Eprint = {arXiv:2302.05442},
 ```
 
 # Todo
-- [ ] 
+- [ ] Add flash attention, with layernorm before attn, and then layernom for qk values,