Skip to content

Algomancer/Positional-Token-Linear

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 

Repository files navigation

Dynamic Weight Extrapolation

It works (loss go down, loss go down more when more positions). Love help testing it. Seems likely increasing the parameters of the position transform is a good place to start.

@misc{algomancer2024,
  author = {@algomancer},
  title  = {Some Dumb Shit},
  year   = {2024}
}

About

Neat.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages