Cleanup MegaBlocks Installation

[eitanturok]

Update 2024-07-25:

1. We will use stk for now and not my fork. We'll take care of this in a separate PR.
2. We will update the repo author and email in a separate PR.
3. I added a _version.py for versioning and we dynamically read the version in setup.py.

---

This PR cleans up the MegaBlocks installation process. Specifically, it

1. Adds a pyproject.toml file
2. Updates the README.md installation instructions
3. Ignores more files in .gitignore
4. Adds missing packages to setup.py, i.e. torch and numpy
5. Adds missing packages for testing to megablocks[dev], i.e. coverage, pytest, pytest_codeblocks, pytest-cov, pre-commit.
6. Gracefully handles missing torch while running setup.py
7. Fix style in setup.py: replade ' with " and add license header
8. Improve long_description by parsing README.md better (taken from composer)
9. MegaBlocks depends on stk. stk's setup.py unnecessarily imports torch which causes issues with installing stk before we have torch installed. We now install my fork of stk that fixes this issue while waiting for @tgale96 to merge my PR fixing this in stk.

[b-chu]

Thanks for the PR!

[eitanturok]

I addressed all of your comments @b-chu. I based my pyproject.toml and setup.py based on Composer copying the features and style while paying careful attention to only copy code that is necessary for MegaBlocks.

My fork of stk enables us to set up github actions for MegaBlocks, something we do not need to worry about right now. So I'm going to just use the regular stk version so we can merge this.

LMK if that sounds good to you.

[eitanturok]

Are we ready to merge? Any other reviewers we should notify?

[karan6181]

Tagging @mvpatel2000 for the review before we merge this PR.

[dakinggg]

LGTM, but wanted to note that since this PR includes a pyproject.toml, I think it enables build isolation which may make the package more difficult to install. Since the torch dep is specified in pyproject.toml it should be ok, but upgrading to latest torch versions will need to be done with care.

[eitanturok]

Currently using custom forks of packages to resolve installation issues:

• https://[email protected]/eitanturok/stk for stanford-stk
• https://[email protected]/eitanturok/grouped_gemm for grouped_gemm

Blocked until these are merged. @dakinggg

[eitanturok]

Closing this PR since #127 changed a lot of things.