Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added support for loading and unloading models on the min-sync api #6

Merged
merged 19 commits into from
Nov 5, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
4d9efaf
feat(mnn-sync): Add a load-unload api
uttarayan21 Oct 25, 2024
ea77e6f
fix(mnn-sync): Ensure that the mnn-session-thread is alive when running
uttarayan21 Oct 25, 2024
2fdec58
chore(lints): Update ast-grep rules and update deny.toml
uttarayan21 Oct 25, 2024
e1a436a
feat(mnn-sync): Use the same ScheduleConfig for all load-unloads
uttarayan21 Oct 25, 2024
7b5f5d2
chore(lints): Fix all issues with linting
uttarayan21 Oct 28, 2024
0beac70
fix(build): Use cmake_cxx_standard instead of -std=c++14
uttarayan21 Oct 28, 2024
9566e95
feat(bindgen): Use stdc++14 for mnn_cpp bindgen
uttarayan21 Oct 29, 2024
4b5bb0c
fix(build): Fix build issues in nix for linux
uttarayan21 Nov 1, 2024
60e6895
chore(test): Ignore some tests since they fail on ci
uttarayan21 Nov 1, 2024
cf83f44
chore(tests): Ignore a few tests on CI
uttarayan21 Nov 4, 2024
ed8bf80
fix(docs): Fix the doctests
uttarayan21 Nov 4, 2024
0289b0e
feat(lints): added proper ast-grep rules for checking println and
uttarayan21 Nov 5, 2024
a0cee90
fix(mnn): Fix the issue with compilation
uttarayan21 Nov 5, 2024
a12812e
chore(flake): Update flake files and remove unused items
uttarayan21 Nov 5, 2024
bfc0101
feat(flake): Update flake to build with additional features for inspe…
uttarayan21 Nov 5, 2024
2f5d483
fix(flake): Typo use optionalString instead of optionals
uttarayan21 Nov 5, 2024
5d67c9e
fix(flake): Fix typo in flake.nix
uttarayan21 Nov 5, 2024
8bc7045
fix(flake): mnn-sys build Only build opencl (remove metal) from x86_6…
uttarayan21 Nov 5, 2024
59ce53c
feat: Update to 2.9.6
uttarayan21 Nov 5, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -6,3 +6,4 @@ target
lama
*.json
*.cache
result
1 change: 1 addition & 0 deletions .ignore
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
mnn-sys/vendor
137 changes: 133 additions & 4 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

1 change: 1 addition & 0 deletions Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -43,6 +43,7 @@ anyhow = "1.0"
bytemuck = "1.17"
clap = { version = "4.5", features = ["derive"] }
divan = "0.1.14"
# mnn-sync = { path = "mnn-sync" }

[[bench]]
name = "mnn-bench"
Expand Down
2 changes: 1 addition & 1 deletion deny.toml
Original file line number Diff line number Diff line change
Expand Up @@ -88,7 +88,7 @@ ignore = [
# List of explicitly allowed licenses
# See https://spdx.org/licenses/ for list of possible licenses
# [possible values: any SPDX 3.11 short identifier (+ optional exception)].
allow = ["MIT", "Apache-2.0", "BSD-3-Clause", "ISC", "Unicode-DFS-2016"]
allow = ["MIT", "Apache-2.0", "BSD-3-Clause", "ISC", "Unicode-DFS-2016", "Zlib"]
# The confidence threshold for detecting a license from license text.
# The higher the value, the more closely the license text must be to the
# canonical license text of a valid SPDX license file.
Expand Down
36 changes: 18 additions & 18 deletions flake.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading
Loading