Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PyTorch interface #235

Open
wants to merge 130 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
130 commits
Select commit Hold shift + click to select a range
89ad918
torch wip
chhwang May 27, 2024
ab1998e
Update ut-cuda.yml
chhwang May 27, 2024
ece4f55
torch wip
chhwang May 27, 2024
952b761
runtime module
chhwang May 27, 2024
a409268
fix
chhwang May 27, 2024
8e46227
fix
chhwang May 27, 2024
eee7ec2
some fixes
chhwang May 28, 2024
87b9b01
Python API Multiple Runtime Support (#216)
naturalcandy Jun 18, 2024
9a0556b
cmake dlpack
chhwang Jun 18, 2024
75f7831
include dlpack for pybind
chhwang Jun 18, 2024
94b44f2
support d2d copy
chhwang Jun 24, 2024
20c23f3
lint
chhwang Jun 24, 2024
ebe8560
Seperate DLPack from C++ interfaces
chhwang Jun 25, 2024
08c9b89
Update workflow trigger
chhwang Jun 25, 2024
1fa08af
expose exceptions
chhwang Jun 25, 2024
59caff1
Build python module by default
chhwang Jun 26, 2024
0bf1962
Merge branch 'main' into chhwang/python
chhwang Jun 29, 2024
efb2c78
revert
chhwang Jun 29, 2024
8975f9d
Do not use `sys.path` for importing `_ark_core`
chhwang Jun 29, 2024
153837b
wip
chhwang Jul 2, 2024
ff8c4b8
torch to ark (#217)
naturalcandy Jul 3, 2024
fe35541
wip
chhwang Jul 3, 2024
0cb10b9
fix a reduction perf bug
chhwang Jul 3, 2024
0fde9c5
optimize
chhwang Jul 4, 2024
c4be6d1
wip
chhwang Jul 5, 2024
cc30912
optimization
chhwang Jul 5, 2024
34a87d8
optimize
chhwang Jul 8, 2024
866112d
optimize
chhwang Jul 9, 2024
68e787a
fix bf16 matmul
chhwang Jul 9, 2024
a149abb
Merge branch 'main' into chhwang/python
chhwang Jul 9, 2024
b18bdb2
Enhance executor interfaces
chhwang Jul 10, 2024
2154690
Update lint workflow
chhwang Jul 10, 2024
705f9f8
Optimize operators
chhwang Jul 11, 2024
a3114e4
fix
chhwang Jul 11, 2024
6a0cd1a
Merge branch 'main' into chhwang/fix-kernels
chhwang Jul 11, 2024
d5bc723
Merge branch 'main' into chhwang/executor-interface
chhwang Jul 11, 2024
f01afaa
Merge branch 'chhwang/fix-kernels' into chhwang/executor-interface
chhwang Jul 11, 2024
860a68f
Merge branch 'main' into chhwang/python
chhwang Jul 11, 2024
03361f9
Merge branch 'chhwang/executor-interface' into chhwang/python
chhwang Jul 11, 2024
6116424
delete an unused file
chhwang Jul 11, 2024
67e3b26
update test
chhwang Jul 11, 2024
f293383
Merge branch 'chhwang/fix-kernels' into chhwang/executor-interface
chhwang Jul 11, 2024
f7a98fc
Merge branch 'chhwang/executor-interface' into chhwang/python
chhwang Jul 11, 2024
e1f178b
fix merge & updates
chhwang Jul 12, 2024
ce1959e
Add `loop_mode` argument
chhwang Jul 12, 2024
eae8972
Merge branch 'chhwang/executor-interface' into chhwang/python
chhwang Jul 12, 2024
55755bb
do not force noinline
chhwang Jul 14, 2024
b29eaae
wip
chhwang Jul 14, 2024
cfabc2f
Merge branch 'chhwang/fix-kernels' into chhwang/executor-interface
chhwang Jul 14, 2024
eddabe7
Merge branch 'chhwang/executor-interface' into chhwang/python
chhwang Jul 14, 2024
a7a5d46
Fix CK tile indexing
chhwang Jul 14, 2024
14f3a97
Merge branch 'chhwang/fix-kernels' into chhwang/executor-interface
chhwang Jul 14, 2024
ce96890
Merge branch 'chhwang/executor-interface' into chhwang/python
chhwang Jul 14, 2024
c72b907
Merge branch 'main' into chhwang/executor-interface
chhwang Jul 15, 2024
9c19a5e
wip
chhwang Jul 29, 2024
ef3bb84
plan manager
chhwang Jul 29, 2024
7a7f70e
fix
chhwang Jul 30, 2024
a77a2ea
llama example
chhwang Jul 30, 2024
28cf7dd
Merge branch 'chhwang/executor-interface' into chhwang/python
chhwang Jul 31, 2024
8192b90
Merge branch 'main' into chhwang/executor-interface
chhwang Aug 6, 2024
ffd43fd
Merge branch 'main' into chhwang/executor-interface
chhwang Aug 6, 2024
78ac0da
fix merge
chhwang Aug 6, 2024
afb518a
fix merge
chhwang Aug 6, 2024
01fa569
Merge branch 'main' into chhwang/executor-interface
chhwang Aug 6, 2024
762bf4a
fix merge
chhwang Aug 6, 2024
f654f0b
add a python method
chhwang Aug 6, 2024
498926c
submodule update
chhwang Aug 6, 2024
3e331a2
fix
chhwang Aug 6, 2024
10bfa75
Rename CMake environments
chhwang Aug 6, 2024
745fa1b
Merge branch 'chhwang/cmake' into chhwang/executor-interface
chhwang Aug 6, 2024
3dda44a
A few fixes & improved coverage
chhwang Aug 6, 2024
e96669b
Merge branch 'main' into chhwang/executor-interface
chhwang Aug 6, 2024
dba78c5
Merge branch 'chhwang/executor-interface' into chhwang/python
chhwang Aug 6, 2024
12b1e58
Merge branch 'chhwang/executor-interface' into chhwang/python
chhwang Aug 6, 2024
4971601
fix merge
chhwang Aug 6, 2024
6ce576a
Merge branch 'chhwang/python' of https://github.com/microsoft/ark int…
chhwang Aug 6, 2024
28b8395
Update runtime.py
chhwang Aug 6, 2024
11901c4
fix
chhwang Aug 7, 2024
3008e7f
Merge branch 'chhwang/executor-interface' into chhwang/python
chhwang Aug 7, 2024
359ed21
Merge branch 'main' into chhwang/torch
chhwang Aug 8, 2024
c0cbf19
lint
chhwang Aug 8, 2024
8583d1b
updates
chhwang Aug 10, 2024
8c2562b
remove runtime ID
chhwang Aug 11, 2024
9b265c7
Fix communication
chhwang Aug 11, 2024
5d5342a
Add `Tensor::torch_strides` method
chhwang Aug 11, 2024
598cb78
Torch Support (#237)
naturalcandy Aug 11, 2024
28ce027
Minor changes
chhwang Aug 11, 2024
b8e13b4
a few fixes & more verfication
chhwang Aug 11, 2024
5ba79f9
Align C++ Executor interface with Python interface
chhwang Aug 12, 2024
b0176ad
lint
chhwang Aug 12, 2024
4db38e1
minor fix
chhwang Aug 12, 2024
15d423b
more fixes
chhwang Aug 12, 2024
802d84f
error handling
chhwang Aug 12, 2024
18a391f
fix unit test
chhwang Aug 12, 2024
7ae0a65
updates
chhwang Aug 12, 2024
4cca609
fix unit test
chhwang Aug 12, 2024
45b14b8
fix imports & pytest
chhwang Aug 14, 2024
f7c6867
fix codecov
chhwang Aug 15, 2024
66b78a7
Add placeholder operator (#239)
chhwang Aug 19, 2024
55f5c51
PyTorch tracer (#243)
chhwang Aug 26, 2024
7a31914
small fix
chhwang Aug 26, 2024
135929e
wip
chhwang Aug 30, 2024
8b46039
Python logging & changed Python class names
chhwang Sep 5, 2024
f788b3d
Merge branch 'chhwang/py-log' into chhwang/torch
chhwang Sep 5, 2024
9919d69
revert
chhwang Sep 5, 2024
2d0b9f0
revert
chhwang Sep 5, 2024
ec4e081
lint
chhwang Sep 5, 2024
55e73f2
Improve coverage
chhwang Sep 5, 2024
95f29b8
lint
chhwang Sep 5, 2024
0e3bfc9
Merge branch 'chhwang/py-log' into chhwang/torch
chhwang Sep 5, 2024
771a41d
Merge branch 'main' into chhwang/torch
chhwang Sep 5, 2024
006af24
updates
chhwang Sep 6, 2024
19d56dd
updates
chhwang Sep 6, 2024
d891914
codegen fix wip
chhwang Sep 17, 2024
706a995
updates
chhwang Sep 22, 2024
b8c55d8
a few fixes
chhwang Sep 26, 2024
b9f35d9
all transpose removed
chhwang Sep 26, 2024
dfae17b
A few fixes
chhwang Sep 27, 2024
97ab2df
multiple resource groups
chhwang Sep 27, 2024
2a0e1a0
fix
chhwang Sep 27, 2024
dae1bb2
fix
chhwang Sep 27, 2024
73aee74
update
chhwang Sep 27, 2024
a711d3e
update
chhwang Sep 28, 2024
9b03feb
updates
chhwang Sep 30, 2024
6b5550e
update
chhwang Sep 30, 2024
f428ea8
update
chhwang Sep 30, 2024
2075a05
update
chhwang Sep 30, 2024
0e33e20
fixes
chhwang Sep 30, 2024
dfc574d
minor fix
chhwang Sep 30, 2024
02bf517
delete test
chhwang Sep 30, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions .gitmodules
Original file line number Diff line number Diff line change
Expand Up @@ -17,3 +17,7 @@
[submodule "third_party/json"]
path = third_party/json
url = https://github.com/nlohmann/json

[submodule "third_party/dlpack"]
path = third_party/dlpack
url = https://github.com/dmlc/dlpack
1 change: 1 addition & 0 deletions .vscode/c_cpp_properties.json
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@
"name": "Linux",
"includePath": [
"${workspaceFolder}/**",
"${workspaceFolder}/third_party/mscclpp/include",
"/usr/local/cuda/include",
"/opt/rocm/include"
],
Expand Down
1 change: 1 addition & 0 deletions ark/CMakeLists.txt
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,7 @@ set(COMMON_LIBS ARK::numa ARK::ibverbs pthread rt)
target_include_directories(ark_obj PUBLIC ${CMAKE_CURRENT_SOURCE_DIR}/include)
target_include_directories(ark_obj PRIVATE ${CMAKE_CURRENT_SOURCE_DIR})
target_include_directories(ark_obj SYSTEM PRIVATE
${DLPACK_INCLUDE_DIRS}
${JSON_INCLUDE_DIRS}
${MSCCLPP_INCLUDE_DIRS}
${IBVERBS_INCLUDE_DIRS}
Expand Down
4 changes: 4 additions & 0 deletions ark/api/context.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -29,4 +29,8 @@ void Context::set(const std::string& key, const std::string& value,
this->impl_->set(key, value_json, type);
}

std::string Context::dump() const {
return this->impl_->dump().dump();
}

} // namespace ark
Loading
Loading