Code

Attention mask with cuda graph#271

Code

Merged

wangyems merged 8 commits intomainmicrosoft/onnxruntime-genai:mainfrom wangye/attn_maskmicrosoft/onnxruntime-genai:wangye/attn_maskCopy head branch name to clipboardApr 18, 2024

+193-157

Commits

Commits on Apr 17, 2024

• revert seqlen_k/total_seq_len in model builder

  wangyems

  committed
  d20b3cc

  Copy full SHA for d20b3cc

• genai tool: remove seqlen_k/total_seq_len and add static buffer for attn mask and update kernels

  wangyems

  committed
  eb247c8

  Copy full SHA for eb247c8

Commits on Apr 18, 2024

• readme

  wangyems

  committed
  0eadc9f

  Copy full SHA for 0eadc9f

• Update README.md

  wangyems

  authored
  953e90c

  Copy full SHA for 953e90c

• update

  wangyems

  committed
  ee8a9f3

  Copy full SHA for ee8a9f3

• Merge branch 'wangye/attn_mask' of github.com:microsoft/onnxruntime-genai into wangye/attn_mask

  wangyems

  committed
  fecca46

  Copy full SHA for fecca46

• pass device allocator

  wangyems

  committed
  c5c862a

  Copy full SHA for c5c862a

• add link

  wangyems

  authored
  248b1c0

  Copy full SHA for 248b1c0