Skip to content

Issues: NVIDIA/NeMo-Aligner

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

63 Open 15 Closed
63 Open 15 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Fix dev branch's build after PTL upgrade bug Something isn't working
#418 opened Nov 22, 2024 by terrykong
@ko3n1g @maanug-nv
Will you support online DPO?
#414 opened Nov 21, 2024 by Shiguang-Guo
How can I use nvidia/Llama-3.1-Nemotron-70B-Reward-HF directly for inference?
#360 opened Oct 25, 2024 by arunasank
4
serve_reward_model goes down bug Something isn't working
#351 opened Oct 18, 2024 by AtsunoriFujita
3
attribute_annotate.py is not worked by KeyError: 'exceeded' bug Something isn't working
#349 opened Oct 18, 2024 by AtsunoriFujita
Unable to pip install nemo-aligner
#342 opened Oct 11, 2024 by SCccc21
@ko3n1g
1
[Question] Converting a Megatron-LM ckpt to nemo so we can use NeMo-Aligner for post-training
#340 opened Oct 10, 2024 by abgoswam
Error during saving checkpoint with TensorRT-enabled PPO actor training bug Something isn't working
#281 opened Sep 5, 2024 by haizadinia
2
[Question] TransfomerEngine and Apex dependencies bug Something isn't working
#278 opened Sep 2, 2024 by peri044
make build_dataloader not take in cfg
#273 opened Aug 28, 2024 by gshennvm
common class for aligner models
#272 opened Aug 27, 2024 by gshennvm
Request for Context Parallel Support in MegatronGPTDPOModel
#271 opened Aug 27, 2024 by Wolfwjs
Does NeMo Aligner support tensor parallel and pipeline parallel?
#265 opened Aug 15, 2024 by cizhenshi
GPTGenerateTRTLLM.trt_llm_exporter.refit failed due to empty weights in the refit engine during PPO actor training bug Something isn't working
#264 opened Aug 10, 2024 by renweizhukov
1
job hangs or IndexError when train reward model with PP> 1 bug Something isn't working
#251 opened Jul 24, 2024 by zirui
@ashors1
6
How to shuffle data before the start of each epoch?
#250 opened Jul 24, 2024 by Cppowboy
SFT not working on nemo:24.05.01 container bug Something isn't working
#236 opened Jul 13, 2024 by vecorro
3
better add_BOS and add_EOS support in reward models
#231 opened Jul 10, 2024 by gshennvm
reward-bench for Reward Model
#230 opened Jul 6, 2024 by lss11005
1
Policy Log Probs and Reference Log Probs differ at 1st iteration of DPO/RPO bug Something isn't working
#227 opened Jul 3, 2024 by shengyangs
@trias702 @gshennvm @shengyangs
LoRA for Reward Model Training
#225 opened Jul 2, 2024 by bugsz
Tutorial / Example for Single Node FP8 Inference?
#216 opened Jun 23, 2024 by noamgat
Multiple training file support bug Something isn't working
#207 opened Jun 15, 2024 by seanliu96
1
add packed dataset
#181 opened May 20, 2024 by gshennvm
2
Some code related to train_valid_test_num_samples may be wrong / unused bug Something isn't working
#176 opened May 17, 2024 by odelalleau
ProTip! Type g i on any issue or pull request to go back to the issue listing page.