Enable Enzyme

[Red-Portal]

• Update Enzyme external dependency to match the new AD interface
• Enable unit tests with Enzyme

Currently, this PR depends on upstream the following upstream issues:

• Enzyme doesn't work for AdvancedVI EnzymeAD/Enzyme.jl#1548
• Fix julia decl EnzymeAD/Enzyme#1933
• Don't bother rewriting known calls EnzymeAD/Enzyme.jl#1550

[Red-Portal]

@wsmoses It seems Enzyme is hitting some C++-level errors on 1.7. All tests do pass on 1.10 though. Is Enzyme not expected to work on 1.7 or should I try to pack a MWE just for 1.7?

[wsmoses]

So 1.7 and below have known GC bugs in Julia so support is weaker than 1.10. That said it should work so an MWE is welcome (and feel free to merge 1.10 here in the interim and we can follow up with a 1.7 PR once a MWE is opened and fixed).

…

On Sat, Aug 10, 2024 at 4:55 PM Kyurae Kim ***@***.***> wrote: @wsmoses <https://github.com/wsmoses> It seems Enzyme is hitting some C++-level errors on 1.7. All tests do pass on 1.10 though. Is Enzyme not expected to work on 1.7 or should I try to pack a MWE just for 1.7? — Reply to this email directly, view it on GitHub <#67 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAJTUXD6Q57IOE676CNBWZLZQZ443AVCNFSM6AAAAABJVGQH5WVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEOBSGI3TKMZXGI> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[Red-Portal]

@wsmoses Unfortunately, some of the tests on 1.10 are still failing, though I can't reproduce it locally. Seems like there is still some work left to do 😞

[Red-Portal]

Hurray, all the tests finally passed! Thank you so much @wsmoses for the amazing real-time work!

[yebai]

@Red-Portal Great work. Some minor comments on how to manage PRs for future reference: it is better to

1. let someone else review the PR before merging.
2. keep changes in PR specific to one thing, e.g. this PR changes lots of interfaces and internals, together with the Enzyme work

This PR is causing lots of merging conflicts in #71.