Credit: The logo has been designed by Cormullion diff --git a/assets/logos_20240205/README/index.html b/assets/logos_20240205/README/index.html index b9a04fc..f1bc6cb 100644 --- a/assets/logos_20240205/README/index.html +++ b/assets/logos_20240205/README/index.html @@ -34,7 +34,7 @@
Original GH Issue: https://github.com/cormullion/graphics/issues/27#issuecomment-1923457407
Credit: The logo has been designed by Cormullion diff --git a/index.html b/index.html index 9ab0291..65f7db6 100644 --- a/index.html +++ b/index.html @@ -1 +1 @@ -
JuliaGenAI
JuliaGenAI is a GitHub organization created to promote Julia as a tool for generative artificial intelligence applications, development, and research. The organization is not intended to usurp robust tools like llama.cpp, ggml, ollama, etc.
Rather, JuliaGenAI is intended to provide a platform for furthering access to these tools in Julia, as well as to motivate the development of new tools and libraries for generative AI.
You can see which language models tend to perform best on Julia code generation here.
Google Summer of Code 2024 with JuliaGenAI
JuliaGenAI is participating in Google Summer of Code 2024 and is currently seeking students to work on a variety of projects. Leap into JuliaGenAI's Google Summer of Code: Unleash your potential, learn about practical applications, and make pivotal contributions in the exciting world of generative AI with Julia—a chance to grow, impact, and thrive in an expanding ecosystem.
Related packages
JuliaGenAI is a new organization, and as such, it is still in the process of developing its first packages. However, we have several packages that represent the type of work we hope to promote. Please see the Awesome List for GenAI meets Julia Language.
Interfaces to existing tools
PromptingTools.jl. Streamline your life using PromptingTools.jl, the Julia package that simplifies interacting with large language models.
LLMTextAnalysis.jl. Effortlessly uncover and label thematic insights in large document collections using the power of Large Language Models and Julia Language.
OpenAI.jl. A community-maintained Julia wrapper to the OpenAI API.
BytePairEncoding.jl. Pure Julia implementation of Byte Pair Encoding (BPE) algorithm. It's used by Transformers.jl to tokenize text.
Llama.jl. Julia interface to llama.cpp, a C/C++ library for running language models locally. Supports a wide range of models.
AIHelpMe.jl. AIHelpMe harnesses the power of Julia's extensive documentation and advanced AI models to provide tailored coding guidance. By integrating with PromptingTools.jl, it offers a unique, AI-assisted approach to answering your coding queries directly in Julia's environment.
Model training and inference
Lux.jl. A purely functional deep learning framework for Julia, in the spirit of Jax. Lux supports many predefined layers, including attention layers through Boltz.
Flux.jl. Flux is the most popular deep learning library for Julia. It is performant, flexible and allows the building of complex models. However, at the time of writing, We're not aware of any Large Language Models (LLMs) that have been trained in Flux. Flux is to Lux what pytorch is to Jax, in particular stateful vs stateless, although the two julia libraries share very similar interfaces.
Llama2.jl. Llama2.jl provides simple code for inference and training of llama2-based language models based on llama2.c. It supports loading quantized weights in GGUF format (
q4_K_Svariant). Training is only experimental at this stage.Transformers.jl. Transformers.jl is a Julia package built on to top of Flux.jl that provides a high-level API for using pre-trained transformer models. It also allows to download any model from the Hugging Face hub with
@hgf_strmacro string.
Why Julia?
Julia is a fantastic tool for generative AI, for several reasons.
Expressiveness. Julia is a high-level language with a powerful syntax that is token-cheap – that is, you get a lot of "program" per token. It's not unlikely that AI agents will be writing code on their own in a lightly monitored way, and Julia's syntax is well-suited to low-cost AI code generation.
Interactiveness. Julia is a just-in-time compiled language, which means that it's fast to run, but also fast to develop in. This is important for AI development, where the ability to quickly prototype and test ideas is crucial. It has first-in-class REPL (read-eval-print loop) support, which could potentially be very important for rapid prototype development.
Performance. Julia is fast. Nuff' said.
Community. Julia has a fantastic community, and it's growing. This is important for the development of AI tools, as it means that there are more people to help develop and maintain the tools that we need.
Ecosystem. Julia has a fantastic and growing ecosystem built by a wonderful community of developers.
How to contribute
We are always looking for new contributors. If you have an idea for a package, or if you would like to contribute to an existing package, please feel free to reach out to us. We are also looking for people to help with documentation, testing, and other non-coding tasks.
Alternatively, you might be interested in participating in the Google Summer of Code 2024 with JuliaGenAI.
Contact
You can reach out to the organizing committee:
Cameron Pfiffer at cameron@pfiffer.org
Jan Siml (Slack: @svilup / Zulip: Jan Siml)
You can reach us on the Julia Slack & Zulip at the #generative-ai channel. You can also find us at the Discord server, or the discussion forum at discourse.julialang.org.
Credit: The logo has been designed by Cormullion
JuliaGenAI
JuliaGenAI is a GitHub organization created to promote Julia as a tool for generative artificial intelligence applications, development, and research. The organization is not intended to usurp robust tools like llama.cpp, ggml, ollama, etc.
Rather, JuliaGenAI is intended to provide a platform for furthering access to these tools in Julia, as well as to motivate the development of new tools and libraries for generative AI.
You can see which language models tend to perform best on Julia code generation here.
Google Summer of Code 2024 with JuliaGenAI
JuliaGenAI is participating in Google Summer of Code 2024 and is currently seeking students to work on a variety of projects. Leap into JuliaGenAI's Google Summer of Code: Unleash your potential, learn about practical applications, and make pivotal contributions in the exciting world of generative AI with Julia—a chance to grow, impact, and thrive in an expanding ecosystem.
Organization packages
HuggingFaceDatasets.jl that wraps the python
datasetspackage from huggingface. Thanks to Carlo Lucibello for the package!
Related packages
JuliaGenAI is a new organization, and as such, it is still in the process of developing its first packages. However, we have several packages that represent the type of work we hope to promote. Please see the Awesome List for GenAI meets Julia Language.
Interfaces to existing tools
PromptingTools.jl. Streamline your life using PromptingTools.jl, the Julia package that simplifies interacting with large language models.
LLMTextAnalysis.jl. Effortlessly uncover and label thematic insights in large document collections using the power of Large Language Models and Julia Language.
OpenAI.jl. A community-maintained Julia wrapper to the OpenAI API.
BytePairEncoding.jl. Pure Julia implementation of Byte Pair Encoding (BPE) algorithm. It's used by Transformers.jl to tokenize text.
Llama.jl. Julia interface to llama.cpp, a C/C++ library for running language models locally. Supports a wide range of models.
AIHelpMe.jl. AIHelpMe harnesses the power of Julia's extensive documentation and advanced AI models to provide tailored coding guidance. By integrating with PromptingTools.jl, it offers a unique, AI-assisted approach to answering your coding queries directly in Julia's environment.
Model training and inference
Lux.jl. A purely functional deep learning framework for Julia, in the spirit of Jax. Lux supports many predefined layers, including attention layers through Boltz.
Flux.jl. Flux is the most popular deep learning library for Julia. It is performant, flexible and allows the building of complex models. However, at the time of writing, We're not aware of any Large Language Models (LLMs) that have been trained in Flux. Flux is to Lux what pytorch is to Jax, in particular stateful vs stateless, although the two julia libraries share very similar interfaces.
Llama2.jl. Llama2.jl provides simple code for inference and training of llama2-based language models based on llama2.c. It supports loading quantized weights in GGUF format (
q4_K_Svariant). Training is only experimental at this stage.Transformers.jl. Transformers.jl is a Julia package built on to top of Flux.jl that provides a high-level API for using pre-trained transformer models. It also allows to download any model from the Hugging Face hub with
@hgf_strmacro string.
Why Julia?
Julia is a fantastic tool for generative AI, for several reasons.
Expressiveness. Julia is a high-level language with a powerful syntax that is token-cheap – that is, you get a lot of "program" per token. It's not unlikely that AI agents will be writing code on their own in a lightly monitored way, and Julia's syntax is well-suited to low-cost AI code generation.
Interactiveness. Julia is a just-in-time compiled language, which means that it's fast to run, but also fast to develop in. This is important for AI development, where the ability to quickly prototype and test ideas is crucial. It has first-in-class REPL (read-eval-print loop) support, which could potentially be very important for rapid prototype development.
Performance. Julia is fast. Nuff' said.
Community. Julia has a fantastic community, and it's growing. This is important for the development of AI tools, as it means that there are more people to help develop and maintain the tools that we need.
Ecosystem. Julia has a fantastic and growing ecosystem built by a wonderful community of developers.
How to contribute
We are always looking for new contributors. If you have an idea for a package, or if you would like to contribute to an existing package, please feel free to reach out to us. We are also looking for people to help with documentation, testing, and other non-coding tasks.
Alternatively, you might be interested in participating in the Google Summer of Code 2024 with JuliaGenAI.
Contact
You can reach out to the organizing committee:
Cameron Pfiffer at cameron@pfiffer.org
Jan Siml (Slack: @svilup / Zulip: Jan Siml)
You can reach us on the Julia Slack & Zulip at the #generative-ai channel. You can also find us at the Discord server, or the discussion forum at discourse.julialang.org.
Credit: The logo has been designed by Cormullion