Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sharing models through Hugging Face Hub #54

Open
osanseviero opened this issue Oct 18, 2021 · 7 comments
Open

Sharing models through Hugging Face Hub #54

osanseviero opened this issue Oct 18, 2021 · 7 comments
Assignees
Labels
enhancement New feature or request

Comments

@osanseviero
Copy link

Hi there!

This project is very cool. I see you host and share models with your own hosted server. Would you be interested in sharing your models in the Hugging Face Hub? The Hub offers free hosting of over 25K models, and it would make your work more accessible and visible to the rest of the ML community. We can help you set up a Qurator organization if it makes sense.

Some of the benefits of sharing your models through the Hub would be:

  • wider reach of your work to the ecosystem
  • freely hosted demos with Streamlit/Gradio. See demos from TrOCR and DocTR.
  • versioning, commit history and diffs
  • repos provide useful metadata about their tasks, languages, metrics, etc that make them discoverable
  • multiple features from TensorBoard visualizations, PapersWithCode integration, and more

Creating the repos and adding new models should be a relatively straightforward process if you've used Git before. This is a step-by-step guide explaining the process in case you're interested. Please let us know if you would be interested and if you have any questions.

Happy to hear your thoughts,
Omar and the Hugging Face team

cc @NielsRogge

@cneud
Copy link
Member

cneud commented Nov 10, 2021

Hi Omar and Hugging Face team,

Thank you for reaching out. Apologies for the delayed reply, but we have all our hands on the completion of a scientific publication about this tool (deadline next week), but I would very much like to get into this asap.

We are fans of HuggingFace and e.g. also produce BERT models for NER and EL on historical German text, similar to those from dbmdz. Given that Qurator is a fixed term funded project that ends soon, setting up an organization profile for the Berlin State Library, which is also the legal entity where we are based and just one of the partners in the Qurator project, would seem the most sensible to me. My one concern with this is the potential red tape that could follow internally from that.

Let me look into our internal procedures, and check the step-by-step guide more closely, and we will either start the setup process soon or get back to you in case of questions.

Meanwhile thanks again for contacting us and for the great services that HuggingFace provides. If we can benefit from it and contribute to extend its reach for NLP and computer vision in particular, that would be great.

Cheers from the @qurator-spk team

@cneud cneud self-assigned this Apr 25, 2022
@osanseviero
Copy link
Author

Hey all! I wanted to follow up after some time to see if this was still of interest from your side :)

cc @NimaBoscarino

@cneud
Copy link
Member

cneud commented Sep 15, 2022

Yes, we are still interested, albeit being very slow to proceed with this.

Meanwhile I've created an org account at https://huggingface.co/SBB and uploaded two of our models there (the Eynollah tool here requires up to 10 models, so we wanted to start with something more simple). We still need to update the model cards, upload some additional stuff, and then test how to set up demos.

There's also been some work under the scope of https://github.com/bigscience-workshop/lam which resulted in the publication of https://huggingface.co/datasets/biglam/berlin_state_library_ocr.

None of this has so far been officially approved by the org, who will only take a policy decision regarding this in 2023, so we will remain in "testing things out" mode at least until the end of this year.

@NimaBoscarino
Copy link

That sounds great! Let us know if there's anything that we can do to help out at any point, for example with creating the demos 😊

@cneud
Copy link
Member

cneud commented Aug 17, 2023

We may be slow, but we are persistent 😏

All models for this tool are now up on the HuggingFace Hub at https://huggingface.co/SBB, including initial model cards, which we will continue to refine further over the coming weeks.

As a next step we will look into this

freely hosted demos with Streamlit/Gradio. See demos from TrOCR and DocTR.

@cneud cneud added the enhancement New feature or request label Aug 17, 2023
@NielsRogge
Copy link

Awesome! I see all models are Keras models. Are you leveraging from_pretrained_keras to load models directly from the hub? https://huggingface.co/docs/hub/keras

@cneud
Copy link
Member

cneud commented Apr 23, 2024

@NielsRogge Now we do ;)

With many thanks to our colleague Dorian Grosch, we now finally have our suite of 13 Eynollah models available in a Hugging Face Space for demo purposes: https://huggingface.co/spaces/SBB/eynollah-demo. 🎉

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

4 participants