I love geeky advent calendars. Among them, this year I really like Hugging Face "Open-source AI: year in review 2024", check it out! huggingface.co/spaces/huggi...
I love geeky advent calendars. Among them, this year I really like Hugging Face "Open-source AI: year in review 2024", check it out! huggingface.co/spaces/huggi...
Top organizations releasing open-source AI models over the course of 2024 (cumulative likes)
Interactive viz: huggingface-open-source-ai-year-in-review-2024.static.hf.space/index.html?d...
Discussion: huggingface.co/spaces/huggi...
The EuroLLM
- 1.7B and 9B parameter
- 24 EU languages (11 non EU)
- 4 trillion pre-training tokens
- beating European alternatives like Mistral
- Comparable to Gemma-2 models (non-EU)
- Apache 2 license
- π No dataset release
I found this positional encoding blog post very good!
huggingface.co/blog/designi...