The Common Crawl team presented a seminar at Stanford HAI entitled “Preserving Humanity's Knowledge and Making it Accessible: Addressing Challenges of Public Web Data”.
commoncrawl.org/blog/common-...
If you were able to join us, let us know about your experience: docs.google.com/forms/d/e/1F...
Thank you everyone for coming to WMDQS (pronounced "whim ducks")!
WMDQS is underway! Come join us in Room 520A at @colmweb.org! #COLM2025
Looking forward to tomorrow's #COLM2025 workshop on multilingual data quality! 🤩
In collaboration with @commoncrawl.bsky.social, MLCommons, and @eleutherai.bsky.social, the first edition of WMDQS at @colmweb.org starts tomorrow in Room 520A! We have an updated schedule on our website, including a list of all accepted papers.
We introduce the TableEval benchmark and investigate the effectiveness and robustness of text-based and multimodal LLMs on table understanding through a cross-domain & cross-modality evaluation.
Joint work by DFKI SLT incl. Fabio Barth, Raia Abu Ahmad, @malteos.bsky.social @pjox.bsky.social
If you want to help us improve language and cultural coverage, and build an open source LangID system, please register to our shared task on Language Identification! 💬
Registering is easy! All the details are on the shared task webpage: wmdqs.org/shared-task/
Deadline: July 23, 2025 (AoE) ⏰
Just a few days left to contribute annotations before the first release of training data. We have over 17,000 document annotations so far!
In June 2025 the Common Crawl Foundation, MLCommons, and EleutherAI had the pleasure of hosting a virtual hackathon in partnership with Masakhane in order to collect language identification annotations for African languages.
commoncrawl.org/blog/the-fir...
The Common Crawl Foundation team took part in the United Nations Open Source Week in New York City this June, meeting with global developers, researchers, and policymakers to discuss all things open source and AI.
commoncrawl.org/blog/common-...
The deadline for paper submissions has been extended!
The new deadline is July 3, 2025. AoE.
For more information, please visit: wmdqs.org
The Common Crawl Foundation, together with IBM, the AI Alliance, and BrightQuery will be hosting an "UN Conference" at IBM's new flagship NYC HQ at One Madison Avenue on Friday, June 20, from 12:30-5pm.
If you are in NYC, it would be great to see you there!
lu.ma/p0a1scde
Call for papers!
We are organising the 1st Workshop on Multilingual Data Quality Signals with @mlcommons.org and @eleutherai.bsky.social, held in tandem with @colmweb.org. Submit your research on multilingual data quality!
Submission deadline is 23 June, more info: wmdqs.org
I’ll be running the Paris Marathon this Sunday for cancer research and treatment 🏃🏻♂️
Please donate if you can! Every donation no matter how small, helps immensely.
marathon-paris.dossards-solidaires.org/fundraisers/...
We would like to welcome all of our attending members to Oslo, with a special welcome to two of our newest members, the Publications Office of the European Union and @commoncrawl.bsky.social!
@nettarkivet.bsky.social | #iipcGA25 | #webarchiving
I don’t know if it is good (and I haven’t tried it), but I found this the other day: www.cherico.fr
Same thing is true for coffee, prices haven’t increased much in the last 60 years, but the cost of living for the producers has skyrocketed in recent years 😢
Today is "I love Free Software Day".
Thank you to the @commoncrawl.bsky.social Foundation for all their hard work. Onwards! @pjox.bsky.social - So great to meet in person.
I’ll be today at the AI Action Summit in Paris, if you’re attending and want to discuss about @commoncrawl.bsky.social or about open data, please DM me!
We're very happy to release cc-downloader, a new CLI tool to download Common Crawl data 📚🚀🧑💻
cc-downloader is still under active development, so if you find any issues or would like to submit a feature request, please visit its GitHub repository at github.com/commoncrawl/....
If you care about open data or anything related to crawling, The Common Crawl Foundation @commoncrawl.bsky.social is now on Bluesky 📊📈📚🥳
😂 No worries, I do mostly Rust and Python these days 🦀
Report of Pedro's Berlin Marathon splits, first half time was 2:06:57 and second half was 2:44:01. Final time was 4:50:58.
Photo of Pedro holding his medal in front of the Brandenburg Gate.
Photo of Pedro's Bib number (26445) and his medal.
Ran the Berlin marathon yesterday and while it was not my best marathon and I was recovering from injury, I had an amazing time. I really hope I can do better next year in Paris where I'll run for cancer research. If you can donate please do so: marathon-paris.dossards-solidaires.org/fundraisers/...
If you can and want to give a donation to the Gustave Roussy Institute, however small, I'd be extremely grateful. If you cannot donate, resharing/boosting is always appreciated! Thank you! ❤️
I decided to run the 2025 Paris Marathon for the Gustave Roussy Institute, the Leading Cancer Centre in Europe. This is a cause close to my heart, as cancer has touched my family, my friends and colleagues:
marathon-paris.dossards-solidaires.org/fundraisers/...
Pedro’s medal and bib (number 77156) for the Paris Marathon.
Pedro’s splits for the Paris Marathon and final time of 4:47:33. Full readable results should be available in https://resultscui.active.com/participants/45607218
Ran the Paris Marathon yesterday. It was an amazing experience. Getting into running was probably the best decision I’ve made in recently. It has helped massively with both physical and mental health. I highly recommend any type of physical activity, especially for researchers 🏃🏻♂️
Thank you! 😄
Pedro at the Branderburg gate after finishing the Berlin Marathon.
Pedro’s medal for finishing the Berlin Marathon, time reads 5:03:04
I still don’t know how, but I finished my first marathon in 5:03:04 🥹
