Common Crawl Foundation

@CommonCrawl

Common Crawl is a non-profit foundation dedicated to the Open Web.

San Francisco, CA

Joined February 2010

2KFollowing

8KFollowers

Common Crawl Foundation@CommonCrawl · Jul 23

commoncrawl.org/blog/july-2025…

CommonCrawl's tweet card. The crawl archive for July 2025 is now available. Crawled between July 7th and July 21st, the data contains 2.42 billion web pages, or 419 TiB of uncompressed content.

238

Common Crawl Foundation@CommonCrawl · Jul 21

commoncrawl.org/blog/wmdqs-sha…

CommonCrawl's tweet card. The Common Crawl Foundation, MLCommons, EleutherAI, and John Hopkins' Center for Language and Speech Processing have the pleasure of inviting you to register for the 1st shared task on Language...

4.0K

Common Crawl Foundation@CommonCrawl · Jul 21

blogs.microsoft.com/on-the-issues/… "MOIC will also partner with Common Crawl, one of the largest free and open repositories of web crawled data. MOIC will fund work at Common Crawl, leveraging native speakers to annotate and seed European language data in the publicly available Common…

CommonCrawl's tweet card. Microsoft launches 2 initiatives to open Europe’s languages and culture, building on AI, cloud, and digital sovereignty commitments.

10.0K

Common Crawl Foundation Retweeted

Catherine Arnett @ ACL 🇦🇹@linguist_cat · Jun 9

One of the biggest obstacles to improving language technologies for low-resource languages is the lack of data. To address this, we need better language identification tools. So, we're organizing a shared task on Language Identification for Web Data!

1.0K

Common Crawl Foundation@CommonCrawl · Jul 8

commoncrawl.org/blog/the-first…

CommonCrawl's tweet card. In June 2025 the Common Crawl Foundation, MLCommons, and EleutherAI had the pleasure of hosting a virtual hackathon in partnership with Masakhane in order to collect language identification annotat...

282

Common Crawl Foundation@CommonCrawl · Jul 1

commoncrawl.org/blog/host--and…

CommonCrawl's tweet card. We are pleased to announce that the Web Graph for June 2025 is now available. The graph consists of 371.6 million nodes and 3.1 billion edges at the host level, and 161.8 million nodes and 2.2...

517

Common Crawl Foundation@CommonCrawl · Jun 30

commoncrawl.org/blog/common-cr…

CommonCrawl's tweet card. The Common Crawl Foundation team took part in the United Nations Open Source Week in New York City this June, meeting with global developers, researchers, and policymakers to discuss all things open...

343

Common Crawl Foundation@CommonCrawl · Jun 27

commoncrawl.org/blog/june-2025…

CommonCrawl's tweet card. We are pleased to announce that the crawl archive for June 2025 is now available.

264

Common Crawl Foundation@CommonCrawl · Jun 24

commoncrawl.org/blog/may-june-…

377

Common Crawl Foundation@CommonCrawl · Jun 20

prnewswire.com/news-releases/…

CommonCrawl's tweet card. /PRNewswire/ -- Today, the AI Alliance, a global collaboration of more than 180 organizations committed to AI open innovation, announced it has incorporated...

254

Common Crawl Foundation@CommonCrawl · Jun 12

commoncrawl.org/blog/announcin…

CommonCrawl's tweet card. Announcing a refreshed version of the Whirlwind Tour in Python. Get to know how to make the most of our crawl data.

253

Common Crawl Foundation@CommonCrawl · Jun 10

Common Crawl Foundation, together with IBM, the AI Alliance, and BrightQuery will be hosting an "UN Conference" at IBM's new flagship NYC HQ at One Madison Avenue on Friday, June 20, from 12:30-5pm. If you are in NYC or will be attending the UN Open Source Week, it would be…

6.0K

Common Crawl Foundation@CommonCrawl · May 29

commoncrawl.org/blog/host--and…