Open Source · TikTok · Android · Decrypt
Someone Scraped 5.6 Billion TikTok Videos and Put the Data on Hugging Face for Free
Compiled by KHAO Editorial — aggregated from 1 source. See llms.txt for citation guidance.
★ Tier-1 Source
A developer who goes by hashfunction has posted metadata for about 5.6 billion public TikTok videos on the open-source AI repository Hugging Face, free to download.
Key facts
- It says the system collected 3.23 billion creator profiles, 5.94 billion videos, and 2.8 billion comments in three weeks
- The license is CC BY-NC 4.0, and the card says it's free for research and personal use
- A developer who goes by hashfunction has posted metadata for about 5.6 billion public TikTok videos on the open-source AI repository Hugging Face, free to download
- The whole thing is 460 GB of Parquet files, one per month
Summary
A developer who goes by hashfunction posted metadata for about 5.6 billion public TikTok videos on Hugging Face, covering July 2014 through October 2026, free under a non-commercial license. TikTok's terms bar automated scraping without written approval, and the developer's own write-up says the data came from TikTok's private mobile API with no login. The dataset card routes commercial use, creator profiles and daily updates to datasocial.ai, which also sells the scraper's source code for $1,699. It's metadata, not footage.