source{d} Datasets

Last updated 13 days ago

source{d} datasets for source code analysis and machine learning on source code (ML on Code).

This repository contains all the needed tools and scripts to reproduce the datasets, as well as the academic papers they may relate to.

Available datasets

Public Git Archive

  • Size: 3TB

  • Description: 180k+ top-bookmarked repositories from GitHub, consisting of 54M+ files and ~16 billion lines of code over 450+ programming languages.

Programming Language Identifiers

Code duplicates


Contributions are very welcome, please see and code of conduct.


The tools and scripts are licensed under Apache 2.0, see