SourcererCC

What SourcererCC is

SourcererCC is free GPL-3.0 software for token-based code clone detection across very large codebases and Internet-scale repositories. It can compare complete files, methods, statements, or blocks, and the project says any programming language can be handled when tokenizer settings and file extensions are configured. Source must be tokenized before detection. The default similarity threshold is 80%, and users can change it. File-level detection ignores files below 65 tokens or above 500,000 tokens under the documented defaults. A controller divides work across multiple nodes, after which results are aggregated. The project provides a virtual-machine artifact with prepared steps from raw source through a database of clone mappings. DéjàVu is described as a supporting web tool for quick clone analysis. SourcererCC is intended for Linux and self-hosted use. The tutorial warns that tokenizer multiprocessing does not work on Macs with Python versions later than 3.6 and recommends avoiding that workflow on Mac.