Git to SQLite

A research on how to save Git log to database for Coco

Architecture

1. parse git log
2. parse log by line to commit
3. save commit to json file
4. read json file and save to db

Performance logs

Without Changes

• Machine: MacBook Pro (15-inch, 2018)
• Processor: 2.2 GHz 6-Core Intel Core i7
• Memory: 16 GB 2400 MHz DDR4

Project Name	Project Commits	Time	Times(ms)
Rust Regex	1078	3s	2919ms ~ 3012ms
Lombok	3127	8s	8096ms ~ 8616ms
Nginx	6805	32s	32468ms ~ 33967ms
Redis	10009	67s	65328ms ~ 71616ms
Spring Framework	22133	706s
Graal	49026	1425s
Gradle	78711	4130s

With Changes in Serial

111063ms

Project Name	Project Commits	Times(ms)
Coco	405	111063ms
Rust Regex	1078	> 6000000ms

With Changes in JSON

Project Name	Project Commits	Time	Times(ms)	Size
Rust Regex	1078	3s	6771ms	598M
Lombok	3127	8s	25541ms	2.4G
Nginx	6805	32s	207398ms	11G
Redis	10009	67s	248299ms

Todo

• 获取所有的提交 id (Change to list all commits)
• 将提交 ID 分段，获取不同的 ID (and run git to split commits)

Or

• Changes of half year

Solution Strategy

1. summary all commits
2. summary all changes, count changes size
3. fetch recently 10000 changes ? or half years change by commit_id?
4. count relations?

License

@ 2020~2021 This code is distributed under the MIT license. See LICENSE in this directory.