List details about dangling commits (Git – Finding Lost/Dangling Commits:
git fsck --lost-found | grep "^dangling commit" | sed "s/^dangling commit //g" | xargs git show -s --oneline
Cleanup:
git reflog expire --expire=now --all git gc --prune=now --aggressive git repack -a -d
It is important to check if git configured with default settings. Especially forcing of creation of multiple smaller packs significantly increases repository size. I.e. changing one 1.2G pack into multiple 256MB packs let, increases size of packs to 4.3GB :(
git config --global -l git config --system -l
Especially take attention for options like:
Command
git gc
and other cleaning commands requires whole repository to be read into memory. For big repos (like kernel.git) it requires to allocate over 8GB of RAM. Compression of objects is also performed in RAM, then packs are written onto disc. https://stackoverflow.com/questions/42175296/git-gc-uses-a-lot-of-memory-even-i-limited-it
To prevent touching existing packs and exhaust system memory paramter auto
should be used.
git gc --auto
Another possibility is to mark some packs as keep
by creating .keep files.
Remove unreachable objects:
git count-objects -v git gc --auto # this is enough to remove loose objects and repack repo git count-objects -v # more instruction git repack -Ad # Remove dangling objects from packfiles git prune # Remove dangling loose objects git gc --aggressive --prune=now --force || rm -f .git/objects/*/tmp_* && rm -f .git/objects/*/.tmp-* git count-objects -v
git was killed by host monitor process or oom due to memory usage. Check syslog for OOM entries.
Solution:
[core] packedGitLimit = 32m packedGitWindowSize = 32m deltaCacheSize = 10m
Disable compression:
git config core.compression 0 git config core.loosecompression 0 git config pack.window 0
git command running under user 'git' with gitlab installed looks for configuration in following places:
This is a user config gile, and file is generated form
/opt/gitlab/embedded/cookbooks/gitlab/templates/default/gitconfig.erb
But if git binary from gitlab is used
sudo -u git -H "/opt/gitlab/embedded/bin/git" config -l
/opt/gitlab/embedded/bin/git --git-dir=/home/git-data/repositories/funny/linux.git config -l /opt/gitlab/embedded/bin/git --git-dir=/home/git-data/repositories/funny/linux.git bundle create /tmp/linux.bundle --all
then, file /opt/gitlab/embedded/etc/gitconfig
is used.
To modify this file:
omnibus_gitconfig['system'] = {. "core" => ["packedGitLimie = 32m", "packedGitWindowSze = 32m", "deltaCacheSize = 32m" ], "receive" => ["fsckObjects = true"], "pack" => ["deltaCacheSize = 32m", "packSizeLimit = 32m", "windowMemory = 32m", "threads = 2" ] }
Test config:
gitlab-ctl show-config
Regenerate config:
gitlab-ctl reconfigure
sudo -u git bash cd /var/opt/gitlab/git-data/repositories/{namespace}/{repository}.git git gc --aggressive