meta data for this page
  •  

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
git:issues [2017/03/01 11:20] – niziakgit:issues [2023/07/17 16:02] (current) – niziak
Line 1: Line 1:
 +====== Issues ======
 +
 +====== fsck: dangling commit =====
 +
 +List details about dangling commits ([[https://lukescott.co/2019/05/10/git-finding-lost-dangling-commits/|Git – Finding Lost/Dangling Commits]]:
 +<code bash>
 +git fsck --lost-found | grep "^dangling commit" | sed "s/^dangling commit //g" | xargs git show -s --oneline
 +</code>
 +
 +Cleanup:
 +<code bash>
 +git reflog expire --expire=now --all
 +git gc --prune=now --aggressive
 +git repack -a -d
 +</code>
 +
 +====== Reduce repo size ======
 +
 +
 +It is important to check if git configured with default settings.
 +Especially forcing of creation of multiple smaller packs significantly increases repository size.
 +I.e. changing one 1.2G pack into multiple 256MB packs let, increases size of packs to 4.3GB :(
 +<code bash>
 +git config --global -l
 +git config --system -l
 +</code>
 +
 +Especially take attention for options like:
 +  *  deltaCacheSize = 10m
 +  *  packSizeLimit = 10m
 +  *  windowMemory = 10m
 +
 +
 +Command <code bash>git gc</code> and other cleaning commands requires whole repository to be read into memory. For big repos (like kernel.git) it requires to allocate over 8GB of RAM.
 +Compression of objects is also performed in RAM, then packs are written onto disc.
 +[[https://stackoverflow.com/questions/42175296/git-gc-uses-a-lot-of-memory-even-i-limited-it]]
 +
 +
 +To prevent touching existing packs and exhaust system memory paramter ''auto'' should be used. <code bash>git gc --auto</code>
 +Another possibility is to mark some packs as ''keep'' by creating .keep files. 
 +
 +Remove unreachable objects:
 +<code bash>
 +
 +git count-objects -v
 +git gc  --auto # this is enough to remove loose objects and repack repo
 +git count-objects -v
 +
 +# more instruction
 +git repack -Ad # Remove dangling objects from packfiles
 +git prune # Remove dangling loose objects
 +git gc --aggressive --prune=now --force  || rm -f .git/objects/*/tmp_* && rm -f .git/objects/*/.tmp-*
 +
 +git count-objects -v
 +</code>
 +
 +
 +
 ====== error: pack-objects died of signal 9  ====== ====== error: pack-objects died of signal 9  ======
  
 +git was killed by host monitor process or oom due to memory usage.
 +Check syslog for OOM entries.
 +
 +Solution:
 <code bash> <code bash>
-git config pack.windowMemory 10m +[core] 
-git config pack.packSizeLimit 20m+    packedGitLimit = 32m 
 +    packedGitWindowSize = 32m 
 +    deltaCacheSize = 10m
 </code> </code>
 +
 +Disable compression:
 +<code bash>
 +git config core.compression 0
 +git config core.loosecompression 0
 +git config pack.window 0
 +</code>
 +
  
 === gitlab === === gitlab ===
Line 18: Line 90:
 But if git binary from gitlab is used But if git binary from gitlab is used
 <code bash>sudo -u git -H "/opt/gitlab/embedded/bin/git" config -l</code> <code bash>sudo -u git -H "/opt/gitlab/embedded/bin/git" config -l</code>
 +
 +<code bash>
 +/opt/gitlab/embedded/bin/git --git-dir=/home/git-data/repositories/funny/linux.git config -l
 +/opt/gitlab/embedded/bin/git --git-dir=/home/git-data/repositories/funny/linux.git bundle create /tmp/linux.bundle --all
 +</code>
 +
 then, file  ''/opt/gitlab/embedded/etc/gitconfig'' is used. then, file  ''/opt/gitlab/embedded/etc/gitconfig'' is used.
 To modify this file: To modify this file:
  
 <file ruby gitlab.rb> <file ruby gitlab.rb>
-omnibus_gitconfig['system'] = { "receive" => ["fsckObjects = true"], +omnibus_gitconfig['system'] = {. 
-                                "core" => ["packedGitLimit = 40m", "packedGitWindowSize = 40m"], +    "core"     => ["packedGitLimie = 32m", "packedGitWindowSze = 32m", "deltaCacheSize = 32m" ], 
-                                "pack" => ["deltaCacheSize = 40m", "packSizeLimit = 40m", "windowMemory = 40m", "threads = 1"] } +    "receive"  => ["fsckObjects = true"], 
 +    "pack"     => ["deltaCacheSize = 32m", "packSizeLimit = 32m", "windowMemory = 32m", "threads = 2" ] 
 +}
 </file> </file>
 +
 Test config: Test config:
-<code>gitlabctl show-config</code>+<code>gitlab-ctl show-config</code>
 Regenerate config: Regenerate config:
-<code>gitlabctl reconfigure</code>+<code>gitlab-ctl reconfigure</code>