LFS 기존 Commit 로그 제거하기 (BFG Repo-Cleaner)
Problem
git -c diff.mnemonicprefix=false -c core.quotepath=false --no-optional-locks push -v --tags --set-upstream origin dev:dev
Pushing to https://github.com/lipnus/cfd.git
POST git-receive-pack (chunked)
remote: warning: File Assets/Firebase/Plugins/x86_64/FirebaseCppApp-10_3_0.so is 75.83 MB; this is larger than GitHub's recommended maximum file size of 50.00 MB
remote: warning: File Assets/Plugins/iOS/Firebase/libFirebaseCppFirestore.a is 62.25 MB; this is larger than GitHub's recommended maximum file size of 50.00 MB
remote: error: Trace: 12e54aed7592073c9adc6758719bfaad29783cc0b269203618454f5b293eb268
remote: error: See http://git.io/iEPt8g for more information.
remote: error: File Assets/Firebase/Plugins/x86_64/FirebaseCppApp-10_3_0.bundle is 137.45 MB; this exceeds GitHub's file size limit of 100.00 MB
remote: error: GH001: Large files detected. You may want to try Git Large File Storage - https://git-lfs.github.com.
To https://github.com/lipnus/cfd.git
! [remote rejected] dev -> dev (pre-receive hook declined)
error: failed to push some refs to 'https://github.com/lipnus/cfd.git'
위와 같은 에러가 난 경우,
기존에 50M가 넘는 커밋을 이미 올린 경우라면
git-lfs등 뭔 짓을 해도 해당 커밋을 수정하기 전까지 동일한 에러가 발생.
본인의 경우 Libaray Dependancy 관련 Commit 이 켜켜히 쌓여있어 수정하기가 힘든 상황
Solution
BFG Repo-Cleaner — BFG Repo-Cleaner https://rtyley.github.io/bfg-repo-cleaner/ — 를 이용
java -jar bfg-1.14.0.jar --strip-blobs-bigger-than 50M
lipnus@LAPTOP-DVOR8J7G MINGW64 /d/dev/CFD (develop)
$ java -jar bfg-1.14.0.jar --strip-blobs-bigger-than 50M
Using repo : D:\dev\CFD\.git
This repo has been processed by The BFG before! Will prune repo before proceeding - to avoid unnecessary cleaning work on unused objects...
Completed prune of old objects - will now proceed with the main job!
Scanning packfile for large blobs: 68553
Scanning packfile for large blobs completed in 429 ms.
Found 15 blob ids for large blobs - biggest=926343223 smallest=53396332
Total size (unpacked)=2000134129
Found 15639 objects to protect
Found 8 commit-pointing refs : HEAD, refs/heads/ad, refs/heads/develop, ...
Protected commits
-----------------
These are your protected commits, and so their contents will NOT be altered:
* commit 3b7a7a4c (protected by 'HEAD') - contains 10 dirty files :
- Assets/Basecamp/School/ground.fbx (71.6 MB)
- Assets/CFD/Unit/Chamsuri/Model/Chamsuri Class fbx.fbx (53.5 MB)
- ...
WARNING: The dirty content above may be removed from other commits, but as
the *protected* commits still use it, it will STILL exist in your repository.
Details of protected dirty content have been recorded here :
D:\dev\CFD.bfg-report\2022-12-26\23-33-14\protected-dirt\
If you *really* want this content gone, make a manual commit that removes it,
and then run the BFG on a fresh copy of your repo.
Cleaning
--------
Found 320 commits
Cleaning commits: 100% (320/320)
Cleaning commits completed in 867 ms.
Updating 4 Refs
---------------
Ref Before After
-------------------------------------------------
refs/heads/ad | 4f615f88 | fef0b7bf
refs/heads/develop | 3b7a7a4c | 98975c5d
refs/remotes/origin/develop | 1e6e83c6 | 2c5aaaaa
refs/stash | ae4ef72f | cd0d126c
Updating references: 100% (4/4)
...Ref update completed in 21 ms.
Commit Tree-Dirt History
------------------------
Earliest Latest
| |
DDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDD
D = dirty commits (file tree fixed)
m = modified commits (commit message or parents changed)
. = clean commits (no changes to file tree)
Before After
-------------------------------------------
First modified commit | 2de9a521 | b0fbdc63
Last dirty commit | ae4ef72f | cd0d126c
Deleted files
-------------
Filename Git id
---------------------------------------------------------------------------
Chamsuri Class fbx.fbx | 09bfacb5 (53.5 MB)
FirebaseCppApp-10_3_0.bundle | f0c4e34e (137.4 MB)
FirebaseCppApp-10_3_0.so | 741d1cbc (75.8 MB)
FirebaseCppApp-7_2_0.so | 67d681fe (98.4 MB)
FishingBoat2_specular.tif | 2502b0d8 (64.0 MB)
HoseWater_TextureSheet.tif | a3676acc (64.0 MB)
RescueBoat_Main_MetallicSmoothness.tga | 0d907d00 (64.0 MB)
SmallSplash_Ripples_TextureSheet.tif | 1cae1bf7 (64.0 MB)
Terrain_01_low_DefaultMaterial_AlbedoTransparency.png | c8124742 (73.8 MB)
Terrain_01_low_DefaultMaterial_Normal.png | 55b0abd7 (80.3 MB)
Water_Drop_Texturesheet.tif | a90726f3 (64.0 MB)
ground.fbx | 9716400c (71.6 MB)
libFirebaseCppFirestore.a | cb7d4024 (62.2 MB)
reckoning.wav | 7d2504e6 (50.9 MB)
In total, 1379 object ids were changed. Full details are logged here:
D:\dev\CFD.bfg-report\2022-12-26\23-33-14
BFG run is complete! When ready, run: git reflog expire --expire=now --all && git gc --prune=now --aggressive
기존 커밋들에서 50M가 넘는 로그들을 싸악 정리해준다.
주의
이미 Push했던 Commit의 로그도 진부 정리해버림.
= 원격저장소와 로컬의 Commit History가 완전히 어긋나버림.
= 이전에 LFS를 설정해서 50M이상의 파일을 올린 적이 있는경우 git이 완전히 아작남
Github에 100MB 이상의 파일을 올리는 방법
문제점
medium.com