Git subtree and multiple directories

I have a rather large git repository that has a directory where I maintain library code. The directory contains a number of subdirectories.

repo
+--- lib
|    +--- A
|    +--- B
...
|    +--- Z

Now let us assume that I want to open source subdirectories A,...,M and keep subdirectories N,...,Z close sourced. Let us also assume that I would like to:

  • Exclude file in Visual Studio from git Commit by default
  • Error when trying to backup Gitlab
  • Having trouble “untracking” file (ignore further changes to tracked file)
  • “git rebase --interactive” is silently dropping commits while attempting to reorder them
  • How to set origin/HEAD in remote branch
  • Dart - How to check if Git is correctly installed?
    • Keep A,...,M in a single open source repository. The reason for this is that the directories A,...,M have interdependencies and it would be confusing to split them into individual repositories.
    • Keep the structure of my closed source repository intact. For example, I could create subdirectories lib/pub and lib/pvt, but this would have cascading effects requiring changing references elsewhere or would require a lot of symlinks (lib/A -> lib/pub/A).
    • Have a solution akin to git subtree where I can modify code either in my closed source repository or in the open source one and I can easily sync the changes between the two repositories.

    I have searched for a solution in both stackoverflow and google, but there does not seem to be an obvious one. Conceptually this is something that git subtree should be able to do, but it only works with a single subdirectory.

    I have looked into the git-subtree script with the intent of modifying it.

    https://github.com/git/git/blob/master/contrib/subtree/git-subtree.sh

    It appears to me that if I was to modify subtree_for_commit() I should be able to convince git subtree split to consider more than a single directory for splitting. But my knowledge of git is not enough to understand what the script is doing and modify it without breaking things.

    If you have any solution for the above mentioned problem or any other pointers in modifying git-subtree, please let me know.

  • Git cannot push folder part of another git project
  • Overwriting and Pushing a Git Branch
  • git submodule update --remote vs git pull
  • Git blame -M: unexpected behavior
  • Unable to find current origin/master revision in submodule path
  • How can I repair a git repository with a missing object?
  • One Solution collect form web for “Git subtree and multiple directories”

    Splitting a subtree mixed with files from the parent project

    This seems to be a common request, however I don’t think there’s a simple answer, when the folders are mixed together like that.

    The general method I suggest to split out the library mixed in with other folders is this:

    1. Make a branch with the new root for the library directories:

      git subtree split -P lib/ -b temp-br
      git checkout temp-br
      
    2. Then use something to re-write history to remove the parts that aren’t part of the library. I’m not expert on this but I was able to experiment and found something like this to work:

      git filter-branch --tag-name-filter cat --prune-empty --index-filter 'git rm -rf --cached --ignore-unmatch N O P Q R S T U V W X Y Z' HEAD
      

      Note: You might need to delete the back-up made by filter-branch if you make successive commands.

      git update-ref -d refs/original/refs/heads/temp-br
      
    3. Lastly, just create a new repo for the library and pull in everything that’s left:

      cd <new-lib-repo>
      git init
      git pull <original-repo> temp-br
      
    Git Baby is a git and github fan, let's start git clone.