How to install Github on USB Drive?

Is it possible to Github and Powershell on a USB drive. And I need it to work just like it would on my computer. Like open the shell through the Github and open the shell from selecting a repository.

Git Baby is a git and github fan, let's start git clone.