Have you tried the lighter version of VS? (Visual Code I think it is) and use Powershell to build the projects.
EDIT:
Take a look at
this.
To build without loading/having the whole IDE use the following from PowerShell
You may have to find your way to the path of MSBuild.exe (for me it's in )
Code:
cd "C:\Program Files (x86)\Microsoft Visual Studio\2017\Community\MSBuild\15.0\Bin"
.\MSBuild "C:\Your Build Path.sln" /t:Rebuild /p:Configuration=Debug /p:Platform="Any CPU"
You may not need to go-to the directory of the MSBuild.exe, I do for some strange reason.