These settings seem to help:

"scm.diffDecorations":"none",
"git.enabled": false,