That’s what most IDEs are. VS Code doesn’t have any native integrations. Everything is provided by plugins. The default plugins that ship with VS Code can be disabled, and you’ll have just a powerful text editor.
(To do this, go to Extensions tab, click the filter icon, select “Built-in”, and go down the list to disable all of them. Or just build a version with no built-in plugins.)