You can use MCP servers without the need to use an extension. You can either add it in the settings.json or use the "Add custom server..." button on the agent 3-dot menu.

The extensions are just for more ease of use as they install the server as well. A one click solution.