-Even with good documentation, the LLM may generate incorrect code to interact with API. (If you fix the generated code and just have the LLM call that code to interact with the API, then you're on your way to an intermediary in any case. You're basically building an "MCP-like" server.)
-Security or resource allocation issues when giving LLMs direct access to APIs. (LLM has limited knowledge of when API was last called. It could call too often and, if each call is expensive, generate surprise infrastructure bills.)
-So on and so forth. Lots of other potential pain points solved by having something intermediate.
Should that "something" be MCP? Reasonable people can disagree on that. Works well enough right now to get done what people need done I suppose.
-Even with good documentation, the LLM may generate incorrect code to interact with API. (If you fix the generated code and just have the LLM call that code to interact with the API, then you're on your way to an intermediary in any case. You're basically building an "MCP-like" server.)
-Security or resource allocation issues when giving LLMs direct access to APIs. (LLM has limited knowledge of when API was last called. It could call too often and, if each call is expensive, generate surprise infrastructure bills.)
-So on and so forth. Lots of other potential pain points solved by having something intermediate.
Should that "something" be MCP? Reasonable people can disagree on that. Works well enough right now to get done what people need done I suppose.