This should not add more latency than your average VPN, since the overhead of websocket is minimal and roundtrip time is about the same.
At the moment, this is running on a single-instance with no load-balancing. The intended use case was to enable streaming of MCP SSE traffic, which is very lightweight. I would expect this to be able to handle a lot of traffic just like that, but if people start using the public instance for other use cases, I will need to think of ways to scale it.
The current implementation is HTTP-focused as that was the primary use case. TCP tunneling is possible architecturally but not something I've had in mind. I suggest start by raising an issue on GitHub and adding thumbs up. If it receives enough attention, I will prioritize it. I am less familiar with what would supporting UDP entail, so cannot answer that right now.
That "deep dive" is an apples-to-oranges comparison. MCP is also a "HTTP API" that you so criticize.
You also somehow consistently think LLM making tool calls against an OpenAPI spec would result in hallucination, while tool calls are somehow magically exempt from such.
All of this writing sounds like you picked a conclusion and then tried to justify it.
There's no reason an "Agentic OpenAPI" marked as such in a header wouldn't be just as good as MCP and it would save a ton of engineering effort.
I was expecting this to be the first comment.
reply