AI Gateway on Open Edge Platform
Tencent EdgeOne AI Gateway implements security, visibility, and request behavior control management for access to large language model (LLM) service providers.
Features
Cache technology for repeated prompts, reducing expenses
Configure retries, rate limits, and fallbacks for complex scenarios
Access AI Gateway statistics to optimize processes and decisions
Virtual keys protect LLM provider access, ensuring data privacy
Open Edge Serverless Development Platform
serverless
Open Edge is a technology open co-creation platform created by Tencent EdgeOne for developers. We will further open up the capabilities of edge nodes around the world. You can explore and build a new generation of Serverless applications with us here. We look forward to your joining Open Edge and changing the world with technology!
We Offer
- Nearby deployment of edge nodes in global regions for a low-latency access
- Smart scheduling to effectively avoid risks while increasing the speed
- Free AI Gateway enables control over access to Large Language Models (LLMs)
FAQs
What is Open Edge Technology Platform?
Open Edge is a technology open co-creation platform created by Tencent EdgeOne for developers. You can explore and build a new generation of Serverless applications with us here.
Is AI Gateway free?
Yes, the AI Gateway is now open for developers to apply for a free trial.
What can AI Gateway do?
The AI Gateway enables management and control of access to large language models (LLMs) and currently supports major model service providers such as OpenAI, Minimax, Moonshot AI, and Gemini AI.
Can the AI Gateway support more LLM service providers?
If the current LLM service providers do not meet your requirements, please feel free tocontact usfor an evaluation.