Release Notes
2024.12.06
To further enhance the development experience and simplify interface integration, AI Gateway now introduces API V2 version. This version has multiple improvements and optimizations, especially in the unification of the request body and response data format.
Major Updates:
Unified request interface address to avoid frequent switching of interface addresses by developers.
Unified Request Body Format: All API requests now use a consistent JSON format, simplifying the data construction process for clients.
Standardized Response Data Structure: A unified response format helps developers quickly understand and process the returned information. It includes status codes, message prompts, and data bodies, making error handling and success feedback more intuitive and clear.
Enhanced Error Handling Mechanism: Clear error code definitions facilitate problem localization and resolution. Detailed error descriptions help developers quickly take corrective actions.
2024.06.19
First version launched
Feature Highlights
Using caching technology, repeated Prompt requests will be responded to directly from the cache, without needing to call the LLM service provider again. This effectively avoids unnecessary duplicate costs, significantly reducing your operational costs.