Uber created a unified platform for serving large language models (LLMs) from external vendors and self-hosted ones and opted to mirror OpenAI API to help with internal adoption. GenAI Gateway provide ...

AWS recently introduced a new capability for Amazon API Gateway featuring dynamic routing rules for custom domain names - allowing users to route API requests based on HTTP header values, either ...