Artificial Intelligence (AI)
BricksLLM: AI Gateway For Putting LLMs In Production, Written in Golang
BricksLLM is a cloud native AI gateway written in Go. Currently, it provides native support for OpenAI, Anthropic, Azure OpenAI and vLLM. BricksLLM aims to provide enterprise level infrastructure that can power any LLM production use cases. Use-cases BricksLLM Here are some use cases for BricksLLM: * Set LLM usage limits