Skip to main content

Portkey • LLMs in Prod

Discord Science and Technology Listed 2 months ago Updated 3 weeks ago

Engineers running Portkey's LLM gateway in production swap config, routing tips and reliability fixes here.


Teams shipping language-model features lean on this space to keep their Portkey gateway stable under real traffic. Conversation runs toward request routing, fallback setups, observability and the rough edges that only show up once something is actually live. The Anthropic crowd shows up often, comparing notes on cost and latency.

Discussion

0 comments about Portkey • LLMs in Prod

No comments yet. Be the first to share something about Portkey • LLMs in Prod.

Loading more groups