Rohit Agarwal

OpenAI Downtime Monitor - Know before the outage impacts you

byā€¢

Opening up our šŸšØ LLM downtime monitoring tool to the community: We started to maintain this because we were tired of running into API errors without warning. Figured it could help other developers stay in the loop on API performance too.

Add a comment

Replies

Best
Vrushank Vyas
Hey PH Community, Tired of unexpected OpenAI outages derailing your production apps? We've got your back. šŸ’Ŗ We built an internal tool to monitor API performance across OpenAI, Anthropic, Anyscale - and now we're opening it up to everyone. šŸŽ Our tool tracks: āœ… Real-time downtime alerts for key models like GPT-3.5, GPT-4, embeddings āœ… Live API latency metrics so you can see when models slow down āœ… Proactive pings every 3 mins so we catch issues before you do Please let us know what you think!
Ankur (getIntro.ai)
It's surprising that this product has to exist! But it's a lifesaver :))
Vrushank Vyas
@ankurpandey_info Thank you! šŸ™
Akash Tandon
This tool is already in my bookmarks and has been useful for us. Thanks for putting it out and more power to you, @jumbld and team Portkey!
Vrushank Vyas
@jumbld @akashtandon Oh haha great to know! Time for me to add it to bookmarks as well šŸƒā€ā™‚ļøšŸƒā€ā™‚ļø
Shivam Sharma
Super useful!
Vrushank Vyas
@shivam_sharma4 Glad you liked it, @shivam_sharma4!!
Louis Wright
Well this is going to save me a whole lot of time in the future! An elegant fix to an issue I have been facing and can only assume has been causing just as much grief for other AI system creators. Great job well done!!
Vrushank Vyas
@iamlwright Thank you so much @iamlwright! ā¤ļø