Langfuse
p/langfuse
Open Source LLM Engineering Platform
Clemens Rawert
Langfuse 2.0 โ€” the open source LLM engineering platform
Featured
104
โ€ข
Langfuse is the open source LLM Engineering Platform. It provides observability, tracing, evaluations, prompt management, playground and metrics to debug and improve LLM apps. Langfuse is open. It works with any model, framework and you can export all data.
Replies
Clemens Rawert
Hi Product Hunt ๐Ÿ‘‹๐Ÿ‘‹๐Ÿ‘‹ Iโ€™m Clemens, co-founder of Langfuse (with @marc_klingen and @max_deichmann). We are so excited to be live on Product Hunt again today launching Langfuse 2.0! We originally launched Langfuse right here in late August 2023 and made it to #1 Product of the Day. Earlier this year we were lucky enough to be awarded a Golden Kitty in the AI Infra category for 2023! Product Hunt holds a special place in our heart and company history. Langfuse has come a long way. Last year, we set out to build open source observability and analytics for LLM apps. We saw a need and gap for a dev-focussed, open source and self-hostable product that allows for complex tracing and nesting of LLM and other workloads. We are excited to introduce Langfuse 2.0 today. We have moved from an observability tool to a platform for LLM engineering. The scope is now wider and the core product has matured so much since last year. A few things you should know about: ๐Ÿ‘ฃ Tracing: TS & Python (new: decorator) + OpenAI, Llama Index, Langchain, Litellm + more ๐Ÿคจ Eval Service: Automatically run evals against all new incoming traces ๐Ÿ’พ Datasets: Collect, test and run fine-tuning, testing, and golden datasets in Langfuse ๐Ÿ’ฏ Metrics: Dashboards and analytics on cost, latency and quality ๐Ÿค– Prompt Management: Version and deploy prompts from within Langfuse ๐Ÿ•น๏ธ LLM Playground: Engineer your prompts with context in Langfuse ๐ŸŽ๏ธ Export & Fine Tune: Open GET API and csv/JSON exports to build downstream use cases ๐Ÿš„ Scale: Weโ€™ve invested significantly in scaling and resilience as weโ€™ve scaled to thousands of users and handle millions of events a day ๐Ÿง‘โ€๐Ÿคโ€๐Ÿง‘ Community: Join our thousands of users on GitHub Discussions and Discord See for yourself: โญ GitHub: https://github.com/langfuse/lang... โฏ๏ธ Demo (includes data, no credit card): https://langfuse.com/demo ๐Ÿ“š Docs: https://langfuse.com/docs Weโ€™re excited to launch the all-new Langfuse on Product Hunt today. We will be in the comments the whole day and canโ€™t wait to hear your thoughts & feedback!
Clemens Rawert
@julietroseb thank you, Juliet :)
Sathish Nagarajan (SNR)
@marc_klingen @max_deichmann @clemo_sf opensourcing LLM engineering platform is great thing in the AI space. Keep up the good work. Congratulations
Oliver Montes
@marc_klingen @max_deichmann @clemo_sf Really amazing product, best in class, Congratulations langfuse team!
Sajida
Congrats on Langfuse 2.0! From observability to a full LLM engineering platform, impressive growth! The features are powerful, catering to user needs. Like snazzystep shoes, Langfuse empowers users to excel. Best wishes on your Product Hunt launch!https://snazzystep.com/wp-admin/
Mike Mahlkow
A bit late here, but I was wondering how you charge for evaluations?
Aqib Ansari
Really happy with the product. It's very intuitive - Traces work very well for Agentic Workflows - Scores is another great feature to help us create datasets for finetuning - Plus, looking forward to your new eval feature!
Marc Klingen
@aqib_ansari thanks Aqib, appreciate your continuous product feedback a lot! It really helps us build the best product and continuously learn what your team needs to build the best agents ๐Ÿ™
Tevfik Oytun Aloglu
A great product to productionize your LLM applications. Once you create a prototype, the next step is understanding the cost structure, and tracing the paths - and Langfuse helps you to solve those challenges. The new decorators make it easy to track anything easily from your code. Good luck with the launch!
Marc Klingen
@tevfik_oytun_aloglu thanks Tevfik, appreciate your feedback. The decorator has been a big step up recently, glad you like it!
Viet Le
So great to see you become more holistic! ๐Ÿค˜๐Ÿฝ
Clemens Rawert
@viet_le ๐Ÿ™๐Ÿ™๐Ÿ™
Marc Klingen
@viet_le thanks for your support since day -1 ๐Ÿ™
David Nordhausen
Congrats team! Really impressed by how much you shipped this week
Marc Klingen
@david_nordhausen Thanks David! We cooked for a bit and dropped it all at once as Clemens was like last week, โ€œwe should just do a launch weekโ€
Hamza Zia
Congrats @clemo_sf and team on the launch of LangFuse v2!! I love the major upgrade in the tracing subsystem ๐Ÿ”ฅ
Marc Klingen
@clemo_sf @hamza_zia Thanks Hamza! The decorator-based integration has been a big upgrade to tracing in Langfuse. We wrote a short piece on it here: https://langfuse.com/blog/2024-0...
Tobias Kemkes
Congrats on the launch guys!! Keep shipping ๐Ÿšข
Marc Klingen
@tobiaskemkes thank you, you guys are an inspiration!
Timon Christiansen
Congrats on the launch! Really enjoying the product since day 1 ๐Ÿš€
Clemens Rawert
@timon_christiansen Thank you timon and the whole team fastgen!
Marc Klingen
@timon_christiansen love that you guys actually built your own golang wrapper
Robert Lukoshko
best LLM engineering platform I have seen so far. Great job!
Marc Klingen
@karmedge thanks for your kind words, let us know if you have any feedback! love what you built with Fixkey: https://www.producthunt.com/prod...
Sebastian Schรผller
@clemo_sf @marc_klingen @max_deichmann congrats on the launch! It's awesome to follow your journey which is truly lightspeedy. ๐Ÿ”ฅ
Marc Klingen
@clemo_sf @max_deichmann @sebastian_schuller thanks for your excitement and support, really appreciate it โค๏ธ
Jean Kaddour
This team ships faster than โšก
Clemens Rawert
@jean_kaddour thank you, Jean! Likewise with sevn!
Marc Klingen
@jean_kaddour thanks, Jean, means a lot!
Dan
๐Ÿ”Œ Plugged in
We love to use Langfuse to build our RAG systems and get the visibility into what prompts actually hitting the LLM! Btw, the new decorate is awesome
Marc Klingen
@dan_meier1 thanks, the decorator is for sure the biggest upgrade to the Langfuse developer experience in Python! We wrote a more technical blog post on it here: https://langfuse.com/blog/2024-0...
Felix Vemmer
Congrats ๐Ÿ‘ on the launch! Excited to try some of these new features!
Marc Klingen
@felix_vemmer thank you! list of all the latest releases: https://langfuse.com/changelog let me know if you have any feedback!
Kai
Congrats! ๐Ÿชขโœจ
Marc Klingen
@kaisr ๐Ÿซก๐Ÿซก๐Ÿซก
Albert
Congratulations to Clemens, Marc, and Max on the launch of Langfuse 2.0 on Product Hunt! ๐ŸŽ‰ It's incredible to see how Langfuse has evolved into a comprehensive LLM Engineering Platform, providing vital tools like tracing, evaluations, metrics, prompt management, and more for developers. The dedication to building an open source platform that caters to the needs of LLM apps is truly commendable. The enhancements in Langfuse 2.0, from new tracing capabilities to prompt management and dataset functionalities, showcase a significant leap in empowering developers to debug and enhance their applications efficiently. I'm curious about the community engagement aspect you mentioned. How has the interaction been with users on GitHub Discussions and Discord influenced the development of Langfuse? Looking forward to exploring Langfuse 2.0 and witnessing the impact it creates in the developer community! ๐Ÿ‘ฉโ€๐Ÿ’ป๐Ÿš€
Marc Klingen
@mashy thank you! GitHub Discussions have been essential (next to bug reports via GitHub issues) to build a useful product. Our community has been super awesome and you can have a look at all the discussion that has been going on around langfuse here: https://langufse.com/ideas
Mathias Nestler
Probably one of the best LLM platforms out there!!
Clemens Rawert
@mathias_n Nice to (sort of) run into you yesterday!
Roman Geugelin
Congrats on the launch, Clemens and team! Been using the product since the start and love the execution speed!! Particularly excited about the new tracing and prompt management features. Excited to explore more!!
Marc Klingen
@roman_geu Thanks Roman! Appreciate your support since day one, no matter if it is product or general founder/life advice. Thank you ๐Ÿ™
Franklin Mayoyo
LLMs always go over my head but not Langfuse.
Marc Klingen
@mayoyo25 thanks, that's a nice tagline โœจ
Girdharee Saran
Congrats on launching Langfuse 2.0! @clemo_sf An open-source LLM Engineering Platform providing observability, tracing, evaluations, prompt management, playground, and metrics. Debug and improve LLM apps easily with Langfuse. It's open, works with any model or framework, and allows exporting all data. How does Langfuse ensure compatibility with different frameworks and models?