What tool do you use for prompt engineering?

Question

I have ChatGPT Plus but I'm specifically looking for something that I can have team members use to allow them to do some prompt engineering (potentially without ChatGPT Plus). I remember seeing a few tools like this months back but PH's search is pretty bad so I can't find them now.

Xinshu Ta · Accepted Answer

I will use the monica

Magomed Vedzizhev · Answer

For collaborative prompt engineering, you might consider tools like PromptBase, which allows users to create, share, and refine prompts with team members. Another option is Genius, a platform designed for building and testing prompts that can be accessed by multiple users, making it easier for your team to collaborate on prompt creation.

Odette Celeste Montgomery · Answer

I've been using Anthropic's Claude to help with prompt engineering. It seems to provide good suggestions for structuring and iterating on prompts. Has anyone compared it to other options like GPT-3/4 for prompt engineering specifically?

Cole Gottdank · Answer

Hi Brady, I'm Cole, Co-Founder at Helicone.ai! If your team is looking for a better way to handle prompt engineering, our new tool Helicone Experiments might be just what you need. It has a spreadsheet-like interface that lets you create, test, and iterate on multiple prompt versions simultaneously using real-world data. We’ve just launched it in early access—check out our launch video. https://www.youtube.com/watch?v=C1SwsvcHLRc In Helicone Experiments, you can easily add input sets from your production data and run experiments rapidly with different prompts & models. It also provides automated evaluations and performance scores. We already have a V1 of prompt experimentation, but this new launch is a revamped version of this: https://docs.helicone.ai/use-cas... Is this the type of tool you're looking for?

Ha My Tran · Answer

You can consider using these 2 types of tools: - Leaked prompt of GPTs: Collection of prompts from most popular GPTs. https://mindpal.space/tool/leake... - Reverse engineering tool: Get prompts from an example of output that you expect to have https://mindpal.space/tool/rever...

Matthew David Harris · Answer

Yeah I've been using Promptable lately to engineer prompts for my AI apps and it's been super helpful. Has a nice library of prompt templates and lets you test prompts across different models. Also heard some people are liking PromptBase and PromptLayer for prompt management. But curious what others are using too!

Answer

I've been using OpenAI's APIs directly to do prompt engineering and iterate on prompts. It's super helpful to be able to programmatically generate outputs, tweak the prompts, and compare results. But I'm curious what dedicated prompt engineering tools others are finding useful?

What tool do you use for prompt engineering?

Replies