How do you reverse engineer a GPT?

Question

Sometimes I see people having GPTs that generate some pretty amazing results and I really want to see how they made the system prompt.

Tham (Sylvia) Nguyen · Accepted Answer

I made this free tool to help myself reverse engineer any GPT with AI: https://mindpal.space/tool/rever... Feel free to try it if you want!

Answer

Study Open Models: Access open-source versions of GPT-like models (e.g., GPT-NeoX, GPT-3 open-source alternatives) to understand the training process. You can explore how these models are built, trained, and optimized, gaining insights into the design decisions behind GPT.
Train a Smaller Model: With the right resources, you can attempt to recreate a simplified version of GPT by fine-tuning a smaller open-source model on a specific dataset. This allows you to experiment with hyperparameters, training strategies, and model evaluation techniques, giving you a better understanding of how the GPT model was trained.

Amanda Nicole Harris · Answer

Reverse engineering GPTs is pretty fascinating! I've experimented with probing GPT models to understand their knowledge and capabilities. Using tools like your reverse engineering one can provide insights into model architecture, training data, and potential weaknesses/flaws. It's a cool way to peek under the hood of these complex AI systems. I'd be curious to hear what kind of insights you've gleaned from your reverse engineering efforts so far!

Emon makhmudov · Answer

Interesting question! Reverse engineering GPT sounds like a fun challenge, but I imagine it involves a lot of model analysis and a deep dive into neural.

Tham (Sylvia) Nguyen · Answer

@tankachat Thanks, have you tried it?

Answer

Analyze the architecture, datasets, and training process by studying open research and papers, like the original GPT publications. Recreate the model using similar frameworks, data preprocessing, and fine-tuning techniques.

Silas Reeve Blackburn · Answer

I've heard people mention some tools like Reverse Prompt, but I haven't tried any myself yet. Let me know if you find a good one! Reverse engineering GPTs sounds pretty wild, I'm curious to hear more about how it works and what you can do with it.

How do you reverse engineer a GPT?

Replies