Adalflow-Auto-optimize LLM Applications
Arize_AI-Prompt Optimization Using Datasets
Promptflow Prompt Flow For Rag
- Construct a “meta prompt” that asks the LLM to write a new prompt based on prior context (i.e., previous prompts and their performance metrics).
- Generate new prompts with an “optimizer” LLM.
- Evaluate these prompts using another LLM, producing an objective value / score.
- Select prompts with the best scores.
- Repeat steps 1-4 until we can’t find a better prompt.
Definitions:
- Meta-prompt: Meta prompts are instructions that guide an AI's behaviour or output in specific ways. They act as a framework for the AI's interpretation and response to subsequent prompts or queries. This article explores the concept of meta prompts, using examples from a system prompt designed for worksheet generation.
