samim

Prompt Engineering Tricks: Poor man's RLHF

1. Have user indicate when model is correct
2. Store associated (input, output) in embedding index
3. At inference time, retrieve nearest K previous inputs
4. Put these top K (inputs, output) pairs into context as few-shot examples
5. Works like a charm ✨

(Source) #ML #Generative