Prompt for GSM8K evaluations
#91
by dayvidwang - opened
Hello, thank you for the amazing work on Phi 1.5. I saw that there was a previous discussion about reproducing the GSM8K evaluation results (via code) that was closed (https://huggingface.co/microsoft/phi-1_5/discussions/36).
The evaluation snippet was helpful, but I'm still not able to reproduce the results from the technical report. In particular, I'm not sure what prompt I should use. All the prompts I've tried produce significantly lower results. Could you please provide the prompt that you actually used to get Phi1.5 to generate the code response for the GSM 8k evals?