Skip to content

Commit

Permalink
Update faq.md
Browse files Browse the repository at this point in the history
  • Loading branch information
mtian8 authored Oct 2, 2024
1 parent 2a57efe commit e177495
Showing 1 changed file with 2 additions and 5 deletions.
7 changes: 2 additions & 5 deletions docs/faq.md
Original file line number Diff line number Diff line change
Expand Up @@ -53,11 +53,8 @@


* **It seems that in the prompt template definition, the prompts with and without backgrounds are assigned the other way around:

DEFAULT_PROMPT_TEMPLATE = Path("eval", "data", "background_comment_template.txt").read_text()

BACKGOUND_PROMPT_TEMPLATE = Path("eval", "data", "multistep_template.txt").read_text()

DEFAULT_PROMPT_TEMPLATE = Path("eval", "data", "background_comment_template.txt").read_text()
BACKGOUND_PROMPT_TEMPLATE = Path("eval", "data", "multistep_template.txt").read_text()
Are the numbers reported in the paper run with these prompts?**

Yes, DEFAULT_PROMPT_TEMPLATE is our standard setup where we ask the model to generate the related background itself. BACKGOUND_PROMPT_TEMPLATE is the template where we will put in the scientist-annotated background.
Expand Down

0 comments on commit e177495

Please sign in to comment.