val_path = os.getenv("VAL") get None

[zhangyipin]

bash examples/CoT/blocksworld/test_cot_llama3.sh

where to set this? Thank you!

[zhangyipin]

----cmd: None/validate examples/CoT/blocksworld/data/generated_domain.pddl LLMs-Planning/llm_planning_analysis/instances/blocksworld/generated_basic/instance-426.pddl tmp_plan.txt
/bin/bash: None/validate: 没有那个文件或目录
RESPONSE:::
Case #45: correct=False, output='unstack the orange block from on top of the blue block\nput down the orange block\npick up the red block\nstack the red block on top of the yellow block\npick up the orange block\nstack the orange block on top of the red block', answer={'init': 'the red block is clear, the orange block is clear, the hand is empty, the red block is on top of the yellow block, the orange block is on top of the blue block, the blue block is on the table and the yellow block is on the table', 'goal': 'the red block is on top of the yellow block and the orange block is on top of the red block', 'plan': '\nunstack the orange block from on top of the blue block\nstack the orange block on top of the red block\n[PLAN END]\n', 'question': '\n[STATEMENT]\nAs initial conditions I have that, the red block is clear, the orange block is clear, the hand is empty, the red block is on top of the yellow block, the orange block is on top of the blue block, the blue block is on the table and the yellow block is on the table.\nMy goal is to have that the red block is on top of the yellow block and the orange block is on top of the red block.\n\nMy plan is as follows:\n\n[PLAN]\n', 'instance_file': 'LLMs-Planning/llm_planning_analysis/instances/blocksworld/generated_basic/instance-426.pddl'};accuracy=0.000 (0/45)

[Ber666]

Hi, could you try following the instruction in the README to set up VAL?