In order to get evaluation to work i had to change config.json

[iamtrask]

config.json has the wrong IP address for the indexer. I am running the index server on the same machine, so it needs to be "http://127.0.0.1:8000" instead of just "127.0.0.1" which... would never work? I'm not sure why it's there.

I'm referring to "request_server" in https://github.com/Langboat/lm-evaluation-harness/blob/f8d779beccfe28e174dec757e0c1dd6f1fbce95e/config.json