Fix prompt formatting features

[dagrayvid]

The dataset.py get_format_string(...) function is outdated and should be removed.

llm-load-test/dataset.py

Lines 122 to 137 in 955c120

	def get_format_string(model_name):
	"""Get the format string."""
	known_system_prompts = {
	"llama": "<s>[INST] <<SYS>>\n{system_prompt}\n<</SYS>>\n\n{prompt} [/INST]",
	"flan": "Question: {prompt}\n\nAnswer:",
	"gpt-neox": "{system_prompt}\n\n{prompt}",
	"starcoder": "input: \n\n{prompt} \n\noutput:",
	}
	for name, fmt_str in known_system_prompts.items():
	if name in model_name:
	logging.info("Using %s prompt format, model_name: %s", name, model_name)
	return fmt_str
	logging.info("Using default prompt format model_name: %s", model_name)
	return "{system_prompt}\n\n{prompt}"

By default no prompt formatting should be done. We could have a config.yaml field for a similar template that accepts {system_prompt} and {prompt} as variables.