You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
With our new SeedPrompt objects and SeedPromptDatasets there's an extra step required to plug them into the send methods which is painful.
Example:
adv_bench_prompts = fetch_adv_bench_dataset()
prompts = [prompt.value for prompt in adv_bench_prompts.prompts[:3]]
await orchestrator.send_prompts_async(prompt_list=prompts) # type: ignore
Describe the solution you'd like
Instead of the middle step, there should either be
a) a way to plug in SeedPromptDatasets into send_prompts_async and the send method can extract the prompts from the dataset OR
b) there needs to be a simple access method, something like get_values() on the SeedPromptDataset class.
The latter seems a tad simpler.
Describe alternatives you've considered, if relevant
Additional context
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
With our new
SeedPrompt
objects andSeedPromptDataset
s there's an extra step required to plug them into the send methods which is painful.Example:
Describe the solution you'd like
Instead of the middle step, there should either be
a) a way to plug in
SeedPromptDataset
s intosend_prompts_async
and the send method can extract the prompts from the dataset ORb) there needs to be a simple access method, something like
get_values()
on theSeedPromptDataset
class.The latter seems a tad simpler.
Describe alternatives you've considered, if relevant
Additional context
The text was updated successfully, but these errors were encountered: