Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Metaforecast Prioritization #9

Open
OAGr opened this issue Jan 1, 2022 · 2 comments
Open

Metaforecast Prioritization #9

OAGr opened this issue Jan 1, 2022 · 2 comments

Comments

@OAGr
Copy link

OAGr commented Jan 1, 2022

On Metaforecast, it could be neat to have prioritization for the following:

  1. For each estimate, how important/decision-relevant is it?
  2. How important is it that this variable be predicted better? (This could use (1), plus forecaster estimates)
  3. How valuable has this question + its predictions been / expected to be?

I think most of the key questions now are on Metaculus, so maybe this could be done with Metaculus somehow.

@uvafan
Copy link

uvafan commented Jan 13, 2022

I'd be excited about QURI trying some version of this out. I think the MVP I'd be most excited about is manually curating important questions. For the first version with forecasts being made, I'd recommend sticking to one meta-question accompanying each question.

@OAGr
Copy link
Author

OAGr commented Jan 13, 2022

Agreed. @NunoSempere did some early work on estimating the value of Metaculus questions, but there's still much more work to do. (Especially, to have the scores show up on Metaforecast and similar. Maybe they could be integrated into Metaculus one day).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants