Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fatiando User Survey 2022 #63

Open
18 of 23 tasks
leouieda opened this issue Sep 7, 2022 · 27 comments
Open
18 of 23 tasks

Fatiando User Survey 2022 #63

leouieda opened this issue Sep 7, 2022 · 27 comments

Comments

@leouieda
Copy link
Member

leouieda commented Sep 7, 2022 •
edited
Loading

In our 2022-08-19 Weekly Call we decided to run a survey to gather information about our community. The goals are to help guide future project directions and gather data that can be used to support future grant applications.

This issue is to track progress of developing, rolling out the survey, and analysing the results.

Tasks:

Promotion (initial 12 Sep):

  • Twitter (@MGomezN)
  • LinkedIn (@leouieda)
  • ResearchGate (@leouieda)
  • GitHub Discussions announcement as a pinned post (@santisoler)
  • Software Underground post to #general (@aguspesce)
  • SimPEG slack (@santisoler)
  • GSH Potential Fields group (@andieie ?)
  • Geolatinas (@aguspesce)
  • Anywhere else?
  • Please also send to personal connections that may use Fatiando.
  • Post links social media on Slack/Matrix for retweets/reshares

Promotion (19 Sep):

Promotion (3 Oct):

Promotion (10 Oct):

Social media messages

Initial post:

📣 Have you used Pooch/Verde/Harmonica/Boule/Fatiando? We need your feedback! Please fill out this survey (5-10min) https://forms.gle/EB4VFLY8PYb7UoJSA Your answers will let us know our community better and tailor development to your needs!
IMAGE: https://github.com/fatiando/logo/raw/main/banner/fatiando-survey.png
Alt: Fatiando a Terra Community Survey 2022. Fill it out today! Should only take 5-10min.

📣 Já usou Pooch/Verde/Harmonica/Boule/Fatiando? Queremos sua opinião! Por favor preencha esse formulário (5-10min) https://forms.gle/EB4VFLY8PYb7UoJSA Suas respostas nos permitirão conhecer melhor nossa comunidade e direcionar o desenvolvimento do projeto!
IMAGE: https://github.com/fatiando/logo/raw/main/banner/fatiando-survey.png
Alt: Fatiando a Terra Community Survey 2022. Fill it out today! Should only take 5-10min.

📣 Has usado Pooch/Verde/Harmonica/Boule/Fatiando? Queremos conocer tu opinión! Por favor completa este formulario (5-10min) https://forms.gle/EB4VFLY8PYb7UoJSA Tus respuestas nos permitirán conocer mejor a nuestra comunidad y mejorar el desarrollo del projecto según las necesidades de nuestres usuaries!
IMAGE: https://github.com/fatiando/logo/raw/main/banner/fatiando-survey.png
Alt: Fatiando a Terra Community Survey 2022. Complétala hoy! Solo te tomará entre 5 y 10min.

Follow up:

We need your feedback on Pooch/Verde/Harmonica/Boule/Fatiando! If you have 5-10min to spare, please fill out this survey: https://forms.gle/EB4VFLY8PYb7UoJSA
IMAGE: https://user-images.githubusercontent.com/29388479/189304150-09b6d863-89dc-44e1-aa74-e91782d76894.png
@leouieda
Copy link
Member Author

leouieda commented Sep 7, 2022

Post survey tasks:

  • Initial pass over the survey data (team with access are @leouieda @aguspesce @santisoler @MGomezN)
  • Compile main take aways from the written responses
  • Create a spreadsheet with personal information and written responses removed (could have identifiable information in those) that can be published
  • Make some graphs of the multiple choice questions from the anonymized data
  • Create a page under https://www.fatiando.org/community/ about the survey results. Includes interpretation, interactive figures, links to download the data (upload a CSV to the website). Could be a Jupyter notebook in Markdown format executed using jupyter-sphinx.
  • Post about the survey results (short thread + link to the page).

Volunteers for any of these would be welcome! Only exception is access to the full data which I'd prefer to keep limited since there could be personal information in there that we don't want to make public.

@leouieda
Copy link
Member Author

leouieda commented Sep 7, 2022 •
edited
Loading

Questions to add:

  • How did you first hear about Fatiando? (talk, paper citation, word of mouth, social media, Transform, search, entered group already using)
  • Any specific use case you’d like to share? (papers, projects, etc)

@aguspesce
Copy link
Member

@leouieda, I can post it in Geolatinas and Software Underground

@santisoler
Copy link
Member

Questions to add:

* How did you first hear about Fatiando? (talk, paper citation, word of mouth, social media, Transform, search, entered group already using)

* Any specific use case you’d like to share? (papers, projects, etc)

I love these two. Feel free to add them!

@aguspesce
Copy link
Member

@leouieda and @santisoler I am working to create the survey alert for the website

@aguspesce
Copy link
Member

@leouieda and @santisoler. I finished the PR for the survey alert.

It is necessary to add the link to the survey, and maybe you can better ideas for the text. Please, take a look on It

@leouieda leouieda pinned this issue Sep 8, 2022
@leouieda leouieda unpinned this issue Sep 8, 2022
@leouieda
Copy link
Member Author

leouieda commented Sep 8, 2022 •
edited
Loading

Social media message:

📣 Calling all users of Pooch/Verde/Harmonica/Boule/Fatiando: We need your feedback! Please fill out this short survey (5-10min) LINKTOSURVEY

Your answers will let us know our community better and tailor development to your needs!

Alt: Fatiando a Terra Community Survey 2022. Fill it out today! Should only take 5-10min.

Any thoughts or changes? cc @MGomezN our social media guru ❤️

@leouieda
Copy link
Member Author

leouieda commented Sep 8, 2022

Alright, here is the link to the survey: https://forms.gle/EB4VFLY8PYb7UoJSA

Please don't share this yet. Could some of you try filling it out to check if it's working OK? We'll delete that data before going live on Monday.

@aguspesce
Copy link
Member

@leouieda ... The survey works fine!

@MGomezN
Copy link
Member

MGomezN commented Sep 9, 2022 •
edited by leouieda
Loading

Some thoughts. Thinking on my personal case.
So narcissist this Mariana!

  • The survey asks about the country of residence. What if we add nationality?

  • to Include a question about native languages? Or English level?
    What I really want to know is if people complain about documentation/tutorials not being clear enough, is it because maybe they don't have the English level required to understand it?
    Perhaps the options can be:
    a) I find the documentation clear. I have an advanced English level.
    b) Documentation is not clear. I have an advanced English level
    c) Documentation is clear. I have a basic English level
    d) Documentation is not clear. I have a basic English level
    e) Documentation seems straightforward, but my English level and lack of fundamental concepts make reading difficult. (Mariana's option) jajaj

  • Maybe the option to reply to the "text" questions in their native language? This is because I can fill out a survey quickly and with more sincere and profound thinking in my language, while in English takes me 3-4 times more to do it. So I usually skip text questions unless I have something significant to say. In this survey, they are optional.

  • If you agree with the last point, we can add a question saying, " We wish to remove the language barriers, so you can reply to these questions in any language you feel comfortable with.
    Please select the language you prefer to reply, " then a list of options...
    I can commit to translating the answers to English after :) (with my friend Google translate)

  • is age not important? Maybe a question like: " What is your age?
    a) 15-20
    b)20-30
    c) 30-40
    d) 40-50
    e) 50-60
    Other??

@MGomezN
Copy link
Member

MGomezN commented Sep 9, 2022

Social media message:

📣 Calling all users of Pooch/Verde/Harmonica/Boule/Fatiando: We need your feedback! Please fill out this short survey (5-10min) LINKTOSURVEY
Your answers will let us know our community better and tailor development to your needs!

Alt: Fatiando a Terra Community Survey 2022. Fill it out today! Should only take 5-10min.

Any thoughts or changes? cc @MGomezN our social media guru ❤️

I love it :) But I will ask my guru Abraham Reyes in case we can improve to make it irresistible to reply

@MGomezN
Copy link
Member

MGomezN commented Sep 9, 2022

My guru's suggestion:
https://www.fakewhats.com/free
😆 😆

fakewhatsappfatiandosurvey

@leouieda
Copy link
Member Author

leouieda commented Sep 9, 2022

😆 Love it! Since our goal is to post about this a few times, we can use the different messages.

@leouieda
Copy link
Member Author

leouieda commented Sep 9, 2022

The survey asks about the country of residence. What if we add nationality?

This can get complicated fast since people can have multiple nationalities and may be living out of their country of birth for most of their lives. So being from Brazil and living in the UK doesn't necessarily say much about my culture/upbringing. My daughter is Brazilian (not a UK citizen) but was born and raised in the UK.

If the goal is to find out if someone is fluent in English or not, then maybe we could just ask that as you suggested: "What is your level of fluency in the English language?" with options "Low, Moderate, High, Fluent, Native". Would that be OK?

What I really want to know is if people complain about documentation/tutorials not being clear enough, is it because maybe they don't have the English level required to understand it?

That's a very good point! Maybe we could include a question about what people think of our documentation?

  • "How would you rate the overall quality of our documentation?" with "Don't know/Haven't used, Very Poor, Poor/Confusing, Neither good nor bad, Good/Mostly clear, Excellent". It could list all projects including the tutorial/videos.
  • This could be followed up by an optional written question "Do you have any suggestions on how we could improve our documentation and learning resources?". This could cover things like "it's too technical" or "my English isn't so good so a Spanish translation would be great".

What do you think?

Maybe the option to reply to the "text" questions in their native language?

Great idea! I can put in text in the description of that section saying:

"The preferred language for your answers is English but we don't want language to be a barrier for your participation. Please feel free to write in another language if you feel more comfortable doing so. However, our team only includes fluent speakers of English, Portuguese, and Spanish. Other languages will be translated using Google Translator."

How about that?

is age not important? Maybe a question like: " What is your age?

Does it matter? I feel like we shouldn't ask personal information like this unless there is a good reason for doing so. Personally, I don't know if I'd use this. But if there is a legitimate reason then I'm happy to include.

@leouieda
Copy link
Member Author

leouieda commented Sep 9, 2022

Thanks for the feedback @MGomezN! Always appreciate your very thoughtful points 🙂

@MGomezN
Copy link
Member

MGomezN commented Sep 9, 2022 •
edited
Loading

@leouieda Maybe the words "nationality" and "age" are not reflecting what I really want to ask.

Rocio in GeoLatinas shared this words one day about an opportunity to write a short article in Nature:

" Terminology: requested them to go from Hispanic Heritage, to “Hispanic, LatinAmerican and Latinx Heritage Month” on the form text, to honor how using those terms are a push for some of us, as we identify differently (by country, gender inclusive and/or other culturally relevant terms like Chicane).

Identity: requested using our country of heritage on the article, even with flags if possible."

So, what I'm looking for are questions to have an idea about
"cultural diversity" of people using Fatiando.

Are these tools used by a wide range of people with a broad range of programming skills? And educational levels?
Bachelors? Posdocs?
Phds?
Assessment of the "accessibility" of this software is maybe something future grants applications are interested in.

@leouieda
Copy link
Member Author

leouieda commented Sep 9, 2022

Ah right, I see what you mean. So how about we ask:

"What is your country of heritage?"

Your country of heritage is the country with which you identify culturally. It may or may not be the same as your country of residence or country of birth.

Are these tools used by a wide range of people with a broad range of programming skills? And educational levels?

I'll include questions about programming skill level and educational level as well. Good catch!

Assessment of the "accessibility" of this software is maybe something future grants applications are interested in.

Yes 100%!

I have added the questions above to the survey: https://forms.gle/X2CUVAc8aD8j1Srg7

@aguspesce @MGomezN could you please have another go at the survey to see if it's OK?

@MGomezN
Copy link
Member

MGomezN commented Sep 9, 2022 •
edited
Loading

@aguspesce @MGomezN could you please have another go at the survey to see if it's OK?

@leouieda some suggestions:

  • What is your affiliation?

  • What is your level of education? --> Maybe add formal or _academic education? since people can argue education is not only academic.

  • I suggest bringing this paragraph to the first page of the survey: "The preferred language for your answers is English but we don't want language to be a barrier for your participation. Please feel free to write in another language if you feel more comfortable doing so. However, keep in mind that our survey team only includes fluent speakers of English, Portuguese, and Spanish. Other languages will be translated using Google Translator."

Some short questions require writing before page 4. I guess people can feel enthusiastic if they know from the beginning they can reply in any language they prefer.

  • How did you manage to include the list of countries!? Awesome! If possible, maybe have a list of languages on page 1. This way, we know what language we expect, and they will be forced to read the message about language freedom.

@leouieda
Copy link
Member Author

leouieda commented Sep 9, 2022

What is your affiliation?

Done

What is your level of education? --> Maybe add formal or _academic education? since people can argue education is not only academic.

Changed to "highest level of formal/academic education"

suggest bringing this paragraph to the first page of the surve

Done but also left it at the end as a reminder since that's where most written responses are.

How did you manage to include the list of countries!?

Searched for a list of countries and then copy+paste into the survey fields 😉 Tried doing the same for language but couldn't find a good list that worked with copy+paste. So maybe we leave that for another time.

@leouieda
Copy link
Member Author

Survey is live!

@leouieda
Copy link
Member Author

Good morning @MGomezN @aguspesce @santisoler! Whenever you're ready, please make the social media/github/slack posts outlined above and drop a link here for retweets/reshares.

@santisoler
Copy link
Member

Discussion already created: #66

@MGomezN
Copy link
Member

MGomezN commented Sep 12, 2022

Twitter https://twitter.com/fatiandoaterra/status/1569366910118109184 ✅
I just now had the idea that we would have better used something like bitly both to shorten the link and to compare how many opened the link vs how many answered it :P

@MGomezN
Copy link
Member

MGomezN commented Sep 12, 2022

What is your affiliation?

Done

What is your level of education? --> Maybe add formal or _academic education? since people can argue education is not only academic.

Changed to "highest level of formal/academic education"

suggest bringing this paragraph to the first page of the surve

Done but also left it at the end as a reminder since that's where most written responses are.

How did you manage to include the list of countries!?

Searched for a list of countries and then copy+paste into the survey fields wink Tried doing the same for language but couldn't find a good list that worked with copy+paste. So maybe we leave that for another time.

@leouieda Thanks for considering my suggestions. You did an amazing job with the survey :)

@leouieda
Copy link
Member Author

I just now had the idea that we would have better used something like bitly both to shorten the link and to compare how many opened the link vs how many answered it

Yes! We could have used a redirect from our website with plausible enabled. It would achieve the same thing. Taking note of this for the reflection we do afterwards on how to improve for next time.

@leouieda
Copy link
Member Author

You did an amazing job with the survey :)

We did 😎

@leouieda
Copy link
Member Author

Alright, survey is now closed! Thank you everyone for helping put this together. We got 28 responses, which is lower than I would have liked but still useful. Feedback in general was excellent with several things we can tease out into Issues for us to work on going forward.

We (me, @aguspesce, @MGomezN, @santisoler) will be working to distil the responses into more actionable information and will share results ASAP.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@leouieda @santisoler @aguspesce @MGomezN