This community is in archive. Visit community.xprize.org for the current XPRIZE Community.

Data from the Global Learning XPRIZE Field Test

daniel_millerdaniel_miller Posts: 19
edited May 2019 in Data
https://data.xprize.org/global_learning_xprize/5cc0c16150ddf00be88dc6e1
We are thrilled to share the results of the Global Learning XPRIZE 15 month field test.

We would love to hear from you on which of the findings you feel is most valuable for scaling this technology and the best ways to further analyze this data in the thread below!

Comments

  • jamiejamie Posts: 3
    RTI mentioned during the data deep dive session that they would upload their presentations to the community forum. Would be great to see these!
  • jo_xprizejo_xprize Posts: 27
    @jamie Hi, Jamie. We have uploaded the presentation here: https://data.xprize.org/global_learning_xprize/5cc0c16150ddf00be88dc6e1 (see "egra-egma-rti-presentation-2019-05-16.pdf").
  • jpressleyjpressley Posts: 1
    Hi There!
    Question mainly directed at UDS or UNESCO: Are there instruments available somewhere for the Social-Emotional interviews? Thanks!
  • Jack_MostowJack_Mostow Posts: 4 ✭✭
    Dear @simonking, @jpressley, and @AmberGove,

    Belated thanks for your May 16 presentation of the results. Congratulations on producing them so quickly, presenting them so clearly, and surviving the onslaught of questions with which we peppered you!

    Can you please post your statistical analyses of the literacy and numeracy test results in sufficiently precise detail for others to replicate, including whether and how you:
    1. adjusted for baseline differences
    2. adjusted for attrition and missing data
    3. weighted subscores to count reading 60%, writing 10%, and numeracy 30%
    4. computed effect sizes
    5. tested statistical significance of differences
    6. corrected for multiple comparisons
    7. analyzed variance within vs. between villages
    8. accounted for within-village clustering effects
    9. used R, Excel, and/or other analysis tools to perform these analyses
    Please include your R code, Excel formulas, etc., in easy-to-execute form, so that we can reuse or at least emulate them as we drill down into the data.

    Thanks! - @Jack_Mostow, RoboTutor team
  • Jack_MostowJack_Mostow Posts: 4 ✭✭
    Which baseline and endline measures, e.g. writing, were omitted from gains, and why?
    Were their gains used to help determine the Grand Prize winners, and if not, why not?
  • Jack_MostowJack_Mostow Posts: 4 ✭✭
    In order to compute gains in writing, we were looking at "dict_q3_End" on the Control & RoboTutor EGMA/EGRA results table, and noticed that the number "4" shows up multiple times. What does the value 4 mean? The codebook says only:
    dict_q3_End Please write the sentence: Nyumbani kwenu ni wapi? (Where do you live?) Integer
    Child attempted sentence 1
    Child did not attempt sentence 888
  • jo_xprizejo_xprize Posts: 27
    Hi There!
    Question mainly directed at UDS or UNESCO: Are there instruments available somewhere for the Social-Emotional interviews? Thanks!

    @jpressley Yes, the questions (and each questions's list of possible answers) have been uploaded at https://data.xprize.org/global_learning_xprize/5cc0c16150ddf00be88dc6e1

    See the file social-emotional-data-dictionary.csv.
  • jo_xprizejo_xprize Posts: 27
    In order to compute gains in writing, we were looking at "dict_q3_End" on the Control & RoboTutor EGMA/EGRA results table, and noticed that the number "4" shows up multiple times. What does the value 4 mean? The codebook says only:
    dict_q3_End Please write the sentence: Nyumbani kwenu ni wapi? (Where do you live?) Integer
    Child attempted sentence 1
    Child did not attempt sentence 888

    @Jack_Mostow The value indicates the number of words attempted. So in this case the child attempted to write 4 words.
  • OdaEdTechOdaEdTech Posts: 1
    Hi all! Where are the UNESCO social & emotional indicators (aspirations, chores, sharing, honesty, persistence, cooperation, self-regulation and obedience) taken from? Were they derived from a given paper?
  • jasmin_baierjasmin_baier Posts: 1
    Thank you for your commitment to open source data!
    @jo_xprize I was wondering if XPrize might be willing to give out 100% of the team data and/or treatment data with IDs if it was being used for purely academic study? If yes, how could one "apply" for it or request the full data?
Sign In or Register to comment.