xAPI: correct response pattern

[garemoko]

The correct response pattern has two issues:

1. Hints are appended to the options. If this data is useful it should be included instead in a definition extension.
2. Possible answers are delimited with a slash. instead they should be listed are multiple possible correct answers. So, for the example statement below:

"correctResponsesPattern": [
    "{case_matters=true}browser[,]Tin Can",
    "{case_matters=true}browser[,]Tin Can API",
    "{case_matters=true}web-browser[,]Tin Can",
    "{case_matters=true}web-browser[,]Tin Can API"
]

I appreciate this could be a lot of permutations where there are lots of blanks, but that's the spec as it is today and of course these permutations can be generated programmatically.

Example statement from H5P wordpress plugin (updated today).

{
    "id": "12fed9ff-f26e-42ae-bb01-1e41f1526008",
    "actor": {
        "name": "admin",
        "mbox": "mailto:[email protected]",
        "objectType": "Agent"
    },
    "verb": {
        "id": "http://adlnet.gov/expapi/verbs/answered",
        "display": {
            "en-US": "answered"
        }
    },
    "result": {
        "score": {
            "scaled": 0,
            "raw": 0,
            "min": 0,
            "max": 2
        },
        "completion": true,
        "response": "web browser[,]tin can",
        "duration": "PT282.78S"
    },
    "context": {
        "contextActivities": {
            "category": [
                {
                    "id": "http://h5p.org/libraries/H5P.Blanks-1.4",
                    "objectType": "Activity"
                }
            ],
            "grouping": [
                {
                    "id": "http://localhost:8888/wordpress/h5p-test/",
                    "definition": {
                        "name": {
                            "en": " | H5P testWordPress sandbox"
                        },
                        "type": "http://activitystrea.ms/schema/1.0/page",
                        "moreInfo": "http://localhost:8888/wordpress/h5p-test/"
                    },
                    "objectType": "Activity"
                }
            ]
        }
    },
    "timestamp": "2016-01-18T18:06:35.886Z",
    "stored": "2016-01-18T18:06:35.886Z",
    "authority": {
        "name": "H5P",
        "account": {
            "homePage": "https://sandbox.watershedlrs.com",
            "name": "CDrGGtiYAEjUFr"
        },
        "objectType": "Agent"
    },
    "version": "1.0.0",
    "object": {
        "id": "http://localhost:8888/wordpress/wp-admin/admin-ajax.php?action=h5p_embed&id=9",
        "definition": {
            "extensions": {
                "http://h5p.org/x-api/h5p-local-content-id": 9
            },
            "name": {
                "en-US": "Fill in the blanks"
            },
            "description": {
                "en-US": "Fill in the missing words
H5P content may be edited using a __________.

\n
xAPI is also known as __________.

\n"
            },
            "type": "http://adlnet.gov/expapi/activities/cmi.interaction",
            "interactionType": "fill-in",
            "correctResponsesPattern": [
                "{case_matters=true}browser/web-browser:Something you use every day[,]Tin Can/Tin Can API:Contains Baked Beans"
            ]
        },
        "objectType": "Activity"
    }
}

[falcon-git]

Yeah, I think this was forgotten, I wasn't sure about adding all those permutations, but since you indicate it is the only way at the moment I'll add it, hopefully for the next release, and get rid of the hints as well obviously

[falcon-git]

This was fixed in:
8e364d0
2f92059
1bf7f97

[kienv]

Hi guys,

We found this becomes a real problem. We have a small activity with 14 fill-in-blank questions. Each question has 4 possible answers. current, the code generates a 4^14 = 268435456 rows array for possible answers. this makes browsers get crashed and also DB issue.

Could you please review it or do you guy already working on this?

[falcon-git]

@garemoko do you know if there are better ways of doing this now? If not I guess we should handle this by:

If the user answered incorrectly use the first alternative answer and the other ones in a custom property(extension), if the user correctly answered one of the alternative answers we use that answer and store alternatives in the same extension.

[garemoko]

Hi, I don't recall exactly how the blanks question works. Would it make sense to model each blank as a separate question with a separate xapi statement to reduce the number of permutations?

[falcon-git]

There might be multiple blanks in each sentence, i.e. There might be ______ _______ in each ________

I'm not sure if it would make sense to model it as multiple sentences. The real problem at least is how xAPI presents multiple alternative answers.

[garemoko]

We've also got to think about how the data will be consumed. xAPI is very unlikely to change at this point but even if it did, how would a reporting tool represent all those options? I think it would have to present them as though they were separate questions.

[kienv]

I think if we can keep them in order then i think it can reduce a lot of possible answers
eg . [first blank - possible answer 1,possible answer 2,possible answer 3,..],[second blank - possible answer 1,possible answer 2,possible answer 3,..],....

[ilukanets]

Hi guys,

We found this becomes a real problem. We have a small activity with 14 fill-in-blank questions. Each question has 4 possible answers. current, the code generates a 4^14 = 268435456 rows array for possible answers. this makes browsers get crashed and also DB issue.

Could you please review it or do you guy already working on this?

Hello...

We have the same issue reported by one of our customers. Are there some news on this?