cognitive fun!

Learn your mind. Play it too.
Protocol differences between the original Jaeggi-Buschkuehl dual n-back task and the cognitivefun reproduction
cognitivefun | 5 years ago Reply Link me
Protocol differences between the original Jaeggi-Buschkuehl dual n-back task and the cognitivefun reproduction
As you may have noticed, the cognitivefun test/5 version is *not* a verbatim implementation of the test in the original paper.

Aside of the audio being a male and not strictly timed voice, and the different visual appearance of stimuli, the three most significant departures are 1. the n-back targets are selected probabilistically, 2. usage of arrow keys, and 3. presence of feedback. For the interested, these points are addressed below.

There is a 20+n trial version available, but to avoid confusion about which to use, it was not put on the front page. There will now be a link from the test page itself. It uses the same dataset as the other version.
cognitivefun | 5 years ago Reply
"3. presence of feedback"
3. On feedback. Feedback is very arguably a distractor in this test. However, it is also arguably a catalyst of learning. Suppose you are 49% confident you have an n-back, but decide, incorrectly, not to respond. Then suppose you are 51% confident, and decide, incorrectly, to respond. In a non-feedback version, you either realize your mistake after the session, in which significant time has elapsed, or you are kept oblivious. Compare this to a case where feedback is administered immediately, and the goal would be to enhance the 49% confidence and diminish the 51% confidence. With a loose behavioral interpretation, this hypothesis holds water.
cognitivefun | 5 years ago Reply
"2. usage of arrow keys"
2. On arrow keys. The principle difference here is that this version allows single-handed input, as opposed to two-hands. There will probably be effects due to the hands being controlled by different brain hemispheres, but this confound is overlooked. You are free to use two hands on the arrow keys as you wish, or use one hand, or foot, whichever (for what it's worth, the foot should be yet slower than the hand).
cognitivefun | 5 years ago Reply
"1. the n-back targets are selected probabilistically"
1. The presentation order in the original version is predetermined, and always has 20+n trials. This is likely necessitated by the need for rigorous comparison and analysis, hence minimizing the variation between confounds that may affect the independent variable (working memory assessment). As this version is not strictly monitored, the trial count is made flexible. Furthermore, as the original version had pre-determined quotas for targets, it is possible to predict the presentation order (for example, if two dual-modality targets have gone by, you are assured they will not appear again), decreasing cognitive load. A probabilistic approach mitigates predictability. Specifically, this n-back variant uses a 1/3 target probability, which means out of 20 trials, about 2 (1/9) are dual-modality, and about 4 (2/9) for each other modality. In the long run, the target/non-target ratios are similar to the original.
cognitivefun | 5 years ago Reply
"long"
Actually, that is the short run, after rounding of probabilities. The original protocol uses 4/20, or 1/5 for single-modality targets, and 2/20, or 1/10 for dual-modality targets. Combined, that is a 1/2 probability of a target showing up.
The picture n-back test used a 1/3 target probability, which worked fine because it was a single-modality test. Using 1/3 independent probabilities for the dual-modality test means a 2/3 chance of a target, which is not good!
This will be fixed soon, and sorry for the inconvenience.
cognitivefun | 5 years ago Reply
It's different, but is it really not good? Does a 66% target chance decrease the efficacy of the test? Does the paper mention the benefits of one probability over another?

On that note, will you only be keeping test/5 up to date or will test/8 receive the same changes? Just want to know what to keep my eye on.

Thanks for the hard work.
rectotron | 5 years ago Reply
"On that note, will you only be keeping test/5 up to date or will test/8 receive the same changes? Just want to know what to keep my eye on."
Thanks for pointing it out! By the time someone reads this, test/8 should be updated.
cognitivefun | 5 years ago Reply
"It's different, but is it really not good? Does a 66% target chance decrease the efficacy of the test?"
Theoretically it shouldn't decrease the efficacy of the test, as long as you are putting in the same effort to complete it. The problem is that if the probability of a target is greater than 0.5, then you will achieve an above-chance score of being correct by mindlessly responding to every presentation. Although users who do this will simply lose the benefit from practice, it's an inelegant oversight.

The other thing is, a higher probability will make the tests shorter, and possibly chaotic, because most of the presentations require response. P = 0.5 seems to be a reasonable balance. For the picture n-back test, it will stay at P = 0.33 for now, because it auto-advances after you respond.
cognitivefun | 5 years ago Reply
Whether it be a positive or negative response bias, doesn't any probability other than .5 bias the results? I've noticed most studies use a probability of .12 - .33, but there is never any discussion or citation explaining why the ratio was used.
benallen | 2 years ago Reply

Login to save scores

© 2008-2012 cognitivefun.net | about | widgets | blog | cognitive neuroscience for everyone