METHODOLOGICAL AND STATISTICAL PROBLEMS IN EXPERIMENTAL PSYCHOLOGY
Rapid development of experimental technology seems not to be paralleled with a response – change in research methodology and statistical analysis. Still, we are mainly reading about factorial designs and analysis of variance, or the like. Researchers trust that methodological vigor and careful control of external confounders are still good enough to make us relaxed otherwise. Only some are thinking how to respond appropriately to fine-grained though massive datasets that we harvest with new technologies. This is even epistemologically sound question. At the very least, methodological and statistical apparatus should harmonize with each other, and with the specific research question and various ecological factors.
Baayen, R. H., & Milin, P. (2010). Analyzing Reaction Times. International Journal of Psychological Research, 3(2), 12-28. PDF
Milin, P., & Hadžić, O. (2011). Moderating and Mediating Variables in Psychological Research. In M. Lovrić (Ed.) International Encyclopedia of Statistical Science (pp. 849-852). Berlin: Springer. PDF