The Berlin Numeracy Test is a fast and flexible psychometric instrument, validated for use with educated samples from diverse countries (e.g., college students, computer-literate adults, physicians). The simplest Berlin Numeracy Test format is a traditional 4 question paper and pencil test that takes about 5 minutes to complete. The computer adaptive version of the Berlin Numeracy Test requires that people answer 2-3 questions (ca. 3 minutes) that are adaptively selected based on one's previous answers. If a test-taker gets the first answer right/wrong then a harder/easier question will be presented. We have also validated a multiple choice format and two very fast (ca. 1 minute) single-item tests (i.e., median-split) for use with general community or highly-educated samples. All test formats are designed to address psychometric limitations of previous instruments (e.g., negative skew, construct validity) and can be used as stand-alone assessments of statistical numeracy and risk literacy (Cokely et al., 2012). Additionally, the various test formats can be combined with other instruments for more extensive analyses, which may be valuable when working with less-numerate individuals. For help selecting the best test format for your needs you can use our
test recommendation tool.
If you would like to use the Computer Adaptive Berlin Numeracy Test, we would be happy to program a unique link for you that can be added to or embedded in your experiment or survey. This link will offer features like automatic scoring and a simple online interface that can be accessed by any computer with internet access. Results are then batched and emailed to you automatically when your experiment is complete (or upon your request). To use this option, you will be asked to do the following:
(1) Supply a valid academic or institutional email**
(2) To indicate your professional affiliation**
(3) To confirm that your research will conform to high ethic standards (see
NIH Bioethics)
(4) Answer a few basic questions (e.g., how many participants do you plan to collect)
Upon completion, you will receive an email containing a link to your personal Berlin Numeracy Research Site, which can be accessed from any computer (and most mobile devices) with internet access or may otherwise be embedded into your experimental design. Click the link below to begin.
Use the Berlin Numeracy Test for Research
Please feel free to
contact us with any questions, concerns, or ideas regarding how to make the test easier or more useful.
** We will never share your information without your consent. We do not sell any information.
References:
Cokely, E.T., Galesic, M., Schulz, E., Ghazal, S., & Garcia-Retamero, R. (2012). Measuring risk literacy: The Berlin Numeracy Test.
Judgment and Decision Making, 7, 25-47.
Download
Description: A 1-4 item (ca. 3 minute) test of statistical numeracy and risk literacy that is well suited for use with moderate-to-highly numerate individuals from diverse countries (e.g., college students, computer literate adults, physicians). Scores from the 3 item Schwartz et al. (1997) test can be added to the Berlin Numeracy Test for a 5 minute assessment that provides additional discriminability at lower levels of numeracy.
See also:
Cokely, E.T., Ghazal, S., Galesic, M., Garcia-Retamero, R., & Schulz, E. (in press). How to measure risk comprehension in educated samples. In R. Garcia-Retamero & M. Galesic (Ed.), Transparent communication of risks about health: Overcoming cultural differences. New York: Springer.
Additional Resources:
Appelt, K. C., Milch, K. F., Handgraaf, M. J. J., & Weber, E. U. (2011). The Decision Making Individual Differences Inventory and guidelines for the study of individual differences in judgment and decision-making research. Judgment and Decision Making, 6, 252-262.
Decision Making Individual Differences Inventory
Description: An online database of psychometric instruments and inventories used in the decision sciences.
Blais, A.-R., & Weber, E. U. (2006). A Domain-Specific Risk-Taking (DOSPERT) scale for adult populations. Judgment and Decision Making, 1(1), 33-47.
Description: The updated, brief version of DOSPERT was designed to more quickly assess risk preferences through self-report in five domains.
Fagerlin, A., Zikmund-Fisher, B., Ubel, P., Jankovic, A., Derry, H., & Smith, D. (2007). Measuring numeracy without a math test: Development of the subjective numeracy scale. Medical Decision Making, 27, 672–680.
Description:
A short instrument for collecting subjective numeracy self-estimates that is well suited for differentiating among low-to-moderately numerate individuals.
Galesic, M., y García-Retamero, R. (2011b). Graph literacy: A cross-cultural comparison. Medical Decision Making, 31, 444-457.
Description: A brief test that measures individual differences in Graph Literacy.
Lindskog, M., Kerimi, N., Winman, A., & Juslin, P. (2011). A Swedish validation study of the Berlin Numeracy Test. Unpublished raw data.
Description: A Swedish translation and validation of the Berlin Numeracy Test.
Lipkus, I. M., Samsa, G., & Rimer, B. K. (2001). General performance on a numeracy scale among highly-educated samples. Medical Decision Making, 21, 37-44.
Description: 11 item test (5-10 minutes) that measures statistical numeracy and is suited for use with low-to-moderately numerate individuals.
Schwartz, L. M. L., Woloshin, S. S., Black, W. C. W., & Welch, H. G. H. (1997). The role of numeracy in understanding the benefit of screening mammography. Annals of Internal Medicine, 127, 966-972.
Description: 3 item test (1-2 minutes) test that is well suited for use with low-to-moderately numerate individuals.
Weber, E. U., Blais, A., & Betz, N. E. (2002). A domain-specific risk-attitude scale: Measuring risk perceptions and risk behaviors. Journal of Behavioral Decision Making, 15(4), 263-290. doi: 10.1002/bdm.414
Description: The DOSPERT was designed to assess risk preferences through self-report in five domains.
Weller, J. A., Dieckmann, N., Tusler, M., Mertz, C. K., Burns, W., & Peters, E. (in press). Development and Testing of an Abbreviated Numeracy Scale: A Rasch Analysis Approach.
Journal of Behavioral Decision Making.
Description: A Rasch test (est. 10 minutes) that combines items from several other tests (e.g., cognitive reflection test, Lipkus et al. 2011) and is designed for use with the general US population.