Date & Time: March 8th-10th. 9am-1pm
Room 20.287 (Campus Ciutadella) and via Zoom
Cross-cultural survey research may span multiple countries, regions, and languages. Examples include the European Social Survey (ESS), the European Values Survey (EVS), the Survey of Health Age and Retiring in Europe (SHARE) among others. Creating questionnaires for multiple contexts should consider potential differences in the way respondents answer questionnaires, and methodological procedures, such as the translation of questionnaires. This course will show students how to design questionnaires for multiple populations. The course is divided in three parts: In the first part students will get familiar with three-step procedure to design questionnaires. In the second part, students will learn about gold-standard procedures to translate survey questionnaires. In the third part, students will learn the state of the art on the effects that linguistic elements can have in the way respondents answer questionnaires.
In the lab sessions, we will use the MCSQ https://www.upf.edu/web/mcsq and open-source and open-access research resource to retrieve and analyse past translations decisions in large scale comparative survey projects, such as ESS, EVS, SHARE.
If students are in the process of designing questionnaires, we will work with their real examples.
No prerequisites. This course is addressed to all researchers with an interest in comparative research in multiple contexts and cultures. It is specially recommended for questionnaire designers, survey practitioners and translators with an interest in the translation of questionnaires.
1. The three-step procedure to design questionnaires (Saris & Gallhofer 2014) in multi-cultural contexts.
Lab: Get familiar with the Multilingual Corpus of Survey Questionnaires (MCSQ)
1. (Cont.) Designing questionnaires in multi-cultural contexts
2. The TRAPD (Translation, Review, Adjudication, Pretesting and Documentation) method to translate questionnaires (Harkness 2003).
Lab: Design of a questionnaire
What is culture? What is language?
Cultural effects and language effects in survey research: Cultural Frame Switching, cognitive biases, response process in multilingual respondents.
Lab: Design of a questionnaire and use of the MCSQ
Hong, Y., Morris, M. W., Chiu, C., & Benet-Martínez, V. (2000). Multicultural minds: A dynamic constructivist approach to culture and cognition. American Psychologist, 55(7), 709–720. https://doi.org/10.1037/0003-066X.55.7.709
Harkness, J. A., Villar, A., & Edwards, B. (2010). Translation, Adaptation, and Design. In J. A. Harkness, M. Braun, B. Edwards, T. P. Johnson, L. E. Lyberg, P. P. Mohler, … T. W. Smith (Eds.), Survey Methods in Multinational, Multiregional, and Multicultural Contexts (pp. 115–140). John Wiley & Sons, Inc. https://doi.org/10.1002/9780470609927.ch7
Harkness, J. A., Edwards, B., Hansen, S. E., Miller, D. R., & Villar, A. (2010). Designing Questionnaires for Multipopulation Research. In J. A. Harkness, M. Braun, B. Edwards, T. P. Johnson, L. E. Lyberg, P. P. Mohler, … T. W. Smith (Eds.), Survey Methods in Multinational, Multiregional, and Multicultural Contexts (pp. 31–57). John Wiley & Sons, Inc. https://doi.org/10.1002/9780470609927.ch3
Saris, W. E., & Gallhofer, I. (2014). Design, evaluation, and analysis of questionnaires for survey research. In Wiley Series in Survey Methodology (Second, Vol. 548). John Wiley & Sons. https://doi.org/10.1111/j.1751-5823.2008.00054_20.x
Zavala-Rojas, D., Sorato, D., Hareide, L., & Hofland, K. (forthcoming). [MCSQ] Multilingual Corpus of Survey Questionnaires. Meta: Journal Des Traducteurs.
We will see examples from the following literature and depending on the individual interests of each student I will recommend specific readings from the following, among others:
Behr, D. (2018) "Translating questionnaires for cross-national surveys – a description of a genre and its particularities based on the ISO 17100 categorization of translator competences." Translation & Interpreting 10 (2): 5-20.
Cohen, A. B. (2009). Many forms of culture. American Psychologist, 64(3), 194.
Peytcheva, E. (2018). Can the Language of Survey Administration Influence Respondents’ Answers? Advances in Comparative Survey Methods. https://doi.org/doi:10.1002/9781118884997.ch15
Stewart, M. A., Ryan, E. B., & Giles, H. (1985). Accent and Social Class Effects on Status and Solidarity Evaluations. Personality and Social Psychology Bulletin, 11(1), 98–105. https://doi.org/10.1177/0146167285111009
Zavala-Rojas, D., & Saris, W. E. (2018). Measurement Invariance in Multilingual Survey Research: The Role of the Language of the Questionnaire. Social Indicators Research, 140(2), 485–510. https://doi.org/10.1007/s11205-017-1787-x