The Mismeasure of Culture Self-Report Questionnaires and Positivist Analysis in Intercultural Communication Research

Stewart Nield (1)
(1) Xi-an Jiao Tung Liverpool University , China

Abstract

The use of self-report questionnaires has been one of the most prevalent methods of data collection in Intercultural Communication research since as early as the 1950s. Yet, the method has received widespread criticism from a range of academic disciplines. For the field of Intercultural Communication, there is the added concern that self-report data and its epistemological companion, quantitative analysis, succeed only in reducing complex intercultural issues to an overly-simplistic numerical summary. Despite these criticisms, the number and influence of self-report questionnaires in Intercultural Communication research continues to grow. Therefore, this paper seeks to remind researchers of the many problems existing when asking respondents to self-report on complex intercultural issues. By way of an example, Ang et al’s (2007) Cultural Intelligence Scale (CQS) will be analysed through a critically interpretive approach.

Full text article

Generated from XML file

References

Ahn, M. J., & Ettner, L. (2013). Cultural intelligence (CQ) in MBA curricula. Multicultural Education & Technology Journal, 7(1), 4–16. https://doi.org/10.1108/17504971311312591 DOI: https://doi.org/10.1108/17504971311312591

Ang, S., Van Dyne, L. &. Koh, C. (2006). Personality Correlates of the Four-Factor Model of Cultural Intelligence. Group & Organization Management, 31(1), 100–123. https://doi.org/10.1177/1059601105275267 DOI: https://doi.org/10.1177/1059601105275267

Ang, S., Dyne, L. Van, Koh, C., Ng, K. Y., Templer, K. J., Tay, C., & Chandrasekar, N. A. (2007). Cultural Intelligence : Its Measurement and Effects on Cultural Judgment and Decision Making , Cultural Adaptation and Task Performance. Management and Organization REview, 3(3), 335–371. https://doi.org/10.1111/j.1740-8784.2007.00082.x DOI: https://doi.org/10.1111/j.1740-8784.2007.00082.x

Angouri, J. (2016). 'Studying identity' in H. Zhu, (ed.) Research Methods in Intercultural Communication: A Practical Guide Hoboken, New Jersey: John Wiley & Sons Inc. DOI: https://doi.org/10.1002/9781119166283.ch3

Blasco, M., Feldt, L. E., & Jakobsen, M. (2012). If only cultural chameleons could fly too: A critical discussion of the concept of cultural intelligence. International Journal of Cross Cultural Management, 12(2), 229–245. https://doi.org/10.1177/1470595812439872 DOI: https://doi.org/10.1177/1470595812439872

Baldwin, W. (2009). ‘Information no one else knows: The value of self-report’ in Stone et al (eds.) The Science of Self-Report: Implications for Research and Practice New Jersey: Taylor & Francis

Brinkmann, S. & Kvale S. 2015. Interviews: Learning the Craft of Qualitative Interviewing Thousand Oaks: Sage

Bucker, J., Furrer, O. Lin, Y. (2015). Measuring cultural intelligence (CQ): A new test of the CQ scale. International Journal of Cross Cultural Management, 15(3), 259-284. https://doi.org/10.1177/1470595815606741 DOI: https://doi.org/10.1177/1470595815606741

Bryman, A. (2004). Qualitative research on leadership: A critical but appreciative review. Leadership Quarterly, 15(6), 729–769. https://doi.org/10.1016/j.leaqua.2004.09.007 DOI: https://doi.org/10.1016/j.leaqua.2004.09.007

Bryman, A. (2008). 'The end of the Paradigm Wars?' in Alasuutari, P., Bickman, L. & Brannen, J. (eds.) The SAGE Handbook of Social Research Methods London: SAGE Publications

Cultural Intelligence Center (2016). 'Cultural Intelligence Research' [Online] Available at: https://culturalcq.com/research/ (Accessed: 16 November, 2016)

Deardorff, D. K. (2006). Identification and Assessment of Intercultural Competence as a Student Outcome of Internationalization. Journal of Studies in International Education, 10(3), 241–266. https://doi.org/10.1177/1028315306287002 DOI: https://doi.org/10.1177/1028315306287002

Deardorff, D.K. (2016). How to assess intercultural competence in H. Zhu, (ed.) Research Methods in Intercultural Communication: A Practical Guide Hoboken, New Jersey: John Wiley & Sons Inc. DOI: https://doi.org/10.1002/9781119166283.ch8

Dervin, F. (2011). A plea for change in research on intercultural discourses: A “liquid” approach to the study of the acculturation of Chinese students. Journal of Multicultural Discourses, 6(1), 37–52. https://doi.org/10.1080/17447143.2010.532218 DOI: https://doi.org/10.1080/17447143.2010.532218

Eisenberg, J., Lee, H. J., Brück, F., Brenner, B., Claes, M. T., Mironski, J., & Bell, R. (2013). Can business schools make students culturally competent? Effects of cross-cultural management courses on cultural intelligence. Academy of Management Learning and Education, 12(4), 603–621. https://doi.org/10.5465/amle.2012.0022 DOI: https://doi.org/10.5465/amle.2012.0022

Gould, S.J. (1996). The Mismeasure of Man New York: W.W. Norton & Company

Gu, Q., & Schweisfurth, M. (2006). Who Adapts? Beyond Cultural Models of “the” Chinese Learner. Language, Culture and Curriculum, 19(1), 74–89. https://doi.org/10.1080/07908310608668755 DOI: https://doi.org/10.1080/07908310608668755

Hamamura, T., Heine, S. J., & Paulhus, D. L. (2008). Cultural differences in response styles : The role of dialectical thinking. Personality and Individual Differences, 44, 932–942. https://doi.org/10.1016/j.paid.2007.10.034 DOI: https://doi.org/10.1016/j.paid.2007.10.034

Holliday, A. (2011) Intercultural Communication and Ideology London: Sage Publications DOI: https://doi.org/10.4135/9781446269107

Holliday, A. (2016). Studying Culture in H. Zhu, (ed.) Research Methods in Intercultural Communication: A Practical Guide Hoboken, New Jersey: John Wiley & Sons Inc. DOI: https://doi.org/10.1002/9781119166283.ch2

Hu, Y. & Fan, W. (2011). An exploratory study on intercultural communication research contents and methods: A survey based on the international and domestic journal papers published from 2001 to 2005. International Journal of Intercultural Relations, 35(5), pp.554–566. Available at: http://dx.doi.org/10.1016/j.ijintrel.2010.12.004. DOI: https://doi.org/10.1016/j.ijintrel.2010.12.004

Jahoda, G. (2012). Critical reflections on some recent definitions of “culture.” Culture & Psychology, 18(3), 289–303. https://doi.org/10.1177/1354067X12446229 DOI: https://doi.org/10.1177/1354067X12446229

Jobe, J.B. (2009). Cognitive processes in self-report in Stone et al (eds) The Science of Self-Report: Implications for Research andPractice New Jersey: Taylor & Francis

Johnstone Young, T. (2016). Questionnaires and Surveys in H. Zhu, (ed.) Research Methods in Intercultural Communication: A Practical Guide Hoboken, New Jersey: John Wiley & Sons Inc. DOI: https://doi.org/10.1002/9781119166283.ch11

Karasz, A., & Singelis, T. M. (2009). Qualitative and Mixed Methods Research in Cross-Cultural Psychology. Journal of Cross-Cultural Psychology, 40(6), 909–916. https://doi.org/10.1177/0022022109349172 DOI: https://doi.org/10.1177/0022022109349172

Lalwani, A. K., Shavitt, S., & Johnson, T. (2006). What is the relation between cultural orientation and socially desirable responding? Journal of Personality and Social Psychology, 90(1), 165–178. https://doi.org/10.1037/0022-3514.90.1.165 DOI: https://doi.org/10.1037/0022-3514.90.1.165

Lee, J. W., Jones, P. S., Mineyama, Y., & Zhang, X. E. (2002). Cultural Differences in Responses to a Likert Scale. Research in Nursing & Health, 25, 295–306. https://doi.org/10.1002/nur.10041 DOI: https://doi.org/10.1002/nur.10041

Newby, P. (2014). Research Methods for Education London: Routledge DOI: https://doi.org/10.4324/9781315758763

Matsumoto, D., & Hwang, H. C. (2013). Assessing Cross-Cultural Competence : A Review of Available Tests. Journal of Cross-Cultural Psychology, 44(6), 849–873. https://doi.org/10.1177/0022022113492891 DOI: https://doi.org/10.1177/0022022113492891

Moon, D. (2011). Critical Reflections on Culture and Critical Intercultural Communication in Nakayama, T. K., & Halualani, R. T. (eds). The Handbook of Critical Intercultural Communication. Chichester: John Wiley & Sons DOI: https://doi.org/10.1002/9781444390681.ch3

Mosakowski, E., Calic, G., & Earley, P. C. (2013). Cultures as learning laboratories: What makes some more effective than others. Academy of Management Learning and Education, 12(3), 512–526. https://doi.org/10.5465/amle.2013.0149 DOI: https://doi.org/10.5465/amle.2013.0149

Oppenheim, A.N. (1992). Questionnaire Design, Interviewing and Attitude Measurement London: Continuum

Paulhus, D. L. (1984). Two-component models of socially desirable responding. Journal of Personality and Social Psychology, 46(3), 598–609. https://doi.org/10.1037/0022-3514.46.3.598 DOI: https://doi.org/10.1037/0022-3514.46.3.598

Paulhus, D.L., & Vazire, S. (2007). The Self-Report Method. Handbook of Research Methods in Personality Psychology, 224–239. New York: The Guildford Press

Phillips, A. (2010). What’s wrong with Essentialism? Distinktion: Scandinavian Journal of Social Theory, 11(1), pp.47–60. Available at: http://www.tandfonline.com/doi/abs/10.1080/1600910X.2010.9672755. DOI: https://doi.org/10.1080/1600910X.2010.9672755

Piller, I. (2011). Intercultural Communication: A critical introduction Edinburgh: Edinburgh University Press

Rohlfer, S., & Zhang, Y. (2016). Culture studies in international business: paradigmatic shifts. European Business Review, 28(1), 39–62. https://doi.org/http://dx.doi.org/10.1108/09564230910978511 DOI: https://doi.org/10.1108/EBR-07-2015-0070

Schlagel, C., & Sarstedt, M. (2016). Assessing the measurement invariance of the four dimensional cultural intelligence scale across countries: A composite model approach. European Management Journal, 34(6), 633–649. https://doi.org/10.1016/j.emj.2016.06.002 DOI: https://doi.org/10.1016/j.emj.2016.06.002

Spector, P. (1994). Using Self-Report Questionnaires in OB Research : A Comment on the Use of a Controversial Method Journal of Organisational Behaviour 15 385-392 http://www.jstor.org/stable/248821. DOI: https://doi.org/10.1002/job.4030150503

Thomas, A. (2007). Self-report data in cross-cultural research: issues of construct validity in questionnaires for quantitative research in educational leadership. International Journal of Leadership in Education, 10(2), 211–226. https://doi.org/10.1080/13603120601097488 DOI: https://doi.org/10.1080/13603120601097488

Van Dyne, L., Ang, S., & Livermore, D. (2010). Cultural intelligence: A pathway for leading in a rapidly globalizing world. In K.M. Hannum. B. McFeeters, & L. Booysen (eds.), Leading across differences: Cases and perspectives (pp.131-138). San Francisco, CQ: Pfeiffer.

Voronov, M. & Singer, J.A. (2002). The Myth of Individualism Collectivism- A Critical Review. The Journal of Social Psychology, 2002, 142(4), 461–480., Available at: papers://13507515-a992-4cea-b488-dec1e41c1983/Paper/p7780 DOI: https://doi.org/10.1080/00224540209603912

Wang, K., Heppner, P., Wang, L., Zhu, F. (2015). Cultural intelligence trajectories in new international students: Implications for the development of cross-cultural competence. International Perspectives in Psychology: Research, Practice Consultation 4(1), 51-65. http://dx.doi.org/10.1037/ipp0000027 DOI: https://doi.org/10.1037/ipp0000027

Wood, E. D., & St. Peters, H. Y. Z. (2014). Short-term cross-cultural study tours: impact on cultural intelligence. The International Journal of Human Resource Management, 25(4), 558–570. https://doi.org/10.1080/09585192.2013.796315 DOI: https://doi.org/10.1080/09585192.2013.796315

Zhu, H. (2016). Identifying Research Paradigms in H. Zhu, (ed.) Research Methods in Intercultural Communication: A Practical Guide Hoboken, New Jersey: John Wiley & Sons Inc.

Authors

Stewart Nield
stewart.nield@xjtlu.edu.cn (Primary Contact)
Author Biography

Stewart Nield, Xi-an Jiao Tung Liverpool University

Stewart Nield is an Intercultural Communication Instructor working at Xi-an Jiao Tung Liverpool University, China. He holds a MA in Applied Linguistics and a MBA that focused on Intercultural Leadership Skills development. He is currently studying for his Doctorate at the University of Bath, UK.

Nield, S. (2019). The Mismeasure of Culture Self-Report Questionnaires and Positivist Analysis in Intercultural Communication Research. Journal of Intercultural Communication, 19(2), 1–14. https://doi.org/10.36923/jicc.v19i2.784

Article Details

Smart Citations via scite_