Common source bias
 | This article needs additional citations for verification. (February 2023) |
Common source bias is a type of sampling bias, occurring when both dependent and independent variables are collected from the same group of people. This bias can occur in various forms of research, such as surveys, experiments, and observational studies.[1] Some scholars believe that common source bias is a significant concern for any study as it can lead to unreliable results, and therefore must be controlled.[2][3][4][5] It is most prevalent in the field of public administration research, where performance measures subject to common source bias can produce false positives when organisational performance is evaluated with explanatory and perceptual measures from the same source.[6]
Occurrence
[edit]Common source bias can be categorised into two types: common method bias, also known as common method variance, and common source bias. Common method bias occurs when the same method or instrument is used to collect data from multiple sources, which can lead to an over-representation of certain factors. Common source bias occurs when the information or data collected is influenced by a single source, such as a single individual, group, or organisation.
One of the major causes of common source bias is the influence of the source on the data collected.[7] For example, if a survey is conducted by a single individual, their own beliefs, biases, and perspectives can influence the responses of the participants. This "self reporting" is subjective, and limited because it is based on attitudes, values, and behaviours of the individual.[8][9]
Common source bias is also present in participant selection. If participants are selected based on their association with the source, then their responses may be biased towards the source’s perspective. If participants are selected based on their willingness to participate, then their responses may not be representative of the population as a whole.
Remedies
[edit]Ex ante remedies
[edit]A recently proposed ex ante remedy for common source bias is the supplementation of survey data with administrative and/or archival data, however the majority of relevant studies seem to present the view that of the proposed statistical remedies for the bias, none appear to reliably counter the issue.[10][11] This results in a lack of a comprehensive methodology for how to control method biases.[12][13]
References
[edit]- ^ Baumgartner, Hans; Weijters, Bert (2021-06-01). "Dealing with Common Method Variance in International Marketing Research". Journal of International Marketing. 29 (3): 7–22. doi:10.1177/1069031X21995871. hdl:1854/LU-8690756. ISSN 1069-031X.
- ^ Bagozzi, Richard P. (2011). "Measurement and Meaning in Information Systems and Organizational Research: Methodological and Philosophical Foundations". MIS Quarterly. 35 (2): 261–292. doi:10.2307/23044044. ISSN 0276-7783.
- ^ Burton-Jones, Andrew (2009). "Minimizing Method Bias through Programmatic Research". MIS Quarterly. 33 (3): 445–471. doi:10.2307/20650304. ISSN 0276-7783.
- ^ Podsakoff, Philip M.; Podsakoff, Nathan P.; Williams, Larry J.; Huang, Chengquan; Yang, Junhui (2024-01-22). "Common Method Bias: It's Bad, It's Complex, It's Widespread, and It's Not Easy to Fix". Annual Review of Organizational Psychology and Organizational Behavior. 11 (1): 17–61. doi:10.1146/annurev-orgpsych-110721-040030. ISSN 2327-0608.
- ^ Favero, N.; Bullock, J. B. (2015). "How (Not) to Solve the Problem: An Evaluation of Scholarly Responses to Common Source Bias". Journal of Public Administration Research and Theory. pp. 285–308. doi:10.1093/jopart/muu020. Retrieved 2023-02-07.
- ^ Andersen, Lotte Bøgh; Heinesen, Eskil; Pedersen, Lene Holm (2016). "Individual Performance: From Common Source Bias to Institutionalized Assessment". Journal of Public Administration Research and Theory. 26 (1): 63–78. ISSN 1053-1858. JSTOR 44165112.
- ^ Craighead, Christopher W.; Ketchen, David J.; Dunn, Kaitlin S.; Hult, G. Tomas M. (2011-05-05). "Addressing Common Method Variance: Guidelines for Survey Research on Information Technology, Operations, and Supply Chain Management". IEEE Transactions on Engineering Management. 58 (3): 578–588. doi:10.1109/TEM.2011.2136437. ISSN 0018-9391.
- ^ Cooper, Brian; Eva, Nathan; Zarea Fazlelahi, Forough; Newman, Alexander; Lee, Allan; Obschonka, Martin (2020-09-01). "Addressing common method variance and endogeneity in vocational behavior research: A review of the literature and suggestions for future research". Journal of Vocational Behavior. 121: 103472. doi:10.1016/j.jvb.2020.103472. hdl:10871/122102. ISSN 0001-8791.
- ^ Podsakoff, Philip M.; Organ, Dennis W. (1986-12-01). "Self-Reports in Organizational Research: Problems and Prospects". Journal of Management. 12 (4): 531–544. doi:10.1177/014920638601200408. ISSN 0149-2063.
- ^ Favero, Nathan; B. Bullock, Justin. "How (Not) to Solve the Problem: An Evaluation of Scholarly Responses to Common Source Bias".
{{cite journal}}: Cite journal requires|journal=(help) - ^ Kim, Mirae; Daniel, Jamie Levine (2020-01-02). "Common Source Bias, Key Informants, and Survey-Administrative Linked Data for Nonprofit Management Research". Public Performance & Management Review. 43 (1): 232–256. doi:10.1080/15309576.2019.1657915. ISSN 1530-9576. S2CID 203468837.
- ^ Podsakoff, Philip M.; Podsakoff, Nathan P.; Williams, Larry J.; Huang, Chengquan; Yang, Junhui (2024-01-22). "Common Method Bias: It's Bad, It's Complex, It's Widespread, and It's Not Easy to Fix". Annual Review of Organizational Psychology and Organizational Behavior. 11 (1): 17–61. doi:10.1146/annurev-orgpsych-110721-040030. ISSN 2327-0608.
- ^ Podsakoff, Philip M.; MacKenzie, Scott B.; Lee, Jeong-Yeon; Podsakoff, Nathan P. (2003). "Common method biases in behavioral research: A critical review of the literature and recommended remedies". Journal of Applied Psychology. 88 (5): 879–903. doi:10.1037/0021-9010.88.5.879. ISSN 1939-1854.