Sample selection in social science research: A holistic approach to methodological rigor
Abstract
The present study investigates the crucial elements of sample selection in social science research, thoroughly examining the nuances of sampling techniques, categories, and factors. The paper offers a thorough overview of the procedures involved in sampling strategies, with a particular emphasis on non-probability and probability approaches. It also discusses the critical role that sample size determination plays, taking into account variables like cost, ethics, statistical power, accuracy, and generalizability in addition to type I and type II errors. The paper also closely examines how several elements, such as research objectives, design, analytical instruments, and resource constraints, affect the choice of the ideal sample size. The topic of choosing the right data analysis software and how it affects choices about sample size is covered in detail. In the last section of the study, the ideas of power, effect size, and minimum sample size in statistical analysis are thoroughly explored, with a focus on partial least squares structural equation modelling (PLS-SEM).
Copyright (c) 2025 Mohammad Rashed Hasan Polas
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors contributing to the journal agree to publish their articles under the Creative Commons Attribution-Noncommercial 4.0 International License, allowing third parties to share their work (copy, distribute, transmit) and to adapt it, under the condition that the authors are given credit, that the work is not used for commercial purposes, and that in the event of reuse or distribution, the terms of this license are made clear.
References
Bolarinwa O. Sample size estimation for health and social science researchers: The principles and considerations for different study designs. The Nigerian Postgraduate Medical Journal. 2020; 27: 67-75. doi: 10.4103/npmj.npmj_19_20
Singh AS, Masuku MB. Sampling techniques & determination of sample size in applied statistics research: An overview. International Journal of economics, commerce and management. 2014; 2: 1-22.
Mthuli SA, Ruffin F, Singh N. ‘Define, Explain, Justify, Apply’ (DEJA): An analytic tool for guiding qualitative research sample size. International Journal of Social Research Methodology. 2021; 25(6): 809-821. doi: 10.1080/13645579.2021.1941646
Fugard AJB, Potts HWW. Supporting thinking on sample sizes for thematic analyses: a quantitative tool. International Journal of Social Research Methodology. 2015; 18(6): 669-684. doi: 10.1080/13645579.2015.1005453
Kosinski M, Matz SC, Gosling SD, et al. Facebook as a research tool for the social sciences: Opportunities, challenges, ethical considerations, and practical guidelines. American Psychologist. 2015; 70(6): 543-556. doi: 10.1037/a0039210
Sim J, Saunders B, Waterfield J, et al. Can sample size in qualitative research be determined a priori? International Journal of Social Research Methodology. 2018; 21(5): 619-634. doi: 10.1080/13645579.2018.1454643
Djimeu EW, Houndolo DG. Power calculation for causal inference in social science: Sample size and minimum detectable effect determination. Journal of Development Effectiveness. 2016; 8(4): 508-527. doi: 10.1080/19439342.2016.1244555
Young JC, Rose DC, Mumby HS, et al. A methodological guide to using and reporting on interviews in conservation science research. Methods in Ecology and Evolution. 2018; 9(1): 10-19. doi: 10.1111/2041-210x.12828
Umar HIS, Usman M. The imperative of population sampling in social science research. Global Journal of Political and Science and Administration. 2015; 3: 49-57.
Chandler J, Rosenzweig C, Moss AJ, et al. Online panels in social science research: Expanding sampling methods beyond Mechanical Turk. Behavior Research Methods. 2019; 51(5): 2022-2038. doi: 10.3758/s13428-019-01273-7
Lehdonvirta V, Oksanen A, Räsänen P, et al. Social Media, Web, and Panel Surveys: Using Non‐Probability Samples in Social and Policy Research. Policy & Internet. 2020; 13(1): 134-155. doi: 10.1002/poi3.238
Pace DS. Probability and non-probability sampling-an entry point for undergraduate researchers. International Journal of Quantitative and Qualitative Research Methods. 2021; 9: 1-15.
Bolarinwa O. Sample size estimation for health and social science researchers: The principles and considerations for different study designs. The Nigerian Postgraduate Medical Journal. 2020; 27: 67-75. doi: 10.4103/npmj.npmj_19_20
Balaji MS, Roy SK. Value co-creation with Internet of things technology in the retail industry. Journal of Marketing Management. 2016; 33(1-2): 7-31. doi: 10.1080/0267257x.2016.1217914
Rahman MM, Tabash MI, Salamzadeh A, et al. Sampling Techniques (Probability) for Quantitative Social Science Researchers: A Conceptual Guidelines with Examples. SEEU Review. 2022; 17(1): 42-51. doi: 10.2478/seeur-2022-0023
Rahman MM. Sample Size Determination for Survey Research and Non-Probability Sampling Techniques: A Review and Set of Recommendations. Journal of Entrepreneurship, Business and Economics. 2023; 11: 42-62.
Berndt AE. Sampling Methods. Journal of Human Lactation. 2020; 36(2): 224-226. doi: 10.1177/0890334420906850
Fiedler K, Kutzner F. Information sampling and reasoning biases. In: Keren G, Wu G (editors). The Wiley Blackwell Handbook of Judgment and Decision Making. John Wiley & Sons; 2015. pp. 380-403. doi: 10.1002/9781118468333.ch13
Ringle CM, Sarstedt M, Mitchell R, et al. Partial least squares structural equation modeling in HRM research. The International Journal of Human Resource Management. 2018; 31(12): 1617-1643. doi: 10.1080/09585192.2017.1416655
Hair JF, Black WC, Babin BJ, Anderson RE. Canonical correlation: A supplement to multivariate data analysis. In: Multivariate Data Analysis: A Global Perspective, 7th ed. Pearson Prentice Hall Publishing; 2010.
Hair JF, Hult GTM, Ringle CM, Sarstedt M. A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM). SAGE; 2014.
Kumar M, Talib SA, Ramayah T. Business Research Methods. Oxford University Press; 2013.
Ryan C. Refereeing articles including SEM—what should referees look for? Tourism Critiques: Practice and Theory. 2020; 1(1): 47-61. doi: 10.1108/trc-03-2020-0002
Francis JJ, Johnston M, Robertson C, et al. What is an adequate sample size? Operationalising data saturation for theory-based interview studies. Psychology & Health. 2010; 25(10): 1229-1245. doi: 10.1080/08870440903194015
Scherbaum CA, Ferreter JM. Estimating Statistical Power and Required Sample Sizes for Organizational Research Using Multilevel Modeling. Organizational Research Methods. 2008; 12(2): 347-367. doi: 10.1177/1094428107308906
Cohen J. Statistical Power Analysis for the Behavioral Sciences, 2nd ed. Lawrence Erlbaum; 1988.
Kock N, Hadaya P. Minimum sample size estimation in PLS‐SEM: The inverse square root and gamma‐exponential methods. Information Systems Journal. 2016; 28(1): 227-261. doi: 10.1111/isj.12131
