Calibrating Expert Consensus in Delphi Studies for Developing Communication Competencies

Crossmark: check for updates

Authors

  • Yogesh B.M
  • Girijesh Singh Mahra
  • Ananda K. R
  • Kishan K
  • Chinnaiah R
  • Parjanya Pavan
  • Sreenanda S. Anand
  • Pibarel Khunjanmayum

DOI:

https://doi.org/10.17140/phoj.2026.v11.i01.pp61-74.2545

Keywords:

Capacity building, communication competencies, consensus calibration, Delphi technique, higher education, Training Need Index

Abstract

Delphi studies are widely used for expert-based consensus building in education and social sciences; however, the absence of a universally accepted standard for determining consensus remains a persistent methodological challenge. Different studies employ varying statistical thresholds and decision rules, leading to inconsistencies in indicator selection and interpretation. Addressing this methodological gap, the study employed a cross-sectional, multi-phase Delphi design to develop communication competencies by applying a tailored calibrated multi-criteria Delphi framework. A panel of thirty experts participated in three iterative rounds and consensus was established with context-specific thresholds using a combination of median values, interquartile range (IQR), quartile deviation (QD), and percentage agreement. The process resulted in the identification of 11 key communication skill indicators demonstrating high consensus (QD ≤ 0.5; IQR ≤ 1) and very high importance (Median ≥ 4; ≥80% agreement). To assess practical relevance, a Training Need Index (TNI) analysis was conducted among 210 postgraduate students from three leading agricultural institutions in India. The findings revealed moderate to high training needs, particularly in interactive communication competencies such as initiating discussions, persuasive communication, and voice modulation. Grounded in Social Cognitive Theory and communication competence perspectives, the study highlights the role of structured, evidence-based framework with calibrated criteria in identifying skill gaps. The proposed calibrated consensus approach offers a transparent and replicable model for Delphi studies, with implications for strengthening communication capacity in professional education and public health-related extension systems.

References

Adler, M., & Ziglio, E. (1996). Gazing into the or-acle: The Delphi method and its application to social policy and public health. Jessica Kingsley Publishers.

Bandura, A. (1997). Self-efficacy: The exercise of control. W.H. Freeman.

Bharathi, A. V. (2016). Communication skills– core of employability skills: Issues & concerns. Higher Learning Research Communications, 6(4). https://doi.org/10.18870/hlrc.v6i4.358

Davis, K. E. (2008). Extension in Sub-Saharan Africa: Overview and assessment of past and cur-rent models.

De Vet, H. C., Terwee, C. B., Knol, D. L., & Bouter, L. M. (2006). When to use agreement versus reli-ability measures. Journal of Clinical Epidemiol-ogy, 59(10), 1033–1039. https://doi.org/10. 1016/j.jclinepi.2005.10.015

Delbecq, A. L., Van de Ven, A. H., & Gustafson, D. H. (1975). Group techniques for program planning. Scott Foresman.

Duncan, E. A., Colver, K., Dougall, N., Swingler, K., Stephenson, J., & Abhyankar, P. (2014). Consen-sus on clinical equipment requirements. BMC Emergency Medicine, 14(1), 5. https://doi. org/10.1186/1471-227X-14-5

Fitch, K., Bernstein, S. J., Aguilar, M. D., Burnand, B., & LaCalle, J. R. (2001). RAND/UCLA appropri-ateness method manual. RAND Corporation.

Franklin, E. A. (2011). Greenhouse facility man-agement competencies. Journal of Agricultural Education, 52(4), 150–161. https://doi.org/

5032/jae.2011.04150 10. Glaser, B. (1978). Theoretical sensitivity. Sociol-ogy Press.

Gordon, T. J. (2009). The Delphi method. In Fu-tures Research Methodology. American Council.

Hsu, C. C., & Sandford, B. A. (2007). The Delphi technique: Making sense of consensus. Practi-cal Assessment, Research, and Evaluation, 12(10). https://doi.org/10.7275/pdz9-th90

Hung, H. L., Altschuld, J. W., & Lee, Y. F. (2008). Delphi study issues. Evaluation and Program Planning, 31(2), 191–198. https://doi.org/ 10.1016/j.evalprogplan.2008.02.005

Kanaga, K. S. (1988). Training needs in agricul-ture. M.Sc. Thesis, KAU.

Kolb, D. A. (1984). Experiential learning. Prentice Hall.

Lang,T.(1995). An overview of four futures method-ologies.Manoa Journal of Fried and Half-Fried Ideas,7,1–43.

Leeuwis, C., & Van den Ban, A. (2004). Commu-nication for rural innovation. Blackwell Science. https://doi.org/10.1002/9780470995235

Linstone, H. A., & Turoff, M. (1975). The Delphi method. Addison-Wesley.

Ludwig, B. G. (1994). Internationalizing Exten-sion. The Ohio State University.

McCroskey, J. C. (1977). Oral communication ap-prehension. Human Communication Research, 4(1), 78–96.

McCroskey, J. C. (1984). Communication appre-hension perspective.

Mitchell, V. W. (1991). The Delphi technique. Technology Analysis & Strategic Management, 3(4), 333–358.

Moore, T., & Morton, J. (2017). Job readiness and communication. Studies in Higher Education, 42(3), 591–609.

Okoli, C., & Pawlowski, S. D. (2004). Delphi method as research tool. Information & Manage-ment, 42(1), 15–29.

Patil, S. S., & Kokate, K. D. (2011). Training need assessment. Indian Research Journal of Exten-sion Education, 11(1), 18–22.

Saaty, T. L. (2008). Analytic hierarchy process. International Journal of Services Sciences, 1(1), 83–98.

Skulmoski, G. J., Hartman, F. T., & Krahn, J. (2007). Delphi method for research. Journal of Informa-tion Technology Education, 6(1), 1–21.

Trexler, C. J., Parr, D. M., & Khanna, N. (2006). Del-phi study in agriculture. Journal of Agricultural Education, 47(4), 15–25.

Von Der Gracht, H. A. (2012). Consensus measure-ment in Delphi studies. Technological Forecast-ing and Social Change, 79(8), 1525–1536.

Warner, L. A. (2024). Delphi technique for exten-sion programs.

Yousuf, M. I. (2007). Using expert opinions through Delphi. Practical Assessment, Research, and Evaluation, 12(1).

Downloads

Published

2026-01-28 — Updated on 2026-03-26

Versions

How to Cite

Yogesh B.M, Girijesh Singh Mahra, Ananda K. R, Kishan K, Chinnaiah R, Parjanya Pavan, … Pibarel Khunjanmayum. (2026). Calibrating Expert Consensus in Delphi Studies for Developing Communication Competencies . Public Health - Open Journal, 11(1), 61–74. https://doi.org/10.17140/phoj.2026.v11.i01.pp61-74.2545 (Original work published January 28, 2026)

Issue

Vol. 11 No. 1 (2026): Volume 11 Issue 1 2026

Section

Articles

License

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

All content published in Public Health - Open Journal (PHOJ) is licensed under the Creative Commons Attribution 4.0 International License (CC BY 4.0). This license allows anyone to copy, distribute, transmit, and adapt the work — including for commercial purposes — provided appropriate credit is given to the original author(s) and source.