Invited Addresses and Webinars
This page provides links to online videos of my webinars, invited and keynote addresses, and key reports- the presentation materials (text).
————————————————————————————————————-
Invited address at the Georgetown University – King’s College London Symposium Series on Process Data in Large-Scale Assessment
Integrating Process Data With Explanation-Focused Validity Theory in Large-Scale Assessments
Invited address on December 12, 2025, to the Georgetown University – King’s College London Symposium Series, Series 3 theme. Validity, Theory, and Ethics of Process Data in Large-Scale Assessments. Organized by Dr. Qiwei Britt He, Georgetown University, and Dr. David Pepper, King’s College London.
Abstract: Assessment researchers have typically used process data descriptively, such as to improve prediction, refine classification, or enhance model diagnostics. In this address, I propose an explanation-focused validity framework that positions process data as evidential structures that support explanatory accounts of item responding. From this perspective, process data contribute to validity not simply by increasing model fit, reliability, or precision, but by enabling the development and testing of explanatory models that illuminate how response processes unfold and how these processes relate to the intended construct. This shift—from descriptive use to explanatory inference—centers process data in contemporary validation practice and underscores their role in strengthening the interpretive meaning of test scores.
- Click here to view the
Video of Professor Zumbo’s full-length presentation and some of the questions and answers (46 minutes).
————————————————————————————————————-
Invited presentation to the NCME 2023 conference session honouring the legacy and career contributions of Professor Ronald K. Hambleton- 2023
Zumbo, B.D. (2023, April 15). Ronald K. Hambleton’s Advances in Detecting Item Bias, Differential Item Functioning. Invited address in the featured session1In this session, held April 15, 2023, at the NCME conference in Chicago, we gathered to honor the late Professor Hambleton’s life work to continue his legacy. On behalf of NCME, session organizer and chair, Steve Sireci, invited five of Professor Hambleton’s colleagues or close collaborators, Wim van der Linden, Ric Luecht, Jose Muniz, April Zenisky, and Bruno Zumbo, to speak on topics to which Professor Hambleton made monumental contributions. His longtime colleague, H. Swaminathan, was invited as the discussant. “Remembering Ron: Reflections on a Career and a Legacy” at the Annual Meeting of the National Council for Measurement in Education (NCME), Chicago, IL.
- Click here to view the Video of the full-length presentation (29 minutes).
————————————————————————————————————-
UBC-Psychometric Webinar Series, 2023-1 to 2023-3
Zumbo, B.D. (2023). Statistical Analyses Using jamovi [Videos]. The University of British Columbia
- Zumbo, B.D. (2023). Statistical Analysis with jamovi. [Video]. UBC- Psychometric Webinar Series 2023-1. University of British Columbia, Vancouver, B.C. https://youtu.be/kwI02CRz-Ns
- Zumbo, B.D. (2023). Bivariate Analyses – Correlation and Regression Using jamovi. [Video]. UBC- Psychometric Webinar Series 2023-2. University of British Columbia, Vancouver, B.C. https://youtu.be/uR4xlNAfwlg
- Zumbo, B.D. (2023). R code in Jamovi – Bubble plot (proportional to sample size). [Video]. UBC- Psychometric Webinar Series 2023-3. University of British Columbia, Vancouver, B.C. https://youtu.be/iL_hcrtGH2Y
————————————————————————————————————-
Invited Address in Milan, Italy, 2023
Validity Theories, Frameworks, and Practices In Using Tests And Measures: An Over-The-Shoulder Look Back at Validity While Also Looking To The Horizon
Zumbo, B.D. (2023, January 19). Validity Theories, Frameworks, and Practices In Using Tests And Measures: An Over-The-Shoulder Look Back at Validity While Also Looking To The Horizon [Invited Address]. Ciclo di Formazione Metodologica (FORME), Dipartimento di Psicologia, Università Cattolica del Sacro Cuore, Milano, Italia.
For a PDF copy of the text of the presentation slides and bibliography, click here. The webinar is available on YouTube in two parts: the main webinar and the question-and-answer session.
- Webinar Part 1: VALIDITY THEORIES, FRAMEWORKS AND PRACTICES IN USING TESTS AND MEASURES An Over-The-Shoulder Look Back at Validity While Also Looking To The Horizon youtu.be/F3ifQzQwp2M
- Webinar Part 2: Question & answer: youtu.be/e-3AT5FjP_8
————————————————————————————————————-
UBC-Psychometric Webinar Series 2022
Zumbo, B.D. (2022). Item Analysis: Graphical item analysis using nonparametric curves [Videos]. The University of British Columbia & Università Cattolica del Sacro Cuore, Milan
- Zumbo, B.D. (2022). Graphical Item Analysis Using Nonparametric Curves Part 1 – Concepts Software (SPSS and Jamovi) https://youtu.be/Df3trp8TnxY
- Zumbo, B.D. (2022). Graphical Item Analysis Using Nonparametric Curves Part 2 – Short demonstration with SPSS https://youtu.be/qPsnIU2dHlc
- Zumbo, B.D. (2022). Graphical Item Analysis Using Nonparametric Curves Part 3 – More Examples Using SPSS https://youtu.be/BtkpNgkKeh4
————————————————————————————————————-
UBC-Psychometric Webinar Series 2022-1
Embracing The Many Ways Of Being Human, & Intersectionality in Assessment, Surveys, and Testing
Zumbo, B.D. (2022, March 18). Measurement Validity at the Nexus of Data Science, Digital Innovation, and a Social Justice Imperative: Embracing The Many Ways Of Being Human. Invited Address to The Research Group in Pursuit of Validity (RGPV)/Le groupe de recherche en quête de validité (GRQV). Quebec.
For a PDF copy of the presentation slides, text, and bibliography, click here. To view the YouTube video, click here.
————————————————————————————————————-
UBC-Psychometric Webinar Series 2021-4
Standard-setting methodology: Establishing performance standards and setting cut-scores to assist score interpretation
Standard-setting | Establish performance standards & set cut-scores to aid score interpretation. To view the YouTube video, click here.
Published paper on this topic: Zumbo, B.D. (2016). Standard-setting methodology: Establishing performance standards and setting cut scores to assist score interpretation. Applied Physiology, Nutrition, and Metabolism, vol. 41, (Number 6; Suppl. 2), S74-S82. [Available for download: here or journal website]
————————————————————————————————————-
Invited Plenary Address to the International Society for Quality of Life Research (ISOQOL) conference – 2021
Zumbo, B.D. (2021, October 14). On Models, Modeling, and Measurement Invariance in Validation Studies: A Stochastic View of Measurement [Invited Plenary Address]. The 28th Annual Conference of the International Society for Quality of Life Research (ISOQOL). For a PDF copy of the presentation text and bibliography, click here. To view the YouTube video, click here.
————————————————————————————————————-
Featured Invited Address to the Quantitative Methods Section of the Canadian Psychological Association – 2021
This is the Video and text of the 2021 featured invited address to the Quantitative Methods Section of the Canadian Psychological Association (CPA).
Zumbo, B.D. (2021, June 17). Equity and Fairness at the Nexus of Data Science, Psychometrics, Digital Innovation, and Social Justice [Featured Invited Address]. Quantitative Methods Section of the Canadian Psychological Association (CPA) [virtual conference]. To view the YouTube video, click here. For a PDF copy of the text of the presentation, click here.
————————————————————————————————————-
Concepts of Validity: Bridging Concepts and Practices – UBC-Paragon Webinar Series 2021-3
Much of what travels under the umbrella of validity theory and validation practices is the methodology of measurement (testing, assessment, and surveys). How should one go about doing and evaluating measurement validity? How should one go about doing and evaluating measurement, testing, and assessment?
Zumbo, B.D., & Shear, B.R. (2021, June). Concepts of Validity: Bridging Concepts and Practices [Video]. UBC-Paragon Webinar Series 2021-3. University of British Columbia, Vancouver, B.C. To view the Video, please click here For a copy of the presentation slides click here
————————————————————————————————————-
Nonparticipation (Unit Nonresponse) in Surveys Webinar
Woitschach, P., & Zumbo, B.D. (2021, March). Nonparticipation (Unit Nonresponse) In Surveys: A Practitioner’s Guide to the Conceptualization, Impact of, and Adjustment for Unit Nonresponse [webinar]. Vancouver, B.C.: British Columbia Patient-Centred Measurement. To view the videos and access the supplementary materials, please click the tab on this website or click [SURVEY NONRESPONSE]
Nonparticipation (Unit Nonresponse) In Surveys: A Practitioner’s Guide to the Conceptualization, Impact of, and Adjustment for Unit Nonresponse -- 3-Part Webinar A three-part webinar that aims to take data analysts and applied researchers with little background in statistical survey science through the conceptualization,impact of, and statistical methods for the adjustment for nonparticipation (unit nonresponse) of statistical surveys. Either see the tab [SURVEY NONRESPONSE] The webinar reports on simulations of the impact of unit nonresponse as well as a description and demonstration of adjusting for unit nonresponse using propensity score weighting- including example data, R code using Twang, and SPSS syntax using the Complex Survey module.
————————————————————————————————————-
Challenges to Ensure Fairness and Equity in Testing- UBC-Paragon Webinar Series 2021-2
Testing and assessment, on the many ways of being human
Zumbo, B.D. (2021, March). Situating Methodological Challenges to Ensure Fairness and Equity in Testing Within My View of Validity as Contextualized and Pragmatic Explanation [Video]. UBC-Paragon Webinar Series 2021-2. University of British Columbia, Vancouver, B.C. To view the Video, please click here. For a copy of the presentation slides, click here
————————————————————————————————————-
Embedding IRT in Structural Equation Models – UBC-Paragon Webinar Series 2021-1
Common research questions in assessment and validation studies that use regression are: – Which of the variables is most predictive of the criterion measure? – What variable(s) is most explanatory of our test scores?
Zumbo, B.D. (2021, February). Embedding IRT in Structural Equation Models as a Solution to Problems with Measurement Error in Predictor Variables in Validation Research [Video]. UBC-Paragon Webinar Series 2021-1. Vancouver, B.C. To view the Video, please click here. For a copy of the presentation slides, click here
————————————————————————————————————-
Impact of the Paragon UBC Initiative Webinar
Taking an ‘over the shoulder look’ back while charting the course ahead: The impact to date of the Paragon UBC Professorship on psychometric science & practice and what is on the horizon – February 12, 2021. To view the Video, please click here.
Hosted by Professor Bruno Zumbo with guests Professor Blye Frank, Dean of Education, and Professor Patsy Duff, Associate Dean, Research, in the Faculty of Education .
————————————————————————————————————-
Assembled Validity- Connections to Validity, Language Testing, and Student Evaluation of Teaching
Zumbo, B.D. (2020, November). On “Assembled Validity”: Connections to Validity, Language Testing & Student Evaluations of Teaching. Invited address hosted by the University of East Anglia, School of Education and Lifelong Learning, Norwich, UK. [Online Virtual Address]. To view the Video, please click here.
Drawing on Kane's argument-based approach to validity and Toulmin's later work on cosmopolitanism and diversity, this work asks whose validity arguments and evidence are being presented. Remarks about and broader implications of Addey, Maddox, and Zumbo's 'Assembled Validity': With connections to Validity Theory and Validation, Language Testing, and to University/College Uses of Student Evaluations of Teaching. (November 30, 2020).
————————————————————————————————————-
Looking Back, Looking Ahead: Outcomes, Impacts, and Next Steps – UBC-Paragon Partnership, 2015 – 2020
Zumbo, B.D. (2020, September). Looking Back, Looking Ahead: Outcomes, Impacts, and Next Steps – UBC-Paragon Partnership, 2015 – 2020. University of British Columbia, Vancouver, B.C. For a copy of the report, please click here. To view the Video of the presentation of this report, please click here.
I describe the Paragon UBC Professorship and its impact to date on psychometric science & practice. Tags and Topics Start time 1. Introductory Remarks/Setting the Stage 0:00 2. What is the UBC-Paragon Partnership? 1:36 3. Outcomes of the Partnership 8:52 4. Impacts of the Outcomes/Activities 21:15 5. Collaborations with Paragon Staff 22:03 6. Looking Ahead 29:29 END 31:48
————————————————————————————————————-
On Computational Psychometrics as a Validity Framework for Process Data
Zumbo, B.D. (2020, August). On Computational Psychometrics as a Validity Framework for Process Data. Presented at the Annual Meeting of the National Council for Measurement in Education (NCME), San Francisco, CA. [Online
Virtual Conference. To view the Video of the presentation, please click here. For a copy of the presentation slides ,click here
Invited remarks to an NCME session devoted to data-driven algorithms for improving the inferences made from technology-supported testing and assessment systems (August 2020)
————————————————————————————————————-
Consequences, Side Effects, and the Ecology of Testing: Keys to Considering Assessment ‘In Vivo’
Zumbo, B.D. (2015, November). Consequences, Side Effects and the Ecology of Testing: Keys to Considering Assessment ‘In Vivo’. Keynote address, the annual meeting of the Association for Educational Assessment – Europe (AEA-Europe), Glasgow, Scotland. To view the Video of the keynote address, please click here
————————————————————————————————————-
Tides, Rips, and Eerie Calm at the Confluence of Data Uses, Consequences, and Validity
Zumbo, B.D. (2015, November). Tides, Rips, and Eerie Calm at the Confluence of Data Uses, Consequences, and Validity. Plenary address, ‘The Production of Data in International Assessments’, Research Conference organized by the Laboratory of International Assessment Studies, Economic and Social Research Council (ESRC), University of East Anglia, Norwich, UK. To view the Video of the keynote address, please click here Click here for the Abstract / Summary.