Full Text
<h2>Introduction</h2><p>Mixed-methods research (MMR) has become a well-established approach in the social and educational sciences, offering the potential to combine the strengths of quantitative and qualitative paradigms (Creswell & Plano Clark, 2018). Over the past two decades, the field has witnessed significant methodological evolution, with scholars proposing new designs, integration strategies, and quality criteria (Fetters & Molina-Azorin, 2017). Despite this growth, the literature remains fragmented, and there is a lack of comprehensive syntheses that capture the breadth of recent innovations. This maiden article of the <em>Global Journal of Innovations in Mixed-Methods Education</em> (GJIME) aims to fill this gap by systematically reviewing methodological innovations in MMR within educational contexts from 2015 to 2023.</p><p>The need for such a review is underscored by the increasing complexity of educational phenomena, which often require multi-faceted approaches to capture both breadth and depth (Johnson & Onwuegbuzie, 2004). Moreover, the proliferation of digital tools and the growing emphasis on participatory and transformative research have introduced novel possibilities and challenges (Mertens, 2019). However, without a clear map of these innovations, researchers may struggle to select appropriate designs and integration methods, and reviewers may lack consistent criteria for evaluating MMR studies.</p><p>This review addresses the following research questions: (1) What methodological innovations have been proposed or applied in mixed-methods educational research between 2015 and 2023? (2) How are these innovations categorized in terms of design, integration, and quality? (3) What are the emerging trends and gaps in the literature? By answering these questions, we aim to provide a comprehensive overview that can guide future research and practice.</p><h2>Methods</h2><h3>Search Strategy</h3><p>We conducted a systematic review following the PRISMA guidelines (Page et al., 2021). We searched five electronic databases: ERIC, Scopus, Web of Science, ProQuest, and Google Scholar. The search was limited to peer-reviewed journal articles and book chapters published in English between January 2015 and December 2023. The search string combined terms related to mixed-methods (e.g., "mixed-methods," "mixed methods," "multi-method") with terms related to innovation (e.g., "innovation," "novel," "advancement," "new design") and education (e.g., "education," "educational," "school," "teaching," "learning").</p><h3>Inclusion and Exclusion Criteria</h3><p>Studies were included if they: (a) focused on mixed-methods research in educational settings (from early childhood to higher education), (b) explicitly discussed methodological innovations (e.g., new designs, integration techniques, quality criteria, or tools), and (c) were published in English. We excluded studies that merely used MMR without discussing methodological innovations, as well as editorials, commentaries, and conference abstracts.</p><h3>Screening and Data Extraction</h3><p>Two reviewers independently screened titles and abstracts, followed by full-text screening. Disagreements were resolved through discussion. Data were extracted using a standardized form that captured study characteristics (e.g., author, year, country, educational level), the type of innovation, and the reported outcomes or recommendations. We also recorded the specific MMR design (e.g., convergent, explanatory sequential, exploratory sequential) and integration methods (e.g., merging, connecting, embedding).</p><h3>Data Analysis</h3><p>We employed thematic analysis (Braun & Clarke, 2006) to identify patterns and themes across the included studies. Initially, we coded the innovations descriptively, then grouped them into higher-order themes. We also conducted a narrative synthesis to summarize the findings and identify trends.</p><h2>Results</h2><h3>Study Selection</h3><p>The initial search yielded 1,204 records. After removing duplicates (n=312), we screened 892 titles and abstracts, of which 128 were selected for full-text review. Of these, 81 were excluded for not meeting inclusion criteria (e.g., no explicit discussion of innovation, not educational context). The final sample comprised 47 studies.</p><h3>Characteristics of Included Studies</h3><p>The included studies were published between 2015 and 2023, with a peak in 2020-2022. Geographically, the studies originated from North America (n=18), Europe (n=14), Asia (n=8), Australia (n=4), and other regions (n=3). The educational levels covered included K-12 (n=15), higher education (n=24), and other (e.g., vocational, adult education; n=8).</p><h3>Thematic Findings</h3><p>Our analysis identified four major themes of methodological innovation:</p><h4>1. Advanced Integration Techniques</h4><p>Many studies proposed or demonstrated advanced integration techniques beyond traditional merging and connecting. For instance, joint displays were increasingly used to visually integrate quantitative and qualitative data (Guetterman et al., 2015). Bayesian approaches were introduced to formally combine evidence from both strands (e.g., van de Schoot et al., 2021). Additionally, some scholars advocated for iterative integration throughout the research process, rather than only at the analysis stage (Fetters & Molina-Azorin, 2017).</p><h4>2. Transformative and Participatory Designs</h4><p>A significant number of studies emphasized transformative and participatory designs, particularly in contexts of social justice and community-based research. These designs prioritize the involvement of stakeholders and aim to promote equity and change (Mertens, 2019). Examples include culturally responsive MMR and designs that integrate indigenous methodologies (Chilisa, 2020).</p><h4>3. Digital and Computational Tools</h4><p>The use of digital and computational tools for data collection and analysis was a prominent theme. Innovations included the use of social media data, mobile apps for real-time data collection, and machine learning algorithms for qualitative coding (e.g., Guetterman et al., 2018). These tools offer new possibilities for handling large datasets and enhancing transparency.</p><h4>4. Novel Quality Frameworks</h4><p>Several studies proposed new quality frameworks or criteria for evaluating MMR studies. These frameworks often emphasize the importance of transparency, reflexivity, and the quality of integration (O'Cathain et al., 2008). Some scholars suggested adapting existing criteria from quantitative and qualitative traditions, while others developed MMR-specific criteria (Fabregues & Molina-Azorin, 2017).</p><h3>Trends and Gaps</h3><p>Across the studies, we observed a trend toward more explicit and systematic integration, with a growing number of studies using joint displays and iterative designs. There was also an increased focus on the use of technology, particularly in data analysis. However, we noted inconsistencies in terminology and reporting, with some studies using terms like "mixed-methods" and "multi-methods" interchangeably. Furthermore, few studies provided detailed guidance on how to implement the proposed innovations, and there was a lack of empirical evaluations of the effectiveness of these innovations.</p><h2>Discussion</h2><p>This systematic review provides a comprehensive overview of methodological innovations in mixed-methods educational research from 2015 to 2023. Our findings indicate that the field is evolving rapidly, with new integration techniques, transformative designs, digital tools, and quality frameworks emerging. These innovations reflect broader trends in social science research, including the increasing use of technology and a growing emphasis on social justice and community engagement.</p><p>One of the key contributions of this review is the identification of four innovation clusters, which can serve as a heuristic for researchers and educators. The cluster of advanced integration techniques highlights the move beyond simple merging to more sophisticated methods such as Bayesian integration and joint displays. This aligns with calls for more rigorous integration in MMR (Fetters & Molina-Azorin, 2017). The transformative and participatory designs cluster underscores the potential of MMR to address power imbalances and promote social change, as advocated by Mertens (2019). The digital and computational tools cluster reflects the increasing availability of new technologies that can enhance data collection and analysis, but also raises questions about data privacy and the role of algorithms in qualitative research (Guetterman et al., 2018). Finally, the novel quality frameworks cluster addresses the ongoing need for criteria to evaluate MMR studies, which is crucial for ensuring rigor and credibility.</p><p>Despite these advances, our review also reveals several gaps. First, there is a lack of consensus on terminology and reporting standards, which can hinder communication and replication. Second, many innovations are proposed but not empirically tested, leaving questions about their practical utility. Third, there is limited guidance on how to adapt innovations to different educational contexts, such as K-12 versus higher education. Fourth, the role of technology in MMR is underexplored, particularly in terms of ethical considerations and the potential for bias.</p><p>Based on our findings, we propose a preliminary framework for classifying methodological innovations in MMR. This framework includes four dimensions: (a) design innovation (e.g., new designs or adaptations), (b) integration innovation (e.g., new techniques for combining data), (c) tool innovation (e.g., digital tools for data collection/analysis), and (d) quality innovation (e.g., new criteria or frameworks). This framework can help researchers locate their work within the broader landscape and identify areas for further development.</p><p>Our review has several limitations. First, we limited our search to English-language publications, which may exclude relevant work in other languages. Second, we focused on educational contexts, so innovations in other fields may not be captured. Third, our search period (2015-2023) may miss earlier foundational work, although we included some seminal references. Finally, the quality of the included studies was not formally assessed, which could affect the reliability of our synthesis.</p><p>Future research should address these gaps by conducting empirical evaluations of proposed innovations, developing standardized reporting guidelines, and exploring the use of technology in MMR more deeply. Additionally, cross-cultural and cross-disciplinary comparisons could enrich our understanding of how innovations are adapted and implemented.</p><h2>Conclusion</h2><p>This maiden article of GJIME provides a systematic review of methodological innovations in mixed-methods educational research from 2015 to 2023. We identified four major clusters of innovation: advanced integration techniques, transformative and participatory designs, digital and computational tools, and novel quality frameworks. These innovations reflect the field's maturation and its responsiveness to contemporary challenges. However, inconsistencies in terminology and reporting, as well as a lack of empirical testing, remain areas for improvement. We propose a preliminary framework to classify innovations and recommend that future research focus on evaluating and refining these methods. We hope this review serves as a valuable resource for researchers, educators, and journal editors, and we invite contributions to GJIME that further advance the field of mixed-methods education.</p><h2>References</h2><p>Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. <em>Qualitative Research in Psychology, 3</em>(2), 77–101. https://doi.org/10.1191/1478088706qp063oa</p><p>Chilisa, B. (2020). <em>Indigenous research methodologies</em> (2nd ed.). SAGE Publications. https://doi.org/10.4135/9781526482103</p><p>Creswell, J. W., & Plano Clark, V. L. (2018). <em>Designing and conducting mixed methods research</em> (3rd ed.). SAGE Publications. https://doi.org/10.4135/9781473998858</p><p>Fabregues, S., & Molina-Azorin, J. F. (2017). Addressing quality in mixed methods research: A review and recommendations for a future agenda. <em>Quality & Quantity, 51</em>(6), 2847–2863. https://doi.org/10.1007/s11135-016-0449-4</p><p>Fetters, M. D., & Molina-Azorin, J. F. (2017). The Journal of Mixed Methods Research starts a new decade: The mixed methods research integration trilogy and its dimensions. <em>Journal of Mixed Methods Research, 11</em>(3), 291–307. https://doi.org/10.1177/1558689817714066</p><p>Guetterman, T. C., Fetters, M. D., & Creswell, J. W. (2015). Integrating quantitative and qualitative results in health science mixed methods research through joint displays. <em>Annals of Family Medicine, 13</em>(6), 554–561. https://doi.org/10.1370/afm.1865</p><p>Guetterman, T. C., Chang, T., DeJonckheere, M., Basu, T., Scruggs, E., & Vohra, S. (2018). Augmenting qualitative text analysis with natural language processing: A demonstration using a mixed-methods study. <em>Journal of Mixed Methods Research, 12</em>(4), 417–434. https://doi.org/10.1177/1558689817742116</p><p>Johnson, R. B., & Onwuegbuzie, A. J. (2004). Mixed methods research: A research paradigm whose time has come. <em>Educational Researcher, 33</em>(7), 14–26. https://doi.org/10.3102/0013189X033007014</p><p>Mertens, D. M. (2019). <em>Research and evaluation in education and psychology: Integrating diversity with quantitative, qualitative, and mixed methods</em> (5th ed.). SAGE Publications. https://doi.org/10.4135/9781544321004</p><p>O'Cathain, A., Murphy, E., & Nicholl, J. (2008). The quality of mixed methods studies in health services research. <em>Journal of Health Services Research & Policy, 13</em>(2), 92–98. https://doi.org/10.1258/jhsrp.2007.007074</p><p>Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., ... & Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. <em>BMJ, 372</em>, n71. https://doi.org/10.1136/bmj.n71</p><p>van de Schoot, R., Depaoli, S., King, R., Kramer, B., Märtens, K., Tadesse, M. G., ... & Yau, C. (2021). Bayesian statistics and modelling. <em>Nature Reviews Methods Primers, 1</em>, 1. https://doi.org/10.1038/s43586-020-00001-2</p><p>Fetters, M. D., Curry, L. A., & Creswell, J. W. (2013). Achieving integration in mixed methods designs—Principles and practices. <em>Health Services Research, 48</em>(6pt2), 2134–2156. https://doi.org/10.1111/1475-6773.12117</p><p>Molina-Azorin, J. F. (2016). Mixed methods research: An opportunity to improve our studies and our research skills. <em>European Journal of Management and Business Economics, 25</em>(2), 37–38. https://doi.org/10.1016/j.redeen.2016.05.001</p>