

Introduction
Scholars often refer to the geological epoch of today as the Anthropocene—the time during which humans have significantly shaped the geology and ecosystems of this planet. Regardless of the term that individuals use, the effect of humans on the planet has ignited a range of problems at the intersection between the environment and society. These problems revolve around the rise in pollution, the changes in climate, the decline in biodiversity, the pressures on food production, the surge in energy demands, and the urbanization of countries.
In recent decades, researchers began to recognize their existing tools and disciplines may not be adequate to address these multifaceted problems. In response, researchers from more than one academic discipline, such as the environment and sociology, attempted to cooperate to explore these matters. Initially, each field of researchers would independently apply the ideologies, theories, methodologies, and tools they had learned over many years, even decades, but then convene to share the information and findings they had uncovered. This approach, in which each field of research largely worked in parallel, but shared their perspectives and insights, is sometimes called multidisciplinary research.
These researchers, as they proceeded, recognized their approach was not adequate to explore many key questions. Therefore, rather than work in parallel, researchers from distinct fields began to blend their methods and knowledge, sometimes interdisciplinary research. Occasionally, these combinations would even generate novel academic disciplines, such as climate change. Alternatively, these combinations would merely shift the boundaries of existing disciplines.
Yet, even interdisciplinary researchers experienced impediments to their pursuits. They sometimes felt their existing disciplines or combinations of disciplines were not comprehensive enough to solve the intractable matters they were exploring. They sometimes felt divorced from the experiences, perspectives, and insights of the communities, organizations, and societies they were attempting to assist. And they sometimes felt disempowered to apply the results they uncovered to benefit their society.
Transdisciplinary research partly originated from these concerns. That is, transdisciplinary research combines several movements in which researchers attempt to develop theories and knowledge that transcends the boundaries of disciplines—not only existing disciplines but all possible disciplines. In addition to multidisciplinary and interdisciplinary research, proponents of transdisciplinary research typically invite people from outside academia not only to be participants but to be active members of the research team. These people, sometimes called non-academic actors, contribute to decisions around the research question, design, methods, analysis, interpretation, and communication. This approach not only extends the knowledge and insight of the research team but also facilitates attempts to apply the findings in practice (but see Pohl, 2008).
Case study
One study, conducted by Stauffacher et al. (2008), illustrates some features of transdisciplinary research, with the caveat that transdisciplinary research is not a unified approach. Indeed, proponents of transdisciplinary research often propose conflicting definitions, methodologies, and priorities.
Stauffacher et al. (2008) conducted this research in Appenzell Ausserrhoden, a canton of Switzerland, comprising 20 communities and about 50 000 residents. The communities that are located considerable distances from large cities and national highways are experiencing a range of interrelated problems. Residents are shifting to larger cities, diminishing labor opportunities and compromising wealth. To attract wealth, the region must utilize the landscape—to maintain agriculture and tourism—but without damaging this landscape for future generations.
To address and to explore these matters, a team of researchers embraced a transdisciplinary approach. That is, they felt the need to develop and to consider tools and perspectives that may transcend the limitations of their academic disciplines, with the assistance of individuals outside the boundaries of academia—such as industry leaders, regional planners, political advisors, and so forth. They wanted to conduct research with society rather than merely research for society. They hoped this pursuit would not only uncover novel perspectives and solutions but also extend the repertoire of skills and capabilities to conduct research across the communities, utilizing the dormant intellectual potential of society.
Scholars have not developed a unified transdisciplinary approach, although many researchers divide this research into three main phases—roughly comprising attempts to clarify the problem and resources, to implement methods that uncover novel insights, and to integrate and utilize these insights. This case study divided these three main phases into six steps, primarily adapted from Scholz and Tietje (2002).
First, the researchers collaborated with stakeholders to uncover a guiding question that would underpin all subsequent phases. After significant consultation, the question revolved around how the ecological quality of landscape in this canton can be preserved and improved while the value of this landscape is increased. In particular, the researchers and president of the canton initially agreed to a case study. Next, a steering workgroup—comprising four researchers and a variety of stakeholders such as a farmer, mayor, historian, regional planner, and tourism administrator—participated in informal workshops and facilitated discussions to define the problem and guiding question. Interviews with other key stakeholders also guided this approach.
Second, the steering workgroup then explored which perspectives to examine. Specifically, this workgroup first established an advisory board from the region, comprising senior representatives, such as a CEO of industrial companies, a bank manager, a community mayor, and a farmer. The steering workgroup and advisory board participated in more facilitated workshops to consider which perspectives should be explored in this research. The researchers also complemented these workshops with a thorough literature review, partly to ascertain which disciplines might benefit this project. This step also uncovered the key themes to prioritize: nature, tourism, and rural settlement
Third, the steering workgroup conducted a system analysis, applying a range of both established methods and informal methods. In particular, the steering workgroup conducted focus groups and interviews with a broader segment of the population, called a reference group, including teachers, medical practitioners, architects, foresters, and pastors to explore their perspectives around the main priorities of nature, tourism, and rural settlement. The steering workgroup also analyzed historical documents about the region, media excerpts, and well as relevant data, stored at the national statistical office. The researchers applied a range of tools, such as impact matrixes, system grids, Mic-Mac-Analysis, and system graphs, to organize and to interpret the data. The key themes and insights that emerged from these analyses were then presented to the reference group to generate more feedback.
Fourth, the steering workgroup conducted a formative scenario analysis to distill inspiring scenarios or circumstances that could arise in the future. To generate these scenarios, reference groups participated in facilitated discussion that were designed to spark creativity around future changes that might unfold. In addition, the researchers combined various levels of the impact factors—the events or changes that might influence key outcomes—to extend these future possibilities. Finally, the steering workgroup presented a range of possible future scenarios to the reference group. The workgroup utilized maps, collages, photos, and other methods to help the individuals visualize these scenarios. The reference group then contributed to discussions about which scenarios should be evaluated in the subsequent steps.
Fifth, the steering workgroup conducted multi-criteria analysis to evaluate the scenarios. In particular, the general public received surveys and specialists participated in interviews to evaluate these scenarios. Individuals indicated their attitudes to the scenario holistically and then judged the scenarios on a set of specific criteria. These data informed conclusions around which scenarios are most beneficial around nature, tourism, and rural settlement
Finally, the steering workgroup and advisory group developed a report that encapsulated a shared understanding of the results and a plan on how to proceed in the future. The results were also published in many formats. As this example demonstrates, the researchers tended to commence this project informally, then applied some more established methods, and ended more informally again.
The scenarios and insights that emanated from this research were translated into practice. Some individuals, for example, opened a holiday village that applies some of the principles that emanated from the scenarios. To illustrate, the buildings were composed of word derived from the surrounding forests. The construction utilized principles that minimize energy consumption. The villages is heated using wood chips that were extracted from the forests as well.
How to conduct transdisciplinary research
Researchers have not developed a standard model that stipulates how to conduct transdisciplinary research. Instead, scholars have proposed a range of approaches (Bergmann et al., 2005; Jahn et al., 2012; Scholz et al., 2006). According to Lawrence et al. (2022), most if not all these approaches comprise three distinct but overlapping phases.
During the first phase, the researchers establish a team of interested members, including representatives of all stakeholders, and explores the problem they want to address and the question that will guide this research. The problem will correspond to a practical, tangible concern and not only a conceptual, theoretical interest (Wickson et al., 2006).
During the second phase, the team design, and then apply, methods to collect data, to analyze or explore these data, to interpret or synthesize these data, and to generate novel, helpful, and robust conclusions or knowledge. Typically, as Wickson et al (2006) underscores, researchers need to explore methods and methodologies that are not specific to a particular discipline. Certainly, researchers may integrate methods, techniques, principles, values, and epistemologies, from existing disciplines to generate a unified, but evolving, approach or methodology. All the researchers share this unified approach, despite the possibility that each person might be more familiar or attuned to a specific discipline. Furthermore, the non-academic actors contribute to these decisions, shaping the problems, goals, methods, and criteria used to conduct and to evaluate the project
During the third phase, the team integrate these conclusions or knowledge to generate transdisciplinary perspectives and then seeks opportunities to publish, communicate, and apply the insights they gained.
How researchers complete these phases varies considerably. This variation enables flexibility and creativity but can also confuse and overwhelm novice researchers. To help research teams reach decisions about how to proceed, Bergmann et al. (2005) developed an extensive set of criteria that individuals can apply to evaluate transdisciplinary research. These criteria may help researchers design transdisciplinary research projects as well. For example, to formulate the project, researchers could answer questions like
-
Does the project team comprise specialists in academic disciplines and competencies that could address the key facets of this problem or object of study?
-
Does the project address a problem that is relevant to the everyday life of a community?
-
Has this problem been translated to a scientific question—a question that has not been resolved adequately in the literature so far?
-
Has the project team formulated criteria they can apply and assess to evaluate the success of this project?
-
Has the project team distinguished the scientific goals from the practical goals?
-
Is the project team willing to uncover any result—as opposite to seeking a particular finding?
Bergmann et al. (2005) then present criteria researchers could follow to complete other phases, such as establishing the committees and teams, assigning responsibilities, financing the project, planning the project, designing the methods, and so forth
How to conduct transdisciplinary research: Insight discovery
Scholars have uncovered a range of other methods and competencies that enhance transdisciplinary research. For example, Pearce et al. (2022) discuss a method called insight discovery. To illustrate, during their life, researchers develop a mental model—a set of beliefs and attitudes—about the problem or setting they plan to study.
Next, researchers are exposed to information that deviates from this mental model, evoking a sense of dissonance or unease. Perhaps, when exploring climate change or some other problem, a stakeholder might express an opinion that shatters their expectations. Or they might uncover some data, perhaps in a report, that diverged from their assumptions about this topic. Rather than dismiss this information, however, transdisciplinary researchers should develop the capacity to contemplate and explore this tension. The researchers may contemplate how they can adapt their mental model to accommodate this information or may explore a solution that resolves this contradiction.
Third, the researcher experiences a state, called a liminal or transition space, in which they recognize their mental model and beliefs are limited and commit to embrace unchartered territory. They realize they are willing to evaluate, to update, and even to discard, their beliefs and assumptions about the problem. They become more receptive to the perspectives and advice of other stakeholders of the project.
Fourth, the researcher then shifts their mental model, experiencing a moment of relief and a feeling of achievement. Once they experience this insight, they cannot revert to their original, obsolete mental model. Although this sequence of thoughts may be intuitive, researchers who are attuned to this sequence of events may be able to integrate and to assimilate diverse perspectives, theories, and methods—the cornerstone of transdisciplinary research
How to conduct transdisciplinary research: Digital research infrastructures
Scholars have begun to converse about how digital infrastructure and other resources might facilitate transdisciplinary research. Opitz et al. (2021), for example, outline a platform, called dataARC, that facilitates transdisciplinary projects. In particular, the platform stores relevant datasets about a problem and links datasets from distinct academic disciplines The data are carefully organized and reconfigured to be comprehendible to individuals who are not specialists in the field—facilitating transdisciplinary work.
Benefits of transdisciplinary research: Application of research to practice
One of the pressing objectives of many universities and research institutions today is to generate insights that enhance society. That is, in recent decades, institutions have become increasingly motivated to enhance the impact of their research. As studies reveals, only some, rather than all, variants of transdisciplinary research are especially suited to this objective (Pohl, 2008).
Specifically, Pohl (2008) conducted interviews of researchers who had contributed to diverse transdisciplinary research projects. As Pohl observed, in some transdisciplinary projects, the researchers initially apply their disciplinary theories and methods to explore the topic. Next, they reconfigure, rearrange, and integrate this disciplinary knowledge to accommodate the perceived goals of the community and other stakeholders. These researchers, therefore, tend to assume, perhaps unconsciously, that academics are tasked with the role to reconfigure, rearrange, and integrate knowledge. They feel their role is to inform other stakeholders—and conceptualize these stakeholders more as individuals to refine academic perspectives rather than to produce knowledge together.
In many instances, the knowledge that emanates from this transdisciplinary research is not applied in practice. That is, the knowledge did not always resonate with the culture and interests of the audience.
In contrast, when researchers participate in attempts to co-produce knowledge as a collective endeavor, these problems dissipated. These researchers appreciate the four policy cultures that Elzinga (1996) distinguishes: the bureaucratic or administrative, the academic or scientific, the economic or commercial, and the civic or societal. These policy cultures tend to compete with each other to attract resources and power, seeking to direct scientific pursuits and technological advances in directions that overlap with their interests. The academics feel their role is partly help the four policy cultures collaborate and co-produce knowledge. This goal, according to Pohl (2008), facilitates the application of research into policy.
Benefits of transdisciplinary research: Diversity of knowledges
Transdisciplinary research is designed to uncover helpful knowledge and insights on how to solve an ongoing, multifaceted, significant, and unbounded problem with no definitive solutions—sometimes called wicked problems. After a transdisciplinary project is completed, the researchers may uncover diverse variants of knowledge. They might discover how distinct bodies, such as various organizations or individuals, interact and affect one another. They might clarify the goals and objectives that various stakeholders prioritize, the conflicts between these goals and objectives, and plans to achieve these goals and resolve the conflicts. The knowledge that academic and non-academic researchers uncover can be divided into three distinct kinds: (Brandt et al., 2013): orientation knowledge, system knowledge, and transformation knowledge.
Specifically, especially during the initial phases of transdisciplinary research, the researchers clarify the key goals and objectives of various stakeholders, called orientation knowledge. They identify the priorities and perspectives that shape the decisions and behaviors of relevant stakeholders. As the research progressed, the researchers unearth key observations and theories or accounts to explain these observations, called systems knowledge. Finally, during the project, the researchers consider how they use this systems knowledge to fulfill the goals and objectives of this project—practical insights that are called transformation knowledge. All of these insights enhance the capacity of these researchers to conduct transdisciplinary research more effectively in the future, sometimes called process knowledge. In practice, orientation knowledge, system knowledge, and transformation knowledge—as well as process knowledge—are acquired during all phases of the research project.
Benefits of transdisciplinary research: Motivations
Many researchers perceive transdisciplinary research as rewarding and challenging. To illustrate, as Katoh et al. (2022) demonstrated, when researchers embrace curiosity and challenge, they are more likely to gravitate to transdisciplinary research and to collaborate with industry—especially if they tend to be extraverted and agreeable in personality. Researchers are more likely to experience a sense of vitality, and not as susceptible to burnout, when they experience this sense of curiosity and challenge at work.
Challenges of transdisciplinary research: Overview
When individuals conduct transdisciplinary research, they experience a range of challenges. Indeed, some researchers have proposed taxonomies to classify these challenges (e.g., Lang et al., 2012). For example, Brandt et al. (2013) distinguished five clusters of challenges:
-
transdisciplinary research is not underpinned by a coherent or unified definition, understanding, or framework
-
the relationships between methods, phases, and categories of knowledge has not been clarified
-
researchers can seldom, in practice, apply the optimal practices that are advocated in the literature
-
transdisciplinary researchers do not often empower practitioners and stakeholders to the extent that best practice recommends, such as granting these individuals the authorities to decide about procedures
-
the social and academic impact of transdisciplinary research is hard to evaluate
Lawrence et al. (2022) divided these challenges into three main constellations: biases, evaluation, and collaboration with stakeholders.
Challenges of transdisciplinary research: Biases
All research is susceptible to some of the biases, preferences, and experiences of researchers. Even when researchers want to study the effect of some scenario or intervention on some outcome, and strive to utilize techniques that scientists advocate, their choices may bias the conclusions. That is, may choose to explore only scenarios and outcomes that are likely to coincide with their preferences or preconceptions. Despite this bias, some of the features of scientific methods—ranging from randomized control trials, statistical analyses, and peer review—tend to limit the impact of these biases on the findings and conclusions they generate.
The methods, results, interpretations, and conclusions that correspond to transdisciplinary research, however, are more susceptible to these biases. Indeed, in most instances, the research is specifically designed to explore and to integrate the priorities and concerns of stakeholders. The stakeholders influence which problems to explore, which methods to apply, which results to prioritize, and which practical implications to pursue. Therefore, relative to many other research endeavors, the methods and outcomes of transdisciplinary research are even more dependent on the experiences and needs of individuals.
Furthermore, as Lawrence et al. (2022) underscores, some of the norms of communities may amplify these biases. For example, some communities, because of prejudices or motivations to maintain political power, might assume the perspective of some stakeholders is more valuable than is the perspective of other stakeholders. The norms of society, therefore, may diverge from the norms that evolved to generate trustworthy and sustainable insights. To address these concerns, Lawrence et al. recommend that
-
researchers need to include a range of stakeholders, often called actors, in all phases of transdisciplinary research; they should help identify the problem or guiding questions, design and apply methods to collate insights, and then evaluate and apply these insights.
-
all the individuals who contribute, and not only the academics, should be granted opportunities to contemplate and discuss their assumptions and desires about this project. The interests of each actor should be as explicit as possible. Some researchers even apply established methods to clarify the motivations of each person to pursue this research and attitudes towards this research (see Guimarães et al, 2019; Lotfian et al., 2020)
-
the leaders of this project should instill the norm to pursue transformations that benefit the community in the future. This emphasis on the future diminishes the impact of more immediate needs on decisions and, instead, elicits the desire to benefit the community (cf Augsburg, 2014)
Yet, transdisciplinary researchers should recognize their goal is not to generate consensus about some objective findings. Instead, their results will generally be perceived as contested—and this ongoing debate is central to sustainable transformations.
Challenges of transdisciplinary research: Evaluation
Evaluation is a key feature of transdisciplinary research. The researchers need to assess whether the quality of methods that were utilized, the accuracy of findings or outcomes, and the impact of this project on society. These evaluations help researchers improve their knowledge about how to conduct transdisciplinary research more effectively in the future. These evaluations also increase the accountability of researchers, motivating these individuals to conduct research that is rigorous, insightful, and useful.
However, scholars have not developed consensus on how to evaluate transdisciplinary research. Indeed, the circumstances and priorities of each project are unique. Therefore, whether researcher can develop one evaluation framework that is suitable to all projects is ambitious.
Yet, because scholars have not developed consensus on how to evaluate transdisciplinary research, the utility of this research is hard to justify to funding bodies. Because the utility of transdisciplinary research can be uncertain and because the projects are likely to evolve dramatically over time, funding bodies are either reluctant to fund these projects at all or willing to fund the project for only limited timeframes. As a consequence of this uncertain or limited funding, researchers may not be able to attract other stakeholders or actors to the project. Fortunately, in recent years, at least in some nations, more funding has been directed to transdisciplinary research (see Gillis et al., 2017).
The diverse priorities of academics and other actors can also complicate the evaluation of these projects. Academics might value rigorous methods and significant results—values that overlap with scholarly publishers. Other stakeholders might value hope, change, clarity, and other goals
Scholars have recommended a vast array of methods and approaches to evaluate transdisciplinary research (Carew & Wickson, 2010; Walter et al., 2007; Williams & Robinson, 2020). To illustrate Lawrence et al. (2022) and Williams and Robinson (2020) advocated a series of practices that can improve evaluations (for a review of principles to guide evaluation, see Klein, 2008). For example
-
researchers should assess whether the perspectives of diverse actors were utilized and how this diversity was measured
-
for example, researchers should assess the degree to which perspectives of both academics and other actors were utilized—and how barriers to this integration, such as disparities in access to information, access to resources, and expertise in methods, were addressed
-
researchers should assess the quality and suitability of methodologies, tools, and other techniques to collect and to analyze data
-
researchers should gauge the degree to which contributors reflect on their assumptions and discussed these assumptions with one another
-
researchers should assess the effects of this project—that is, the changes in the knowledge and behavior of other stakeholders
-
researchers should assess the knowledge that everyone acquired, during the research, about how to conduct transdisciplinary research more effectively—and evaluate the degree to which this ongoing learning was applied during the project
-
researchers should identify more enduring impacts of this project—changes in governance or-technical systems that are more likely to persist
Challenges of transdisciplinary research: Collaboration with non-academic actors
Like other variants of participatory research, the central involvement of actors and stakeholders who are not trained academics can generate a range of complications. One complication is the role of these non-academic actors might be underestimated. According to Lawrence et al. (2022), some academics believe that discussions with other stakeholders, sitting around a shared table, may be sufficient to unearth novel, valuable, and robust insights and plans. But this perception deviates from the assumption that such actors should be able to influence all decisions about the project, from the clarification of problems to the implementation of insights.
A second complication is that non-academic actors might misuse the knowledge and credibility they gain from their participation in this project. Because of their association with academics, their recommendations to the community may be perceived as legitimate, even when their perspective might actually be biased towards their own interests. They might distill evidence from the project that is not representative of the overarching findings to promote their business, personal, or political agendas.
A third complication revolves around the distinct standards that academics and non-academic actors may observe. Some academics may be inclined to discount methods that are suggested by other stakeholders. Conversely, some non-academic actors might be inclined to discredit valuable scientific knowledge and methods, partly because of concealed motivations, social pressure, or other interests. To resolve these complications
-
Researchers need to utilize established methods, such as suitable committees, world cafes, appreciative inquiry, and other techniques, to empower non-academic actors. For example, they could establish a steering committee and working groups that are represented by both academics and non-academic actors equally—and integrate the insights of this diversity of stakeholders to create these working groups. They could also define the responsibilities of each member of the steering committee explicitly and consensually, and so forth
-
Researchers should also learn how to communicate scientific information, such as equations, parameters, and models—as explicitly, simply, and transparently as they can
-
Researchers should inspire all contributors to contemplate both their assumptions as well as the ideologies that elicit feelings of discomfort or tension. Individuals should be encouraged to recognize and withstand some of their defensive responses to information or perspectives that deviate from their interests or preconceptions.
Challenges of transdisciplinary research: Integration of disciplines
Central to the transdisciplinary mindset is the attempt to integrate the epistemologies, theories, and practices of diverse academic disciplines. This integration of epistemologies—in the beliefs on how to establish trust—is especially ambitious. Over time, however, transdisciplinary researchers have shifted from the attempt to unify all epistemologies to the pursuit of opportunities to uncover commonalities that enabled a shared understanding (Wickson et al., 2006).
To help integrate epistemologies, theories, and practices, Wickson et al. (2006) recommends that researchers embed themselves in the problem. As researchers immerse themselves in the issue, they naturally integrate theoretical knowledges and lay perceptions to develop a more comprehensive perspective.
Challenges of transdisciplinary research: Metrics
One concern that researchers have expressed about transdisciplinary research—as well as multidisciplinary and interdisciplinary projects—revolves around the metrics that leaders apply to evaluate universities. To illustrate, transdisciplinary research is often dynamic, in which the problem and design evolves inexorably and frequently. Researchers, therefore, are often unable to secure the funding they need to conduct this research. Consequently, if universities prioritized transdisciplinary research, research income would diminish. The institution would thus decline on university ranking schemes that prioritize research income—such as the Times Higher Education World University Rankings. This drop in the rankings might deter students, decrease revenue, and ignite a sequence of other complications.
Admittedly, one ranking scheme, UMR, does consider interdisciplinary—and presumably transdisciplinary—work. Therefore, transdisciplinary research might improve rankings in one ranking scheme. But none of the other major ranking schemes reward interdisciplinary and transdisciplinary research. Consequently, in general, transdisciplinary research might, inadvertently, diminish the prestige of universities.
Challenges of transdisciplinary research: Overlooked literature
Proponents of transdisciplinary research strive to uncover relevant theories and methods from any discipline or approach that could be relevant to their project. Yet, because of this breadth of theories and methods, researchers may overlook relevant literature. That is, they might enter search terms that differ from the keywords that are common in a specific field.
Trujillo and Long (2018) recommend that a technique, called document co-citation analysis, might address this concern. In essence, document co-citation analysis is a technique that identifies sets of documents that are cited by the same individuals.
This technique generates several benefits. First, when applied proficiently, researchers can utilize this analysis to uncover a community of scholars who cite the same publications and, therefore, share their interests. These scholars might thus be willing to collaborate effectively on a transdisciplinary project. Second, these researchers can then uncover the publications these scholars have cited. These publications are likely to be relevant to their shared interests but might otherwise have been overlooked.
References
-
Augsburg, T. (2014). Becoming transdisciplinary: The emergence of the transdisciplinary individual. World Futures, 70(3-4), 233-247.
-
Bartomeus, I., & Dicks, L. V. (2019). The need for coordinated transdisciplinary research infrastructures for pollinator conservation and crop pollination resilience. Environmental Research
-
Bergmann, M., Brohmann, B., Hoffmann, E., Loibl, M. C., Rehaag, R., Schramm, E., & Voß, J. P. (2005). Quality criteria of transdisciplinary research. A guide for the formative evaluation of research projects. ISOE-Studientexte, 13.
-
Brandt, P., Ernst, A., Gralla, F., Luederitz, C., Lang, D. J., Newig, J., ... & Von Wehrden, H. (2013). A review of transdisciplinary research in sustainability science. Ecological economics, 92, 1-15.
-
Carew, A. L., & Wickson, F. (2010). The TD wheel: a heuristic to shape, support and evaluate transdisciplinary research. Futures, 42(10), 1146-1155.
-
Elzinga, A. (1996). Shaping worldwide consensus: the orchestration of global climate change research. Internationalism and Science, Cambridge, Taylor Graham Publishing, 223-253.
-
Gillis, D., Nelson, J., Driscoll, B., Hodgins, K., Fraser, E., & Jacobs, S. (2017). Interdisciplinary and transdisciplinary research and education in Canada: A review and suggested framework. Collected Essays on Learning and Teaching, 10, 203-222.
-
Guimarães, M. H., Pohl, C., Bina, O., & Varanda, M. (2019). Who is doing inter-and transdisciplinary research, and why? An empirical study of motivations, attitudes, skills, and behaviours. Futures, 112
-
Jahn, T., Bergmann, M., & Keil, F. (2012). Transdisciplinarity: Between mainstreaming and marginalization. Ecological economics, 79, 1-10.
-
Katoh, S., Aalbers, R., & Sengoku, S. (2021). Effects and interactions of researcher’s motivation and personality in promoting interdisciplinary and transdisciplinary research. Sustainability, 13(22), 12502.
-
Klein, J. T. (2008). Evaluation of interdisciplinary and transdisciplinary research: a literature review. American journal of preventive medicine, 35(2), S116-S123.
-
Lang, D. J., Wiek, A., Bergmann, M., Stauffacher, M., Martens, P., Moll, P., ... & Thomas, C. J. (2012). Transdisciplinary research in sustainability science: practice, principles, and challenges. Sustainability science, 7(1), 25-43.
-
Lawrence, M. G., Williams, S., Nanz, P., & Renn, O. (2022). Characteristics, potentials, and challenges of transdisciplinary research. One Earth, 5(1), 44-61.
-
Lotfian, M., Ingensand, J., & Brovelli, M. A. (2020). A framework for classifying participant motivation that considers the typology of citizen science projects. ISPRS International Journal of Geo-Information, 9(12), 704.
-
Opitz, R., Strawhacker, C., Buckland, P., Cothren, J., Dawson, T., Dugmore, A., ... & Thompson, P. (2021). A Lockpick's guide to dataARC: Designing infrastructures and building communities to enable transdisciplinary research. Internet Archaeology, 56.
-
Pearce, B. J., Deutsch, L., Fry, P., Marafatto, F. F., & Lieu, J. (2022). Going beyond the AHA! moment: insight discovery for transdisciplinary research and learning. Humanities and Social Sciences Communications, 9(1), 1-10.
-
Pohl, C. (2008). From science to policy through transdisciplinary research. Environmental Science & Policy, 11(1), 46-53.
-
Scholz, R. W., Lang, D. J., Wiek, A., Walter, A. I., & Stauffacher, M. (2006). Transdisciplinary case studies as a means of sustainability learning: Historical framework and theory. International Journal of Sustainability in Higher Education.
-
Scholz, R. W., & Tietje, O. (2002). Embedded case study methods Integrating quantitative and qualitative knowledge. Thousand Oaks
-
Stauffacher, M., Flüeler, T., Krütli, P., & Scholz, R. W. (2008). Analytic and dynamic approach to collaboration: a transdisciplinary case study on sustainable landscape development in a Swiss prealpine region. Systemic Practice and Action Research, 21(6), 409-422.
-
Trujillo, C. M., & Long, T. M. (2018). Document co-citation analysis to enhance transdisciplinary research. Science advances, 4(1).
-
Vienni Baptista, B., & Vilsmaier, U. (2022). Models of transdisciplinary knowledge production at universities: A Romanian case study. Higher Education Research & Development, 41(5), 1757-1772.
-
Walter, A. I., Helgenberger, S., Wiek, A., & Scholz, R. W. (2007). Measuring societal effects of transdisciplinary research projects: design and application of an evaluation method. Evaluation and program planning, 30(4), 325-338.
-
Wickson, F., Carew, A. L., & Russell, A. W. (2006). Transdisciplinary research: characteristics, quandaries and quality. Futures, 38(9), 1046-1059.
-
Williams, S., & Robinson, J. (2020). Measuring sustainability: An evaluation framework for sustainability transition experiments. Environmental Science & Policy, 103, 58-66.

Introduction
In recent decades, many funding agencies have increased the priority they attach to interdisciplinary research—research that integrates distinct academic disciplines. For example, National Science Foundation introduced the Integrative Graduate Education Research and Training Program or IGERT to fund graduate researchers who conduct interdisciplinary research. Since 1998, this body has funded over 250 grants. Accordingly, many studies have explored practices that improve the supervision of these interdisciplinary projects (Vanstone et al., 2013).
The challenges of interdisciplinary supervision: Institutional support
Candidates who want to pursue interdisciplinary research cannot always identify academics who are willing and able to supervise. That is, they may discover that few academics who are specialists in one of these disciplines are also willing to embrace the other discipline or disciplines.
But even academics who would like to supervise these interdisciplinary projects—and have developed the requisite skills—may discover the institution does not support this endeavor. To illustrate, these academics might discover the candidates they would like to supervise are enrolled or attached to another school or department within the university. These schools or departments often compete to attract scarce resources. Therefore, academics may be discouraged to supervise candidates who are enrolled in other schools or departments. This supervision, for example, may not be recognized in their workload (see Sá, 2008).
The challenges of interdisciplinary supervision: Limited familiarity with the experience of interdisciplinary graduate researchers
Even academics who would like to supervise interdisciplinary research—and perceive themselves as helpful and empathetic—might overlook the challenges that interdisciplinary graduate researchers experience. For example, graduate researchers, such as PhD candidates, who conduct interdisciplinary research often experience distinct challenges:
-
they often feel their work is not entirely relevant to any specific research team, such as a lab group, and thus may experience a sense of isolation (Boden et al., 2011; Golde & Gallagher, 1999); similarly, as Parchoma and Keefer (2012) revealed, applying constructivist grounded theory, these candidates often feel the interests of their supervisors do not overlap closely with their own goals and passions
-
they feel that none of their supervisors genuinely feel responsible to support their progress and careers—because no one person has developed the expertise in the gamut of their interests (Phillips & Pugh, 2005)
-
they often feel they need to complete more work than do their peers, because they need to learn two disciplines (e.g., Blackmore & Nesbitt, 2008), often provoking an anxiety about their progress
-
they recognize they need to co-construct the approach with their supervisors, yet feel they are not granted a position of power to shape this conversation (Martin, 2011)
Accordingly, supervisors have often not experienced the range of challenges their candidates may endure. This limitation in their experience may impede their capacity to helps these candidates manage these challenges effectively.
To illustrate, in some instances, when graduate researchers conduct interdisciplinary research, they feel compelled to separate the disciplines into separate chapters. Supervisors may read only the chapters that correspond to their discipline. The problem is the candidate may not have integrated the insights that emanate from each discipline effectively. The work does not reap the benefits of interdisciplinary work. Instead, as Lyall and Meagher (2012) suggest, at least one supervisor should be willing and able to read every chapter proficiently.
The challenges of interdisciplinary supervision: Quality criteria
To evaluate a thesis, examiners need to assess the degree to which the research fulfills a set of criteria. Typically, the university will stipulate the criteria—although national associations or accreditation bodies often shape or even impose these criteria. To illustrate, around 2009, several national associations proposed that doctoral thesis should
-
substantially contribute to knowledge
-
be designed well and argue coherently
-
engage critically with the literature of appropriate depth and breadth
-
present evidence of critical reflection
-
grasp theoretical perspectives and methodology
-
demonstrate mastery of the topic
-
be presented effectively
Although these criteria might seem uncontroversial, Mitchell and Willetts (2009) revealed how this wording might not be suited to interdisciplinary research. That is, some of these criteria do not apply to interdisciplinary research, yet these criteria do not encompass many of the key features of suitable interdisciplinary work. For example
-
although the arguments should be coherent, students should also demonstrate they are attuned to the paradoxes and contradictions in their conclusions
-
rather than merely engage with the literature, students should be able to explore, evaluate, and integrate multiple strands of literature
-
rather than engage only with the scholarly literature, students should explore the perspectives of stakeholders and other artefacts
-
students should be able to align the epistemology, theory, methodology, and conclusions—a goal the existing criteria overlook
-
students may not be able to master the topics entirely, because the literature on multiple disciplines is too extensive; instead, they should perhaps master an approach or influence an audience about a relevant topic
-
the criteria overlook the need to adapt the language and communication to accommodate multiple disciplines and audiences
As these considerations reveal, the criteria that examiners apply to evaluate theses may not be applicable to interdisciplinary research. These criteria might not recognize some exemplary attributes of an interdisciplinary thesis.
Effective practices: Help graduate researchers justify their work to examiners
Many graduate researchers who undertake interdisciplinary research experience problems during the examination of their thesis. That is, they may not be able to identify examiners who have developed the requisite expertise to evaluate the research—expertise in one or more of the disciplines as well as the expertise to appreciate interdisciplinary research. That is, because the research is interdisciplinary, candidates may need to have deviated, at least to some extent, from the norms and principles that epitomize a discipline. The examiners may express concerns about these deviations. Supervisors, therefore, must help graduate researchers prevent or accommodate these concerns.
To achieve this goal, Golding (2010) proposed four tools that graduate researchers, conducting interdisciplinary research, should apply to clarify and to justify this interdisciplinary approach to examiners. Supervisors should encourage their candidates to apply these tools.
First, according to Golding (2010), the graduate researchers must articulate explicitly how their approach overlaps with each discipline but also how their approach diverges from each discipline. To achieve this goal, graduate researchers should construct a graph in which one axis represents the degree to which a discipline is pure or applied and the other axis represents the degree to which a discipline is objective versus subjective. Graduate researchers can then represent their approach as well as the separate disciplines they will apply on this graph.
Second, graduate researchers should list all the features of each discipline they will apply to their research—features such as concepts, theories, methods, assumptions, epistemologies, and criteria of quality. This list enables graduate researchers to identify potential conflicts between the disciplines and how they might resolve these conflicts. This tool helps manage the expectations of examiners.
Third, according to Golding (2010), graduate researchers can stipulate the kind or variant of interdisciplinary research they adopted. Golding (2010), for example, distinguishes seven levels of interdisciplinarity:
-
uni-disciplinary research
-
multi-disciplinary research. Although more than one discipline is applied—such as theories from health and visual arts—these disciplines are not integrated. For example, one chapter might be oriented around one discipline and another chapter might be oriented around another discipline
-
cross-disciplinary research. One discipline is applied to evaluate or to contemplate another discipline; however, none of the methods of this second discipline are applied
-
disciplinary borrowing. The research is situated in one discipline, but the researcher also applied methods, insights, or conclusions that emanated from another discipline
-
cooperative interdisciplinary research. The researchers utilize distinct disciplines to complete different sub-tasks of one activity.
-
integrative interdisciplinary research. The researchers utilize distinct disciplines to complete one sub-task. For example, researchers might apply ecology, sociology, architecture, and engineering to determine the best location for a bridge
-
transdisciplinary research. The researchers apply methods and utilize theories that do not belong to a specific discipline.
Finally, graduate researchers may construct a statement in which they summarize or outline their interdisciplinary position. For example, the researchers might write a few paragraphs that
-
specify the problem they want to resolve
-
why an interdisciplinary approach may be helpful to solve this problem
-
which features or facets of each discipline will be employed and will not be employed
-
the level of interdisciplinarity—such as cooperative interdisciplinary research versus transdisciplinary research
-
how the potential outcome and approach differs from the possible expectations of researchers in one field
Rather than complete these activities, supervisors might instead attempt to choose examiners who have accrued significant experience and knowledge in interdisciplinary research. One complication, however, is the ratio of doctoral students to academic staff is higher in interdisciplinary research than mono-disciplinary research. Therefore, interdisciplinary academics may be inundated with requests to evaluate a thesis—as Lyall and Meagher (2012) reported.
Effective practices: Skill development of graduate researchers
Besides enabling graduate researchers, conducting interdisciplinary research, to address specific problems, supervisors may also need to help these individuals develop the skills they need to thrive in interdisciplinary research. Spelt et al. (2009) enumerated some of the skills that facilitate interdisciplinary study in general. According to Spelt et al., students need to
-
obviously acquire at least adequate knowledge about each discipline
-
appreciate the paradigms or philosophies that underpin each discipline—such as the epistemology or philosophy on how to decide which arguments are true or useful
-
understand interdisciplinarity—such as the various approaches that researchers have applied to integrate or apply multiple disciplines. Supervisors should even organize, or encourage graduate researchers to join, interdisciplinary discussions—such as seminar series, journal clubs, or social events that span disciplines (see Duke & Denicolo, 2017). Supervisors could also show students how to harness differences between the disciplines and establish defensible research boundaries (Bammer, 2008)
-
demonstrate advanced cognitive and meta-cognitive skills—such as the capacity to search, choose, understand, evaluate, and assimilate the theories and methods of each discipline as well as decide which discipline or knowledge to apply in particular circumstances
-
communicate effectively, using the right language to accommodate diverse audiences. For example, Lyall and Meagher (2012) recommend that graduate researchers, conducting interdisciplinary research, receive training in facilitation, stakeholder engagement, and mediation.
Effective practices: A publication strategy
Most graduate researchers publish in outlets that are most relevant to their field. In contrast, if these individuals conduct interdisciplinary research, they may need to consider a more versatile approach. To demonstrate their capacity to publish in esteemed journals, they may need to pursue the respected outlets in one of their disciplines. Yet, to convey their message to relevant stakeholders, they may need to consider other outlets: outlets embrace interdisciplinary and practical research.
Accordingly, supervisors might need to help these graduate researchers design a publication strategy, as Lyall and Meagher (2012) recommends. Together with the supervisor, graduate researchers may need to consider diverse works—such as a methodological, theoretical, interdisciplinary, and policy articles.
Supervisors might need to defer these publications until after the graduate researcher submits the thesis. When the research is interdisciplinary or transdisciplinary, the graduate researcher may not feel confident about their direction or arguments until they have integrated diverse strands of research. This confidence and clarity, therefore, may not emerge until they have reached the end of their exploration. Because the workload of these candidates is often extensive anyway, supervisors may, in some instances, need to advise these graduate researchers to resist the temptation to publish their work prematurely.
Effective practices: Explicitly discuss underlying assumptions
Some of the underlying assumptions of researchers vary considerably across fields of research and academic disciplines. To illustrate, these researchers might differ on
-
epistemology—such as whether the aim of research is to collect objective evidence to uncover the truth or whether the aim of research is to appreciate the perspectives of individuals
-
how to choose a research question—such as whether research questions should emanate from shortfalls in the literature and thus follow a comprehensive literature review or should emanate from personal experience
-
whether they prioritize theory development over community support
Rather than disregard these differences, scholars recommend that supervisors should instead discuss their perspectives on these matters—especially perspectives they may not have considered explicitly before. The candidate, under the guidance of these supervisors, should gradually choose and explicate the principles or framework they would like to adopt. Occasionally, to prevent the possibility that some disputes between supervisors might confuse or concern the candidates, these supervisors might, occasionally, meet without the student or before the student arrives (cf Lyall & Meagher, 2012). Without this sequence of phases, supervisors might subtly attempt to impose their disciplinary perspectives onto the project (Nisselle & Duncan, 2008; Taylor et al., 2005).
Effective practices: Implement the principles of exemplary interdisciplinary research
Unsurprisingly, many scholars argue that supervisors of interdisciplinary research should indeed be attuned to the practices that optimize interdisciplinary research. Yet, in practice, these supervisors are often unfamiliar with these practices. They do not dedicate significant time to understand the approaches, principles, and frameworks that help researchers and doctoral candidates undertake interdisciplinary research effectively.
Even simple frameworks could be helpful. To illustrate, according to Brown et al. (2019), to thrive in interdisciplinary research, the research team should
-
develop a shared mission that stipulates an inspiring problem that all researchers want to resolve or a goal they collectively want to achieve—as well as the key role of each discipline
-
comprise T-shaped researchers—researchers who acquire extensive knowledge and expertise in their confined discipline but learn to appreciate the priorities, theories, approaches, and key discoveries of other academic disciplines
-
arrange opportunities that encourage the researchers to discuss alternative scientific approaches and perspectives in a trusting, respectful, and empathic environment
-
seek institutional support to encourage value interdisciplinary research—such as seed funding that is directed to interdisciplinary projects; otherwise, institutions often introduce policies that inadvertently disadvantage interdisciplinary research, such as reliance on publication in the top journals to secure promotions
-
actively extend and maintain networks with other researchers, policy makers, and industry partners—and inspire these individuals to adopt interdisciplinary research outputs.
Effective practices: Foster an interdisciplinary culture
Rather than merely assist one candidate, supervisors might need to cultivate a culture that promotes interdisciplinary mindsets. In their case study of the Vienna Doctoral Programme on Water Resource Systems, Carr et al. (2018) delineated a series of practices that foster an interdisciplinary culture in a research institute, center, or program. For example, these workgroups should
-
co-opt someone who can facilitate connections between researchers in diverse fields (Siedlok et al., 2015).
-
arrange shared offices, comprising graduate researchers from distinct academic disciplines
-
organize symposia, seminar series, and other events that are specifically designed to impart knowledge about multiple academic disciplines
-
graduate researchers and supervisors are assigned to clusters that revolve around one problem—but a problem that spans multiple disciplines.
References
-
Bammer, G. (2008). Enhancing research collaborations: Three key management challenges. Research Policy, 37(5), 875-887.
-
Bauer, H. H. (1990). Barriers against interdisciplinarity: Implications for studies of science, technology, and society (STS). Science, Technology & Human Values, 15(1), 105–119.
-
Blackmore, K., & Nesbitt, K. (2008). Identifying risks for cross-disciplinary higher degree research students. Proceedings of the Tenth Conference on Australasian Computing Education, 78, 43–52.
-
Boden, D., Borrego, M., & Newswander, L. K. (2011). Student socialization in interdisciplinary doctoral education. Higher Education, 62(6), 741-755.
-
Boix-Mansilla, V. (2005). Productive shifts: Faculty growth through collaborative assessment of student interdisciplinary work. Journal of Learning Communities Research, 3(3), 21-26.
-
Boix-Mansilla, V., & Duraising, E. D. (2007). Targeted assessment of students’ interdisciplinary work: An empirically grounded framework proposed. The Journal of Higher Education, 78(2), 215–237.
-
Brown, R., Werbeloff, L., Raven, R., Dynamics of Innovation Systems, & Innovation Studies. (2019). Interdisciplinary Research and Impact. Global Challenges, 3(4)
-
Carr, G., Loucks, D. P., & Blöschl, G. (2018). Gaining insight into interdisciplinary research and education programmes: A framework for evaluation. Research Policy, 47(1), 35-48.
-
Coryn, C. L. S., Stufflebeam, D. L., Davidson, E. J., & Scriven, M. (2010). The interdisciplinary Ph.D. in evaluation: Reflections on its development and first seven years. Journal of Multidisciplinary Evaluation, 6(13), 118–129.
-
Duke, D. C., & Denicolo, P. M. (2017). What supervisors and universities can do to enhance doctoral student experience (and how they can help themselves). FEMS microbiology letters, 364(9).
-
Eley, A. & Jennings, R. (2007). Effective postgraduate supervision. Maidenhead, UK: McGraw-Hill International.
-
Golde, C. M., & Gallagher, H. A. (1999). The challenges of conducting interdisciplinary research in traditional doctoral programs. Ecosystems, 2(4), 281–285.
-
Golding, C. (2010). Positioning interdisciplinary graduate research (or how to avoid painful misunderstandings with your supervisors and examiners). Traffic (Parkville), 12(1), 17–37.
-
Lattuca, L. (2003). Creating interdisciplinarity: Grounded definitions from college and university faculty. Histoy of Intellectual Culture, 3(1), 1–20.
-
Lyall, C., & Meagher, L. R. (2012). A masterclass in interdisciplinarity: Research into practice in training the next generation of interdisciplinary researchers. Futures, 44(6), 608–617.
-
Manathunga, C., Lant, P., & Mellick, G. (2006). Imagining an interdisciplinary doctoral pedagogy. Teaching in Higher Education, 11(3), 365–379
-
Martin, D. (2011). Reflecting about interdisciplinary post-graduation education. Saude E Sociedade, 20(1), 57–65.
-
McVicar, A., Caan, W., Hillier, D., Munn-Giddings, C., Ramon, S., & Winter, R. (2006).
-
A shared experience: An interdisciplinary professional doctorate in health and social care.
-
Innovations in Education and Teaching International, 43(3), 211–222.
-
Mitchell C., & Willetts J., (2009). Quality criteria for inter- and trans‐disciplinary doctoral research outcomes. Prepared for ALTC Fellowship: Zen and the Art of Transdisciplinary
-
Postgraduate Studies. Sydney: Institute for Sustainable Futures, University of Technology.
-
Nisselle, A., & Duncan, R. (2008). Multiple supervisors from multiple disciplines: Lessons from the past as multidisciplinary supervision becomes the way of the future. Traffic, 10(1), 143.
-
Parchoma, G., & Keefer, J. (2012). Contested disciplinarity in international doctoral supervision. In Hodgson, V., Jones, C., de Laat, M., et al (Eds), Proceedings of the 8th International Conference on Networked Learning. 498–505.
-
Phillips, E., & Pugh, D. S. (2005). How to get a PhD: A handbook for students and their supervisors (4th ed.). New York: Open University Press.
-
Sá, C. M. (2008). Strategic faculty hiring in two public research universities: Pursuing interdisciplinary connections. Tertiary Education and Management, 14(4), 285–301.
-
Siedlok, F., Hibbert, P., & Sillince, J. (2015). From practice to collaborative community in interdisciplinary research contexts. Research Policy, 44(1), 96-107.
-
Skarakis-Doyle, E., & Doyle, P. C. (2008). The ICF as a framework for interdisciplinary doctoral education in rehabilitation: Implications for speech-language pathology. International Journal of Speech-Language Pathology, 10(1–2), 83–91.
-
Spelt, E., Biemans, H., Tobi, H., Luning, P., & Mulder, M. (2009). Teaching and learning in interdisciplinary higher education: A systematic review. Educational Psychology Review, 21(4), 365-378
-
Taylor, S., Beasley, N., & Ebrary, I. (2005). A handbook for doctoral supervisors. New York: Routledge
-
Vanstone, M., Hibbert, K., Kinsella, E. A., McKenzie, P. J., Pitman, A., & Lorelei, L. (2013). Interdisciplinary doctoral research supervision: A scoping review. Canadian Journal of Higher Education (1975), 43(2), 42–67.

Introduction
Many scholars, competitors, and associations argue that graduate researchers—such as PhD candidates—are vital to the economic stability and success of nations. That is, graduate researchers are central to the exchange of knowledge between universities and other sectors of the economy (Auriol et al., 2010; Mangematin & Robin, 2003; Slaughter et al., 2002). These collaborations tend to be more frequent in engineering, sciences, technology, agriculture, and health but does also extend to arts, social sciences, and humanities as well (e.g., Santos et al., 2021).
Industries can utilize several avenues or capabilities to contribute to graduate research. Santos et al. (2021), for example, differentiated several avenues
-
industry partners might permit the candidate to be located at the company and conduct the research at their premises
-
industry partners might fund the project, such as offer a stipend, increase an existing stipend, or pay some or all the expenses
-
industry partners might enable the candidate to utilize physical resources, such as equipment, digital resources, such as data, or human resources, such as the assistance of a technician
-
industry partners might share the results of this research with relevant stakeholders and, therefore, contribute to the impact of this work
-
industry partners might co-design the doctoral program and, for example, contribute to the training and development of graduate researchers
Determinants of collaboration between industry and graduate researchers: Overview
Many studies have explored the practices and circumstances that facilitate the success of collaborations between industry and graduate researchers. Salimi et al. (2016) conducted one of the most comprehensive analyses of this relationship. To measure the success of collaborations, the researchers considered several indicators, such as the degree to which the partner has since applied or commercialized the knowledge that emanated from the PhD, whether the collaboration generated a patent, whether a collaboration between the university and industry partner continued, and whether the industry partner later offered the candidate a job.
This research uncovered several practices and circumstances that predicted the likelihood the partner has since applied or commercialized the knowledge that emanated from the PhD. For example, the partner was more likely to apply or commercialized the knowledge that emanated from the PhD if
-
the partner had contributed significantly to the research question and design
-
the university supervisor was especially enthusiastic about the topic
-
the supervision panel had not changed during the PhD project
-
the university and industry supervisor met frequently and communicated effectively
-
the PhD candidates was a former employee of the partner
Other practices and circumstances predicted the likelihood of patents. That is, these projects were more likely to generate patents if
-
the partner had funded the research and restricted the publication of data
-
the university supervisor was especially enthusiastic about the topic
-
the university and industry partner were located in the same city
Similarly, a range of practices and circumstances predicted the likelihood the university would continue to collaborate with the industry partner. Specifically, these collaborations were more likely to persist if
-
the university supervisors were especially knowledgeable about the project—a characteristic that, however, diminished the likelihood the industry partner would apply the findings, secure a patent, or employ the PhD candidate later
-
the university and industry supervisor met frequently
-
the PhD candidates was a former employee of the partner
Finally, the PhD candidate was more likely to receive a job offer from the industry partner if
-
the university supervisor was especially enthusiastic about the topic
-
the industry supervisor frequently met the PhD candidate
Determinants of collaboration between industry and graduate researchers: Characteristics of the company
The structure and facilities of companies also affect the likelihood they will collaborate with graduate researchers. To illustrate, as Santos et al. (2021) revealed, organizations that have established R&D departments—especially departments that comprise five or more staff—are particularly receptive to graduate researchers. These R&D departments tend to value the exposure to advanced research and skilled researchers that such opportunities afford (Borrell-Damian, 2009).
Benefits of industry collaborations with graduate researchers: Career trajectories
In some circumstances, graduate researchers cannot readily secure an ongoing position, either in academia or in other sectors, after they graduate. For example, some laboratories prefer graduates with particular skills, such as engineering, over PhD graduates. They feel that PhD graduates are confined to research activities and therefore may not be flexible enough (e.g., Beltramo et al., 2001). Consequently, initiatives that counter this concern, such as industry engagement, may be crucial.
In some disciplines, collaboration with industry enhances the career prospects of graduate researchers in the private sector but not necessarily in academia. For example, Mangematin (2000) explored whether industry collaborations, during the PhD, affected the career prospects of engineering graduate researchers. In this study, industry collaborations included circumstances in which an industry partner pays the salary, expenses, or both of the PhD candidate as well as other arrangements as well. If these engineering PhD candidates collaborated with industry during the PhD, they were more likely to secure a permanent job with industry after graduation. In contrast, other characteristics of their PhD, such as number of publications did not affect the likelihood of these jobs with industry.
This finding implies that companies value the industry experience of research candidates, at least in some disciplines. An alternative explanation is that industry collaborations might, in some instances, diminish the number of articles these students publish. As Mangematin (2000) showed, if students publish few if any articles, they are not as likely to secure an academic role—and may thus pursue industry roles instead.
Benefits of industry collaborations with graduate researchers: Future collaborations and exchanges of knowledge
Ultimately, institutions encourage industry collaborations with graduate researchers not only to benefit these candidates but also tend to strength relationships with industry. Santos et al. (2021) conducted a study that explores how graduate students facilitate these collaborations. This study explored a dataset that characterizes industry collaborations with graduate researchers in Portugal. They discovered that graduate researchers facilitate these collaborations because they
-
transfer knowledge between universities and companies—such as knowledge about research methods, research discoveries, and industry needs
-
generate findings and discoveries that both the university and industry partner can use more effectively if they continue to collaborate
-
help staff at universities and companies develop relationships and networks with one another
-
develop a channel in which industry can fund university research
Thus, graduate researchers assume many roles that facilitate these collaborations. Santos et al. (2021) conducted a series of multiple regression analyses to ascertain the characteristics of universities and programs that predict the likelihood that graduate researchers will fulfill this diversity of roles. They discovered that graduate researchers are more likely to fulfill these diverse roles if
-
the university was relatively small
-
the dean, director, or coordinator of this doctoral program is experienced in working with industry.
Challenges of industry collaborations with graduate researchers
Despite the apparent and diverse benefits of these industry collaborations with graduate researchers, scholars have acknowledged many challenges that all parties need to monitor and address. Salminen-Karlsson and Wallgren (2008), for example, recognized that graduate researchers are often conceptualized as a boundary or object that connects universities and industry. The complication emanates from the conflicting objectives, values, and timelines of universities and industry—a tension that can impinge on the experience of graduate researchers.
One common challenge revolves around workload. Many PhD candidates and other graduate researchers feel inundated with demands and responsibilities. Industry collaborations, however, can sometimes exacerbate these demands. That is, these graduate researchers must fulfill the academic expectations of universities as well as the commercial demands of industries, amplifying their workload (Salminen-Karlsson & Wallgren, 2008). Not only does this conflict potentially increase the number of tasks that graduate researchers need to complete. But this conflict may also consume time. The graduate researcher, for example, may need to attend extensive negotiations between the academic supervisor and industry partner.
A related challenge revolves around the support that academic supervisors provide. Many academic supervisors perceive the funding that industries offer primarily as opportunities to enhance the progress and development of graduate candidates. Their inclination, therefore, is to support the candidate extensively when problems and conflicts transpired. In contrast, some academic supervisors perceive the funding that industry offers as opportunities to extend their own careers—perhaps by supervising more candidates or securing more research contracts. Doctoral candidates tend to feel these supervisors are unsupportive, frequently overlooking the conflicts and concerns these collaborations may elicit. They perceive these supervisors as occupied by negotiations with industry partners and other responsibilities (Salminen-Karlsson & Wallgren, 2008)
The practice of industry collaborations with graduate researchers
Some researchers have attempted to delineate the sequence of practices that universities, supervisors, industry partners, and students apply to complete these projects. Although these practices vary considerably across fields of research, industry sectors, nations, and so forth, researchers have uncovered some common, but certainly not universal or necessary, practices.
For example, some researchers have described how these industry collaborations with graduate researchers are initiated (e.g., Salminen-Karlsson & Wallgren, 2008; Schild & Hanberger, 2000). This research has shown that, in many circumstances, the academic supervisor, or the research team in which this supervisor operated, had already developed some relationship between the industry partner. The supervisor and industry partner may have broadly discussed projects on which they might collaborate in the future. The supervisor might then deliberately seek graduate researchers who might be able to contribute to these projects. Or, after they develop a relationship with graduate researchers, the supervisor might then adjust these potential collaborations to accommodate the goals and skills of these candidates.
Next, the university and industry partner tend to formulate a contract or agreement. Often, the university commence with a template, and the industry partner adapts this template to accommodate the needs of this organization. The contract will stipulate the roles of each supervisor. For example, the academic supervisor is obliged to confirm the project is compatible with the academic qualification, whereas the industry supervisor then confirms the project is compatible with the interests of this company (Salminen-Karlsson & Wallgren, 2008). Although all parties contribute to the project, many of the most successful projects initially emanate from the capabilities and ideas of the academic supervisor (Ryan et al., 2001).
Industry partners vary in the extent to which they facilitate the development of graduate researchers. Some industry supervisors merely suggest minor amendments to the design, methods, or reports, primarily to align the project with the company priorities. Other industry supervisors, however, socialize the graduate researcher into the company. The graduate researcher may attend training with other employees or engage in other company events.
The determinants of collaboration between industry and universities in general
Many barriers may impede the collaboration between industry and universities in general, potentially impeding the participation of graduate researchers in industry. Tootell et al. (2020) conducted a study to explore some of these barriers as well as the practices that facilitate collaboration between industry and universities. Specifically, these authors utilized insights from the relationship marketing literature to explore how industries and universities develop trusting and cooperative relationships. This collaboration is vital: The cooperation of industry and university in Australia generates an income of 10 billion dollars AUD. The benefit of this cooperation to the Australian economy approaches 20 billion dollars AUD each year (Gardner & Robinson, 2019, cited in Tootell et al., 2020).
In this study, the researchers interviewed 36 participants who had contributed to successful collaborations between industry and university. The questions revolved around the motivation of these individuals to establish these relationships as well as how the relationships evolved over time
The findings revealed that many differences between industry and universities impeded the capacity of these organizations to develop trust. For example
-
universities tend to prioritize reputation, whereas industry tends to prioritize financial profit
-
university staff often do not respond to emails or telephone calls as rapidly as they would like; industry partners tend to respond more swiftly to clients and thus expect more rapid responses
-
the jargon of universities and industries may compromise a sense of familiarity with one another, impeding trust
-
sometimes, university or industry staff feel the need to impress the other party and thus may speak too formally, compromising affiliation and trust; academics are often perceived as conceited, for example.
When university and industry staff perceive themselves as different to one another, trust dissipates: That is, individuals have evolved to feel distrust towards unfamiliar people. This distrust may compromise the inclination of individuals to share information. When individuals feel the other party is withholding information, their distrust of this party amplifies. They also become more reluctant to share knowledge, generating an inexorable cycle of mistrust.
Some practices can overcome these barriers. To illustrate
-
conversations in person, rather than videoconference, phone, or email, are especially helpful before the relationship has solidified—because subtle cues may facilitate understanding
-
an attempt to unearth a shared goal—a goal that enhances the reputation of university academics, the profit of companies, and the individual values of relevant members—can foster trust
-
academics that appreciate the imperatives, priorities, and strategies of industry partners and can negotiate effectively are more likely to unearth these shared goals
-
similarly, when the parties are genuinely interested in the success of one another and the community, they are more likely to commit to one another, promoting trust
-
to illustrate, when the parties share a meal and visit the workplaces of one another, this mutual understanding, commitment, and trust also develops
This study, although not specific to graduate research, is relevant to collaborations between industry and doctoral candidates. Therefore, doctoral candidates and their supervisors should be attuned to these barriers to collaboration and the practices that circumvent these barriers.
Case studies: The UNSW-CSIRO Industry PhD program
To facilitate collaborations between industry partners and graduate researchers in Australia, the University of New South Wales in Australia and CSIRO—the Commonwealth Scientific and Industrial Research Organization—developed an Industry PhD program. The program is completed in about four years and includes an internship of 6 months at an agreed industry partner as well as a stipend of over $41000, over $10 000 more than a typical PhD scholarship in this nation.
Specifically, during this course, PhD candidates attend and complete a development program that is designed to enhance their capacity to collaborate with industry. For example, they learn skills around design thinking, innovation, and leadership. The candidates dedicate about 4 days a year to this development program. In addition, PhD candidates participate in an orientation or launch at CSIRO, lasting two days, called LaunchCamp
The internship lasts six months, although not always contiguously, and is separate from the PhD project—although some of the data they might collect during this internship can be included in the thesis. The internships are located at the premises of this industry partner. During the internship, the candidates may, for example
-
manage a specific research project or contribute to an ongoing research project
-
develop a set of procedures that emanate from this research or similar research
-
deliver public workshops that emanate from this research or similar research
Case studies: Graduate Research Industry Partnership at Monash University
The Graduate Research Industry Partnership at Monash University in Australia was also designed to facilitate industry collaborations with graduate researchers. In essence, this program is designed to identify multidisciplinary clusters of graduate researchers—usually about 15 to 20 PhD candidates—to work on a common topic. For example, one cohort might conduct research that revolves around one societal challenge, such as sustainability in Asia. Alternatively, one cohort might conduct research that revolves around industry, such as plastics. To illustrate, in the past, these cohorts conducted research projects that revolve around
-
behavior change, such as how to encourage behaviors that improve the environment and conserve energy
-
food and dairy, such as benefits of the FODMAP diet or efficient food processing
-
sustainable public transport, such as road safety and traffic flow
-
healthcare that is guided by digital technology
Case study: National Industry PhD Program
In 2022, the Australian Government announced a National Industry PhD Program, worth $296 million Australian, that enables 1300 candidates, over 10 years, to complete an industry PhD. Each year, between 65 and 150 PhD applicants are granted the opportunity to participate in this program. The industry PhD program comprises several features:
-
the research project is co-designed with an industry partner and will generate outcomes that benefit this partner or the industry more broadly
-
the PhD candidate is embedded with the industry partner at least 20% of the time and with the university at least 20% of their time
-
at least one academic and one industry partner supervise the project
The program comprises two streams. The first stream, called the Industry Linked PhD stream, is designed to encourage all PhD applicants to consider a collaboration with industry. Individuals can first participate in this project within their first year or as soon as they commence. These applicants, unlike most of their peers, would receive
-
a higher stipend than peers, usually about $46 000 rather than about $30 000
-
training on how to collaborate with industry—such as how engage with industry, government, and community effectively and generate outcomes that benefit industry—lasting 12 weeks
To fund this higher stipend, over three to four years, full-time candidates each year receive
-
about $30 000 from the scheme that supports most PhD stipends in Australia, called RTP
-
an additional $6 210 from the government to support this scheme, indexed over time
-
at least $10 000 from an industry partner as well as some funds to support a portion of the research costs
The second stream is more innovative. This stream is designed to encourage Australian citizens who already work, as an employee rather than contractor, at a business or organization to complete a PhD, while retaining their existing salary. The business and organization must have arranged an Australian Business Number or Australian Company Number, registered with the tax office, and conduct research and development. In particular, these individuals receive, each year
-
$41 400 a year from the government, lasting up to four years, indexed over time
-
the rest of their salary from their employer
For each PhD candidate, regardless of the scheme, the government will also pay the university $10,350 a year. This payment, although purportedly designed to support administration costs, motivate universities to encourage individuals to pursue this scheme.
PhD candidates are eligible whether they are domestic or international. The scholarship is exempt from tax, but only if the candidate is full time rather than part time. In addition, candidates must have
-
been awarded an RTP scholarship or approved to receive this stipend
-
not have completed a PhD before
In practice, the universities submit the applications, in which one application corresponds to one project. Multiple universities, multiple industry partners, and multiple PhD candidates may contribute to each project. However, the selection committee may prefer applications that support only one PhD candidate. Universities can submit applications even before they select the PhD candidates. The service provider, Campus Plus, engaged by the Australian Government, can facilitate these relationships between universities and industry partners.
Only a subset of applications are funded. An advisory committee assesses several criteria to rank applications. Specifically, 50% of the ranking depends on the engagement between University and Industry Partner, such as
-
past engagement between the university and industry partner
-
potential to develop and to maintain ongoing collaboration between the university and industry partner
-
level of benefit to both the university and industry partner
In addition, 30% of the ranking depends on research feasibility and strategic alignment, such as
-
the extent to which the design, duration, resources, and supervisory support is viable
-
the degree to which the industry partner supplies resources, including staff time, to support the project, as well as cash contributions or additional support of stipends
-
the degree to which the project is compatible with the strategies priorities of the Australian Government—such as the National Reconstruction Fund and regional matters
-
the likelihood the project will attract domestic candidates
Furthermore, 10% of the ranking depends on project impact, such as
-
relevance of the project to research translation and commercialization—especially translation and commercialization that benefits the industry partner
Finally, 10% of the ranking depends on the capacity, capability, and resources to support the development of these candidates, such as
-
professional development around research translation, commercialization, and innovative industry experience
-
suitable access to facilities, infrastructure, and other support
-
opportunities that might culminate in future employment after the program ends
Once awarded, the university, industry partner, and student must agree to a collaborative agreement. The service provider will supply a template that encompasses IP, confidentiality, funding amounts, embedment arrangements, leave, and thesis publication
Case study: The industry PhD in the UK
The Industry PhD surfaced in the UK around 2010. Yang and Jeffrey (2021) trace the history of this degree. Although the doctoral degree can be traced to the twelfth century, first conferred by the University of Paris, the modern version of a PhD originated in the 1800s, initially in Germany. However, the first PhD awarded in the UK, at Oxford University, was in 1920.
Several decades later, however, many individuals expressed concerns about the utility of this PhD. Graduates had not necessarily developed the workplace and communication skills that are necessary to thrive outside the research sphere. To accommodate this concern, many professions have embraced professional doctorates—a degree that combines research with some coursework or placement in a specific discipline, such as education, business, engineering, and health. How the various facets of the course are arranged varies considerably across institutions. Nevertheless, although these courses might include placements or internships, students do not necessarily collaborate with industry on their research.
The industrial doctorate, in contrast, does revolve around a research collaboration between the candidate and an industry partner. That is, the candidate actually conducts research on an issue or problem that is significant to an industry partner.
Yang and Jeffrey (2021) presented a detailed case study of one Industrial PhD—a Doctor of Engineering in the UK. The case study revolved around a Center for Doctoral Training—a scheme that was initiated in 2009 by the Engineering and Physical Sciences Research Council. To illustrate this scheme, in 2018, the research council funded 75 centers, distributed across 49 UK universities, supporting over 4600 doctoral candidates. In each of these centers, doctoral candidates, in the fields of engineering and science, conduct research on problems that are relevant to the problems and challenges of industries today. The scheme is designed to improve collaboration between universities and industry as well as enhance the capacity of doctoral candidates to work in industry. Yang and Jeffrey (2021) analyzed one of these centers, funded from 2009 until 2022.
The center that Yang and Jeffrey (2021) explored received over 3.5 million pounds to train 70 Doctor of Engineering candidates. The center collaborated with over 43 partners, including companies and research organizations across the globe.
To be eligible, like most doctoral programs, applicants need to have attained the equivalent of an upper second-class Honors degree or better. However, in this industry PhD, the research proposal of applicants must overlap with the projects of interest to the center. In addition, the industry partner that is interested in the project is granted an opportunity to interview shortlisted candidates.
To attain the degree, the candidates must complete relevant modules, equivalent to about 25% of the workload, as well as submit an integrated portfolio of research projects, all conducted in the industry, equivalent to the standard of a PhD. The modules comprise a range of topics that are relevant to industry, such as commercialization of research, professional conduct, presentation skills, teamwork, public engagement, and industrial case studies. Some of the optional modules enable candidates to develop the relevant technical skills and industrial knowledge. Furthermore, the industry partners themselves may organize some additional training.
A range of individuals assist and support each candidate. For example, to conduct the research, the candidate is assigned at least two academic supervisors and an industry supervisor. The industry supervisor helps the candidate navigate the workplace environment and fulfill the priorities of this organization. Although the roles of each supervisor are usually apparent, some conflict is possible, and these individuals must thus be able to resolve these concerns and collaborate effectively. In addition, each candidate is assigned a mentor who helps individuals choose which modules to study.
To examine the research, candidates participate in a viva voce, or oral presentation, to an external examiner with experience in this research. This person, coupled with an internal examiner, then assesses the thesis. This thesis is conceptualized more as a portfolio than a single narrative, comprising publications, technical reports, and other material. Although equivalent in standard to a traditional PhD, the contributions of this work are intended to prioritize the needs of industry over then needs of academic communities.
References
-
Auriol, L., Felix, B., & Schaaper, M. (2010). Mapping Careers and Mobility of Doctorate Holders: Draft Guidelines, Model Questionnaire and Indicators--the OECD/UNESCO Institute for Statistics/EUROSTAT Careers of Doctorate Holders Project. OECD Science, Technology and Industry Working Papers, 2010(1).
-
Beltramo, J. P., Paul, J. J., & Perret, C. (2001). The recruitment of researchers and the organization of scientific activity in industry. International Journal of Technology Management, 22, 811–834
-
Borrell-Damian, L., Brown, T., Dearing, A., Font, J., Hagen, S., Metcalfe, J., & Smith, J. (2010). Collaborative doctoral education: University-industry partnerships for enhancing knowledge exchange. Higher Education Policy, 23(4), 493-514.
-
Mangematin, V. (2000). PhD job market: Professional trajectories and incentives during the PhD. Research Policy, 29, 741–756.
-
Mangematin, V., & Robin, S. (2003). The two faces of PhD students: Management of early careers of French PhDs in life sciences. Science and Public Policy, 30(6), 405–414.
-
Rynes, S. L., Bartunek, J. M., & Daft, R. L. (2001). Across the great divide: Knowledge creation and transfer between practitioners and academics. Academy of Management Journal, 44(2), 340-355.
-
Salimi, N., Bekkers, R., & Frenken, K. (2016). Success factors in university–industry PhD projects. Science and Public Policy, 27(3), 1–19.
-
Salminen-Karlsson, M., & Wallgren, L. (2008). The interaction of academic and industrial supervisors in graduate research. An investigation of industrial research schools. Higher Education, 56(1), 77–93
-
Santos, P., Veloso, L., & Urze, P. (2021). Students matter: The role of doctoral students in university–industry collaborations. Higher Education Research & Development, 40(7), 1530-1545.
-
Schild, I., & Hanberger, A. (2000). Industrial research schools: a real-time evaluation of the Swedish Knowledge Forundation's research school programme. Umeå universitet.
-
Slaughter, S., Campbell, T., Holleman, M., & Morgan, M. (2002). The ‘traffic’ in graduate students: Graduate students as tokens of exchange between academe and industry. Science, Technology, & Human Values, 27(2), 282–312.
-
Thune, T. (2009). Doctoral students on the university–industry interface: a review of the literature. Higher Education, 58(5), 637-651.
-
Tootell, A., Kyriazis, E., Billsberry, J., Ambrosini, V., Garrett-Jones, S., & Wallace, G. (2020). Knowledge creation in complex inter-organizational arrangements: understanding the barriers and enablers of university-industry knowledge creation in science-based cooperation. Journal of Knowledge Management.
-
Wallgren, L., & Dahlgren, L. O. (2005). Doctoral education as social practice for knowledge development. Conditions and demands encountered by industry PhD students. Industry and Higher Education, 19, 433–443.
-
Yang, H., & Jeffrey, R. (2021, December). Industrial Doctorate: A Case Study of Doctor of Engineering in the United Kingdom. In 2021 IEEE International Conference on Engineering, Technology & Education (TALE) (pp. 01-06). IEEE.

Introduction
Usually, many researchers contribute to a research project. When researchers submit a manuscript, they need to decide of these contributors deserve to be authors and the order in which these authors should be presented. Usually
-
the researchers can apply simple principles to choose which contributors deserve authorship, although disputres are not uncommon
-
the researchers can apply a range of techniques, including some quantitative approaches, to determine the order in which these authors should be arranged—although, in practice, this activity is usually informal and often perfunctory.
These choices can greatly affect the status and success of researchers. If the contributions of researchers are underestimated, these individuals are not as likely to receive promotions or grants in the future. If the contributions of researchers are overestimated, these individuals might receive benefits, such as grants, they do not deserve, undermining the return on research investment.
Yet, because of several reasons, decisions around authorship have become even more contentious in recent years. To illustrate
-
the number of co-authors on publications has increased over time (Larivière et al., 2015)—and this increase may complicate attempts to rank the contributions of each author
-
research projects are increasingly likely to span multiple disciplines—yet disciplines tend to differ, at least slightly, on how they evaluate the contributions of authors (Smith & Master, 2017)
-
research projects have become increasingly reliant on individuals who are not employed as academics, such as citizen scientists or cultural advisors (Castleden et al., 2010)—and when or whether these individuals should be designated as authors remains contentious.
Criteria to decide which contributors should be authors
Several bodies have developed criteria or guidelines that researchers can apply to decide which contributors should be granted authorship. One team, called the Vancouver Group—who were the editors of the International Committee of Medical Journal—devised perhaps the most renowned guidelines in 1985. These guidelines have been updated several times. Individuals refer to these guidelines as the Vancouver Protocol, the Vancouver Convention, or the International Committee of Medical Journal Editors guidelines. Regardless of the name, according to these guidelines (e.g., ICMJE, 2013), contributors should be granted authorship only if they fulfill four criteria
-
they contributed substantially and intellectually to the conception or design of this work—or to the acquisition, analysis, or interpretation of data
-
the drafted the manuscript or revised the manuscript to enhance this work intellectually
-
they approved the final version of this manuscript, and
-
they agree to be accountable for every facet of this work.
The first two criteria are relevant only if individuals contributed substantially and intellectually. Despite some controversy about this phase (Street et al., 2010), in essence, individuals contributed substantially and intellectually if
-
the contribution of anyone else—even someone in the same field—would have been different and, therefore, this contribution is not routine
-
this contribution enhances the quality of this work.
Individuals who do not fulfill all four criteria cannot be designated as authors. Instead, these individuals may be recognized in the section on acknowledgements.
Other guidelines overlap with these criteria. For instance, according to the National Institute of Health or NIH (2007), individuals should be designated as authors only if
-
they have contributed significantly to the conceptualization, design, execution, or interpretation of the research—analogous to the first criterion of the Vancouver protocol
-
they contributed to the drafting or revision of this manuscript—analogous to the second criterion of the Vancouver protocol
-
they are willing to assume responsibility for this study—analogous to the fourth criterion of the Vancouver protocol; this guideline might also encompass the third criterion of the Vancouver protocol, because individuals should not assume responsibility for all facets of this study unless they approve the final draft.
In practice, some researchers deliberately breach these protocols. For example, they might designate someone as an author to reciprocate a favor (Street et al., 2010). Or they might not designate someone as an author (Gøtzsche et al., 2007) merely to conceal a potential conflict of interest or fulfill some other unwelcome goal.
Quantitative methods to order authors: The Winston (1985) method
In some publications, especially when the number of authors is extensive, the authors are ordered alphabetically (Waltman, 2012). This approach has gradually declined over the decades. In 2011, only 3.7% of scientific publications utilized this approach. In most publications now, the order of authors is intended to reflect the level of contribution—although, in some fields, especially in health, the last author is often assumed to be the primary supervisor or director.
Winston (1985) pioneered a method that researchers could apply to order the authors systematically and appropriately. This method, although not applied frequently today, inspired an array of similar attempts. According to this method, to decide the order of authors, each research activity is first assigned a specific number of points. Specifically
-
the conceptualization and refinement of the research question, aim, and idea is worth 50 points
-
the literature search is worth 20 points
-
the design of this research is worth 30 points
-
the selection of instruments is worth 10 points
-
the construction of instruments, such as a questionnaire, is worth 40 points
-
decisions on how to analyze the data are worth 10 points
-
completion of the analysis is worth 10 points
-
interpretation of the analysis is worth 10 points
-
the first draft is worth 50 points
-
the second draft is worth 30 points—or two points for each additional page
-
the editing of this manuscript is worth 10 point
Second, whenever an author completes one of these activities alone, this person receives the corresponding points. However, if two or more authors complete one of these activities, these points are shared. Usually, points are shared according to the proportion of time each person dedicated to the activity. For example
-
suppose two researchers, Adam and Betty, dedicated 30 hours and 10 hours to the literature search respectively
-
thus, 75% and 25% of the task duration was completed by Adam and Betty respectively
-
so, Adam is assigned 75% of 20 points or 15 points—and Betty is assigned 25% of 20 points or 5 points.
However, the distribution of time does not always reflect the level of scholarly contribution. To illustrate, someone might attempt to conceptualize the research question or ideas over many hours. Another researcher, within only a few minutes, might recognize these ideas are unfeasible and suggest a better alternative. Therefore, on some activities, the researchers should discuss who they felt contributed most effectively and assign points accordingly. This method to divide points is most applicable to
-
the conceptualization and refinement of the research question, aim, and idea
-
the design of this research
-
the selection of instruments
-
decisions on how to analyze the data
-
interpretation of the analysis
-
and, to a lesser extent, the construction of instruments
Finally, after the points are divided across the researchers on each task, the sum is calculated for each author separately. The order of authors merely corresponds to the order of these sums.
Limitations of quantitative measures to determine the order of authors: Arbitrary priorities
Despite the ingenuity and creativity of the method that Winston (1985) proposed, several problems dampen the benefits of this method and similar techniques. First, to quantify the contributions of each author, most quantitative methods need to prioritize the various activities. They might, for example, decide that
-
research design should be weighted higher than data analysis, or
-
writing the first draft should be weighted higher than reviewing the literature
Yet, because of several reasons, attempts to prioritize or weight the various activities are tenuous. First, these priorities vary across researchers. To illustrate, as Smith and Master (2017) underscored, Ahmed et al. (1997) believed the conceptualization and refinement of the research idea should be assigned considerable weight, because the research is entirely contingent upon this idea. In contrast, Clement (2014) argued this activity should be assigned a modest weight, because nobody can know whether the idea is useful until the more arduous task of research and writing is completed.
Second, these priorities may vary across disciplines or methodologies. For example, interpretation is perhaps more important in qualitative research, in which interpretation may demand extensive reflection, than quantitative research, in which fewer interpretations are possible. In principle, researchers could vary the weights across disciplines or methodologies. However, this approach is not only cumbersome but may not accommodate interdisciplinary or transdisciplinary research (Smith & Master, 2017).
Third, these priorities may not be robust to changes in research methods, practices, and approaches. In the future, researchers may conduct novel research activities that existing quantitative methods disregard. Alternatively, some research activities that are valued now may, because of artificial intelligence and other technologies, become automated in the future (Smith & Master, 2017). In short, the value that individuals attach to specific research activities might shift over time.
Several complications might emanate from these changes over time. To illustrate,
-
when the authors submit a manuscript, most researchers might perceive one activity, such as data analysis, as especially valuable.
-
therefore, the researcher who completed the data analysis may be designated as first author
-
years later, however, various bodies, such as funding agencies or promotion committees, might not perceive data analysis as especially valuable
-
in this instance, the order of authors in this manuscript is misleading because the first author primarily completed an activity that funding agencies or promotion committees today do not value
To address this problem, Tscharntke et al. (2007) recommended that researchers should submit the rationale or methods they applied to order the authors. Consequently, various bodies, such as funding agencies or promotion committees, can later assess whether they espouse this rationale and, if not, can revise the order of authors.
For similar reasons, other scholars, such as Rennie et al. (1997) and Resnik (1997), suggest that researchers should delineate the precise role of each contributor rather than order the authors. That is, according to this perspective, authors should submit a document that stipulates the contributions of all researchers—including the researchers who are not designated as authors. Taxonomies, such as the Contributor Role Ontology, designed to classify the various research activities, were partly developed to achieve this goal.
Limitations of quantitative measures to determine the order of authors: Exclusion of useful activities
Many significant research bodies, such as the International Committee of Medical Journal Editors, have stipulated the research activities that are perceived as scholarly enough to warrant authorship—such as research conception, research design, data analysis, and report writing. Other research activities, including technical assistance, routine statistical analysis, project management, supervision, and the acquisition of funds are not perceived as scholarly enough to warrant authorship. Accordingly, the quantitative measures that are designed to determine the order of authors, such as the method that Winston (1985) pioneered, often disregard these other research activities.
Smith and Master (2017), however, question this practice. To illustrate, suppose that two researchers had completed the scholarly research activities to the same extent, but only one researcher also managed the project. The researcher who had managed the project should, presumably, be prioritized before the other researcher. This simple example shows that research activities that are not deemed as scholarly, but are nevertheless vital, should not be disregarded when the order of authors is determined.
Limitations of quantitative measures to determine the order of authors: Other concerns and equal contribution
Over the years, other researchers have raised concerns about the method that Winston (1985) proposed as well as some of the subsequent variants. For example
-
Winston (1985) does not stipulate how the authors should decide which individuals contributed most to each research activity, especially the research activities that are evaluated qualitatively
-
when researchers apply these quantitative measures, they might discover that two authors contributed equally. Not all journals, however, permit authors to stipulate equal recognition
However, O’Brien et al. (2022), editors of Academic Medicine, revealed that increasingly more researchers have requested the authors be designed as equal in their level of contribution. These researchers might either feel their contributions were equal or believe that attempts to determine the order of authors might compromise teamwork and arbitrarily position some roles and disciplines as superior.
Yet, as O’Brien et al. (2022) acknowledge, when authors are designated as equivalent in their contributions, some problems can unfold. Over time, researchers may not be as motivated to contribute, because the reward is not as apparent. In addition, until this practice is unified, funding bodies, promotion committees, and other stakeholders could misconstrue this designation of equal authorship. Finally, researchers may request this designation of equal authorship to fulfill unhelpful goals, such as the goal to shun debate around authorship.
Other quantitative methods to order authors
Since Winston (1985) published his seminal work, many other researchers have attempted to develop alternatives. Each alternative is similar but includes some unique features, designed to address various limitations.
To illustrate, Bhopal (1997) introduced a method that was designed to clarify how the researchers should decide which individuals contributed most to each research activity. According to Bhopal (1997), for each research activity or phase
-
each potential author should identify the three other authors who contributed to the greatest extent
-
assign these three authors a number depending on the degree to which these three individuals contributed, such as 20, 30, and 50
The ratings of each potential author should then be aggregated to generate a score, representing the relative contribution of these authors. This method, although designed to foster consensus, is imperfect, primarily because the individuals are seldom aware of the degree to which the authors contributed. The estimates of researchers who dedicated limited time to this project might be especially inaccurate.
One complication is that researchers cannot readily choose precise numbers to evaluate contribution. For example, they cannot readily distinguish levels such as 50% or 60% of the contribution. To override this problem, Ahmed et al. (1997) devised an approach in which
-
each potential author is assigned a 1, 3, or 5 on each research phase, depending on their level of contribution
-
specifically, minimal contributions attract a 1, significant contributions attract a 3, and major contributions attract a 5—although the terms minimal, significant, and major are still hazy
In contrast to these simple alternatives, Sheskin (2006) proposed one of the most sophisticated methods. In essence
-
to decide the weight that should be attached to each research activity, individuals first compare the importance of two research activities—such as the first draft and second draft
-
individuals then repeat this comparison on every other pair of research activities
-
to evaluate the contribution of authors on each research activity, the individuals compare each possible pair of authors
-
all this information is then inserted into a formula
This method, although perhaps the most accurate, demands significant effort. Consequently, despite the apparent merits of this method, researchers do not often recommend this approach.
Other quantitative methods to order authors: The Warrender approach
Warrender (2016) developed a method that integrates the key features of several other techniques. To apply this technique, the researchers rate the degree to which each potential author contributed to four key research phases
-
conception and design
-
data acquisition
-
analysis and interpretation
-
manuscript preparation
Specifically, on each phase, all potential researchers are assigned a score of 0, 1, 3, and 5, depending on whether their contributions were minimal, significant, or major. The unique feature of this scheme, however, is that Warrender (2016) developed a rubric to choose these numbers. For example, to evaluate the contribution of researchers on the conception and design of this research
-
individuals are assigned a 5 if they were primarily responsible for ascertaining the goal of this study and the overall approach or they formulated the key research question
-
individuals are assigned a 3 if they participated in all planning meetings or contributed substantially to the planning or conception of a key facet of this study
-
individuals are assigned a 1 if they participated in a planning meeting or suggested how past activities might be relevant to this study
In contrast, to evaluate the contribution of researchers on manuscript preparation
-
individuals are assigned a 5 if they were the main writer of the first draft or prepared, as well as submitted, the final manuscript
-
individuals are assigned a 3 if they contributed at least a paragraph to the manuscript, prepared a key figure, suggested a few substantive changes, or address the comments of reviewers substantially
-
individuals are assigned a 1 if they approved the final version of the manuscript.
Similarly, the researchers apply two other rubrics to evaluate the contribution of researchers on data acquisition as well as analysis and interpretation. Each author can receive up to 5 points on the four phases, generating a maximum total of 20. Like the other approaches, the authors of this publications should be arranged form the most points to the least points accumulated. The benefit of this approach is that
-
researchers need to differentiate only four main research phases—an approach that mirrors the methods that Paneth (1998), Sheskin (2006), Slone (1996) formulated but is more convenient than is the method that Winston (1985) proposed
-
researchers merely need to distinguish three levels of contribution that, like the approach that Ahmed et al. (1997) proposed, is simple and perhaps more likely to reach consensus
-
researchers can apply a rubric to differentiate these three levels, also facilitating consensus.
The distinction between credit and responsibility
All these approaches assume that authors have both contributed to the manuscript and assume responsibility. However, Paneth (1998) challenges this assumption. That is, individuals who are credited as authors because of their scholarly contributions should not necessarily be responsible to explain anomalies in all facets of the project. Instead, authors should be granted the opportunity to specify the facets of this project for which they are responsible.
Furthermore, several authors might contribute to a research activity, but only one author might have committed fraud. Surely, only the person who committed the fraud should be liable. To address this concern, Allen et al. (2014) recommended that researchers utilize a more precise taxonomy of research activities, comprising 14 categories, to stipulate the contribution of each author. The categories, derived from the feedback and advice of 230 authors, include activities that are not relevant to decisions around authorship
-
formulation of the research question and hypotheses
-
design of the methodology
-
development and implementation of code or software
-
application of statistical or other formal techniques to analyze the data
-
implementation of the experiments and investigation process
-
collection of the data
-
collation of the study materials
-
management of the data
-
preparation of the initial draft
-
revision of the draft
-
preparation of the visual representations
-
supervision of the research
-
coordination of the research activities
-
acquisition of the financial support
To illustrate the benefits of this approach, in some instances, authors may have manipulated some of the figures to distort the results. Only the authors engaged in this manipulation should be responsible. This approach is not designed to supplant authorship but, in the future, may inspire the academy to regard contribution as equally or more significant and relevant than authorship to key decisions.
As Vasilevsky et al. (2022) discussed, many research bodies now utilize this taxonomy or minor refinements to this taxonomy, such as the Contributor Roles Taxonomy or CRediT as well as an extension of CRediT called the Contributor Role Ontology. The Contributor Role Ontology is a more precise taxonomy that differentiates 50 research activities.
Despite the benefits of this approach, Smith and Master (2017) have identified a few shortcomings. First, this approach does not characterize the degree to which each author contributed—a characterization that is vital to many decisions. Second, this approach does not clarify when a contribution is considered substantial enough to be included. Third, if this approach did ever supplant authorship, all the practices that depend on authorship—such as citations—would be obsolete. Alternative tools would be necessary (for some possible examples, see Vasilevsky et al., 2022).
Qualitative methods to decide the order and contributions of authors: Approaches to accommodate multiple disciplines.
Many techniques that have been proposed to decide the order and delineate the contributions of authors exhibit the same problem: the priority of each research activity varies across methodologies and disciplines. This problem is especially conspicuous when the research is multidisciplinary, cross-disciplinary, interdisciplinary, or transdisciplinary.
Smith and Master (2017) proposed a method that may be especially useful when the research entails more than one discipline. This approach is designed to encourage genuine debate and conversation—debate and conversation that continues throughout the project. In essence, this approach comprises five phases:
-
First, before the project commences, the researchers, as a team, can utilize the taxonomy that Allen et al. (2014) developed to outline the roles and responsibilities of each individual in the project. Or the team could modify this taxonomy to suit their project. During this discussion, the team should allocate a leader to each research activity and stipulate a dispute resolution procedure
-
Second, this discussion can then inform preliminary attempts to specify the likely order of authors
-
Third, as the research progresses, dialogue about contributions, authorship, and the order of authors should continue regularly
-
Fourth, immediately before the manuscript is published, the researchers should seek consensus about the final contributions, authorship, and the order of authors
-
Fifth, the authors should draft a declaration that outlines these decisions and is submitted to the journal
To resolve disputes, Smith and Master (2017) suggest that teams organize an independent researcher, who is a member of the lab or team, to be arranged in advance. The team should also seek the advice of publication officers and research integrity officers. The procedure should be designed to limit the effects of disparities in power between senior and junior researchers.
Smith and Master (2017) acknowledge some limitations of this approach. First, because universities tend to be hierarchical and values diverge across disciplines, disagreement is likely, even if sometimes concealed. Second, this discussions, although likely to facilitate collaboration, innovation, and productivity, may consume significant time and thus promote stress.
References
-
Ahmed, S. M., Maurana, C. A., Engle, J. A., Uddin, D. E., & Glaus, K. D. (1997). A method for assigning authorship in multi-authored publications. Family Medicine, 29(1), 42-44.
-
Allen, L., Scott, J., Brand, A., Hlava, M., & Altman, M. (2014). Publishing: Credit where credit is due. Nature, 508(7496), 312-313.
-
Baykaldi, S., & Miller, S. (2021). Navigating the decisions and ethics of authorship: An examination of graduate student journal article authorship. Journalism & Mass Communication Educator, 76(1), 29-45.
-
Bhopal, R. S., Rankin, J. M., McColl, E., Stacy, R., Pearson, P. H., Kaner, E. F. S., et al. (1997). Team approach to assigning authorship order is recommend (letter to the editor). British Medical Journal, 314, 1046.
-
Castleden, H., Morgan, V. S., & Neimanis, A. (2010). Researchers' perspectives on collective/community co-authorship in community-based participatory indigenous research. Journal of Empirical Research on Human Research Ethics, 5(4), 23-32.
-
Clement, T. (2014). Authorship matrix: A rational approach to quantify individual contributions and responsibilities in multi-author scientific articles. Science and Engineering Ethics, 20, 345
-
Fine, M. A., & Kurdek, L. A. (1993). Reflections on determining authorship credit and authorship order on faculty-student collaborations. American Psychologist, 48(11), 1141.
-
Gasparyan, A. Y., Ayvazyan, L., & Kitas, G. D. (2013). Authorship problems in scholarly journals: considerations for authors, peer reviewers and editors. Rheumatology international, 33(2), 277-284.
-
Gøtzsche, P. C., Hróbjartsson, A., Johansen, H. K., Haahr, M. T., Altman, D. G., & Chan, A. W. (2007). Ghost authorship in industry-initiated randomised trials. PLoS medicine, 4(1), e19.
-
Grobman, L. (2009). The student scholar: (Re)negotiating authorship and authority. College Composition and Communication, 61(1), W175.
-
Haerling, K., & Prion, S. (2020). Negotiating authorship. Clinical Simulation in Nursing, 46, 66-67.
-
ICMJE. (2013). Recommendations for the conduct, reporting, editing, and publication of scholarly work in medical journals. International Committee of Medical Journal Editors.
-
Konopasky, A., O'Brien, B. C., Artino Jr, A. R., Driessen, E. W., Watling, C. J., & Maggio, L. A. (2022). I, we and they: A linguistic and narrative exploration of the authorship process. Medical Education, 56(4), 456-464.
-
Larivière, V., Gingras, Y., Sugimoto, C. R., & Tsou, A. (2015). Team size matters: Collaboration and scientific impact since 1900. Journal of the Association for Information Science and Technology, 66(7), 1323-1332.
-
Macfarlane, B. (2017). The ethics of multiple authorship: power, performativity and the gift economy. Studies in Higher Education, 42(7), 1194-1210.
-
Marušić, A., Bošnjak, L., & Jerončić, A. (2011). A systematic review of research on the meaning, ethics and practices of authorship across scholarly disciplines. Plos one, 6(9), e23477.
-
NIH. (2007). Guidelines for the conduct of research in the intramural research program at NIH. Bethesda, MD: National Institutes of Health.
-
O’Brien, B. C., Lypson, M. L., Chan, T. M., Coverdale, J., DeVilbiss, M. B., West, C. P., & Roberts, L. W. (2022). Academic Olympism and Authorship: Honoring Contributions to Collaborative Scholarship. Academic Medicine, 97(3), 315-318.
-
Paneth, N. (1998). Separating authorship responsibility and authorship credit: A proposal for biomedical journals. American Journal of Public Health, 88.
-
Rennie, D., Yank, V., & Emanuel, L. (1997). When authorship fails—A proposal to make contributors accountable. Journal of the American Medical Association, 278, 579.
-
Resnik, D. B. (1997). A proposal for a new system of credit allocation in science. Science and Engineering Ethics, 3.
-
Sheskin, T. J. (2006). An analytic hierarchy process model to apportion co-author responsibility. Science and Engineering Ethics, 12.
-
Slone, R. M. (1996). Coauthors’ contributions to major papers published in the AJR: Frequency of undeserved coauthorship. American Journal of Roentgenology, 167.
-
Smith, E., & Master, Z. (2017). Best practice to order authors in multi/interdisciplinary health sciences research publications. Accountability in Research, 24(4), 243-267.
-
Street, J. M., Rogers, W. A., Israel, M., & Braunack-Mayer, A. J. (2010). Credit where credit is due? Regulation, research integrity and the attribution of authorship in the health sciences. Social Science & Medicine, 70(9), 1458-1465.
-
Tscharntke, T., Hochberg, M. E., Rand, T. A., Resh, V. H., & Krauss, J. (2007). Author sequence and credit for contributions in multi-authored publications. PLoS Biology, 5, e18
-
Vasilevsky, N. A., Hosseini, M., Teplitzky, S., Ilik, V., Mohammadi, E., Schneider, J., ... & Holmes, K. L. (2021). Is authorship sufficient for today’s collaborative research? A call for contributor roles. Accountability in Research, 28(1), 23-43.
-
Waltman, L. (2012). An empirical analysis of the use of alphabetical authorship in scientific publishing. Journal of Informetrics, 6(4), 700-711.
-
Warrender, J. M. (2016). A simple framework for evaluating authorial contributions for scientific publications. Science and Engineering Ethics, 22(5), 1419-1430.
-
West, J. D., Jacquet, J., King, M. M., Correll, S. J., & Bergstrom, C. T. (2013). The role of gender in scholarly authorship. PloS one, 8(7).
-
Winston, R. B. (1985). A suggested procedure for determining order of authorship in research publications. Journal of Counselling and Development, 63, 515-518.