Evaluator Exclusion in the Program Planning and Design Phase

168713-Thumbnail Image.png
Description
Program leadership’s decision to include an evaluator during the program planning and design phase is the critical first step necessary for evaluators to provide the programmatic benefits associated with the evaluation profession. Several recent developments have promoted evaluator inclusion in

Program leadership’s decision to include an evaluator during the program planning and design phase is the critical first step necessary for evaluators to provide the programmatic benefits associated with the evaluation profession. Several recent developments have promoted evaluator inclusion in program planning and design activities, including federal legislation that mandates evaluator inclusion and advocacy efforts from evaluation academics. However, the evaluation literature presents a collective frustration within the evaluation field due to ongoing exclusion from program planning and design activities. Utilizing the defensive attribution hypothesis, this quantitative study gathered responses from 260 American Evaluation Association members and 61 Project Management Institute members to determine an evaluator exclusion rate, develop a taxonomy of exclusion factors, and explore the extent to which program leaders and program evaluators demonstrate defensive attributions when rating these factors’ influence on evaluator exclusion in program planning and design activities. Results indicated an approximately 70% evaluator exclusion rate in respondents’ most recent program experiences. Furthermore, the defensive attribution hypothesis was not supported in the study, as program evaluators more strongly attributed their lack of inclusion to deficiencies outside of the evaluation practice, but program leaders also more strongly attributed evaluator exclusion to deficiencies outside of the evaluation practice. Program evaluators most strongly attributed their exclusion to program leaders’ insufficient training and knowledge on the role of evaluation during the program planning and design phase. Program leaders most strongly attributed evaluator exclusion to their own staffing decisions, indicating a preference to not include evaluators in program planning and design activities due to achieving previous program success without them, assigning evaluation activities to non-evaluation staff, and a funding process that allows the practice to occur. As the first study to explore evaluator exclusion in the program planning and design phase, it sets a foundation for future research studies to corroborate and build upon its findings, identify policies that encourage evaluator inclusion, and continue efforts to establish mutually beneficial relationships in the program planning and design phase.
Date Created
2022
Agent

From soul searching to community building: Understanding community identification through community "jen-tung" process

158191-Thumbnail Image.png
Description
This study provides insights into expanding the concepts of community arts in general and more specifically community-based art practices (CAP); highlights the participatory characteristics in the processes of CAP, and seeks to discern the mechanism that contributes to the formation

This study provides insights into expanding the concepts of community arts in general and more specifically community-based art practices (CAP); highlights the participatory characteristics in the processes of CAP, and seeks to discern the mechanism that contributes to the formation of community collective identity. Revolving around Bhattacharyya’s (1995, 2004) conceptualization of community development, this study found it essential for exploring the fundamental concept of community in relation to community identity. To examine the concept of community identity, this research anchors the inquiry by studying how community-based art practice contributes to community identification and seeks to discover the connection between identity process and social change. The research also discusses the emergent concepts that serve as influential factors to the formation of community identity and proposes an alternative identification mechanism, ‘jen-tung’ process, which provides a needed new dimension to the existing theories of social identity formation and community efficacy development.
Date Created
2020
Agent

Toward an analytical framework for assessing power dynamics in university-community partnerships

156890-Thumbnail Image.png
Description
In a contemporary socioeconomic context that pushes universities toward a more neoliberal agenda, some are answering a call to reinvest in the public purpose of higher education. Their strategies increasingly integrate teaching, research, and service through university-community partnerships. Within this

In a contemporary socioeconomic context that pushes universities toward a more neoliberal agenda, some are answering a call to reinvest in the public purpose of higher education. Their strategies increasingly integrate teaching, research, and service through university-community partnerships. Within this movement, several initiatives aim to support a qualitative transformational shift toward a more egalitarian paradigm of collaboration. However, the literature and knowledge-building around these aims is largely insular to higher education and may be insufficient for the task. Thus, this study situates these aspirations in the community development literature and theories of power to better conceptualize and operationalize what is meant by reciprocal, mutually-beneficial approaches to university-community partnerships.

First, a theoretically grounded analytical framework was developed using both higher education and community development literatures to build two ideal-typical approaches to community practice characterized by power-over versus power-with. Within power-over, the institution exclusively holds authority, control, and legitimacy. Power-with is built through partnerships that share these elements with communities. Second, the resulting theoretical framework was developed further through a multi-stage deductive-inductive content analysis of written data readily available from university websites about their community partnerships. This process operationalized the framework by identifying and clarifying specific indicators within the power-over and power-with ideal-types.

The analytical framework was then compared to the aspirational community empowerment goals found in materials about the Carnegie elective classification for Community Engagement and materials from both the Anchor Initiatives Task Force and Anchor Initiatives Dashboard Learning Cohort. This comparative analysis found that while these initiatives aspire to transform power dynamics between universities and communities, they are vague on the meaning of these practices and their antitheses. This gap in clarity hinders these initiatives from distinguishing transformative work from the status quo, potentially inadvertently allowing the perpetuation of power-over dynamics in university-community partnerships.

The more robust analytical framework developed herein will enable these initiatives to better assess the quality of university-community partnerships against the aspirations of equity, social justice, democratic practice, mutual respect, shared authority, and co-creation. Such assessment will enable more effective knowledge-building toward transformational practice.
Date Created
2018
Agent

The metaphors we help by

154283-Thumbnail Image.png
Description
As universities, nonprofits, community foundations, and governmental organizations proliferate the language of leadership development and social transformation, it is with an inadequate understanding of what agency is being provoked. With an emphasis on ‘career-focused’ tools and techniques in community development

As universities, nonprofits, community foundations, and governmental organizations proliferate the language of leadership development and social transformation, it is with an inadequate understanding of what agency is being provoked. With an emphasis on ‘career-focused’ tools and techniques in community development literature and pedagogy, there is too little understanding of the knowledge being drawn upon and created by community workers (CWs). Furthermore, this knowledge is often tacit, bodily, spiritual, and collective, making it even more alien to the empiricism-focused world of social science. Situated meaning-making must be recapitulated in the study of community development in order to better address the complexity and ambiguity of specific practices and the associated construction of identities.

This study suggests an alternative way to understand and analyze community development work. Building on fieldwork in the Kumaoni Himalaya of India, it is argued that community workers make sense of the world in large part through the co-construction of dialectic identity metaphors (DIMs). These DIMs help explain to the workers the way the world works, the way it does not work, and what to do about it. More than formal community development theory, I suggest community workers look to dominant DIMs to structure organizational vision and program creation. Furthermore, ideological fragments within local DIMs contribute to the reproduction of dominant ways of knowing and the creation of best practices. For this reason, in situ examination of DIM creation and maintenance is useful for understanding how and why CWs collectively construct their identities and the co-constitutive work.
Date Created
2016
Agent

Bolstering youth community involvement: uncovering the essential role of family and leadership

154268-Thumbnail Image.png
Description
This dissertation explores youth community involvement in a geographically defined urban community in the United States. The research approach was qualitative, naturalistic, and ethnographic, and utilized grounded theory analysis. The study included fifty-six participants. In focus groups and interviews with

This dissertation explores youth community involvement in a geographically defined urban community in the United States. The research approach was qualitative, naturalistic, and ethnographic, and utilized grounded theory analysis. The study included fifty-six participants. In focus groups and interviews with youth and adults as well as with a group of youth and adults working on events in the community (hereby called the “Active Youth Group” or AYG), the characteristics of the community were discussed. Furthermore, the study inquired about the nature of youth adult-interactions. In this context, the categories “family” and “leadership” emerged. The study highlights the importance of family in the lives of residents of the community. Furthermore, the study contributes to the literature about youth adult-partnerships (Camino, 2000; Camino & Zeldin, 2002a; Jones, 2004; Lofquist, 1989) by exploring the dynamics between youth-led and adult-led community work. It discusses some of the factors that may influence whether the youth or the adults are in charge of various components of a youth development program.
Date Created
2016
Agent

University-community partnerships: a stakeholder analysis

153753-Thumbnail Image.png
Description
Universities and community organizations (e.g., nonprofit organizations, schools, government, and local residents) often form partnerships to address critical social issues, such as improving service delivery, enhancing education and educational access, reducing poverty, improving sustainability, sharing of resources, research, and program

Universities and community organizations (e.g., nonprofit organizations, schools, government, and local residents) often form partnerships to address critical social issues, such as improving service delivery, enhancing education and educational access, reducing poverty, improving sustainability, sharing of resources, research, and program evaluation. The efficacy and success of such collaborations depends on the quality of the partnerships. This dissertation examined university-community partnership (UCP) relationships employing stakeholder theory to assess partnership attributes and identification. Four case studies that consisted of diverse UCPs, oriented toward research partnerships that were located at Arizona State University, were investigated for this study. Individual interviews were conducted with university agents and community partners to examine partnership history, partnership relationships, and partnership attributes. The results revealed several aspects of stakeholder relationships that drive partnership success. First, university and community partners are partnering for the greater social good, above all other reasons. Second, although each entity is partnering for the same reasons, partnership quality is different. University partners found their community counterparts more important than their community partners found them to be. Third, several themes such as credibility, institutional support, partner goodwill, quality interpersonal relationships have emerged and add descriptive elements to the stakeholder attributes. This study identifies aspects of UCPs that will be contextualized with literature on the subject and offer significant contributions to research on UCPs and their relational dynamics.
Date Created
2015
Agent

The search for social capital transference in associations: the case of the Verrado assembly

153034-Thumbnail Image.png
Description
This mixed-method study of a community association discusses the potential for a comeback in associationalism. This comeback is posited to first occur within associations before it can occur across associations. This study discusses research on associations and critiques its failure

This mixed-method study of a community association discusses the potential for a comeback in associationalism. This comeback is posited to first occur within associations before it can occur across associations. This study discusses research on associations and critiques its failure to not go far enough to understand how to spur this comeback. In particular, this study suggests that future research needs to focus more on the psychological components of social capital and pay more attention to the more informal forms of association behavior.

The findings of this community case study provide a preliminary model of psychological social capital development and transference. The findings suggest that Herzberg's (1959) factors, attitudes, and effects complex still holds merit after considering psychological social capital effects, specifically cognitions and behaviors. Evidence from looking at associational and community involvement is presented that suggests that psychological social capital can be transferred between associations and their respective communities. A framework for intentionally stimulating psychological social capital transference is presented based on an association's leadership program. Thus, psychological social capital transference as a theory is presented for consideration in future research and application.
Date Created
2014
Agent

A pilot study of the benefits of traditional and mindful community gardening for urban older adults' subjective well-being

150103-Thumbnail Image.png
Description
The population of older adults and the percentage of people living in urban areas are both increasing in the U.S. Finding ways to enhance city-dwelling, older adults' social integration, cognitive vitality, and connectedness to nature were conceptualized as critical pathways

The population of older adults and the percentage of people living in urban areas are both increasing in the U.S. Finding ways to enhance city-dwelling, older adults' social integration, cognitive vitality, and connectedness to nature were conceptualized as critical pathways to maximizing their subjective well-being (SWB) and overall health. Past research has found that gardening is associated with increased social contact and reduced risk of dementia, and that higher levels of social support, cognitive functioning, mindfulness, and connectedness to nature are positively related to various aspects of SWB. The present study was a pilot study to examine the feasibility of conducting a randomized, controlled trial of community gardening and to provide an initial assessment of a new intervention--"Mindful Community Gardening," or mindfulness training in the context of gardening. In addition, this study examined whether community gardening, with or without mindfulness training, enhanced SWB among older adults and increased social support, attention and mindfulness, and connectedness to nature. Fifty community-dwelling adults between the ages of 55 and 79 were randomly assigned to one of three groups: Traditional Community Gardening (TCG), Mindful Community Gardening (MCG), or Wait-List Control. The TCG and MCG arms each consisted of two groups of 7 to 10 participants meeting weekly for nine weeks. TCG involved typical gardening activities undertaken collaboratively. MCG involved the same, but with the addition of guided development of non-judgmental, present-focused awareness. There was a statistically significant increase in different aspects of mindfulness for the TCG and the MCG arms. The interventions did not measurably impact social support, attention, or connectedness to nature in this small, high functioning, pilot sample. Qualitative analysis of interview data from 12 participants in the TCG and MCG groups revealed that both groups helped some participants to better cope with adversity. It was concluded that it is feasible to conduct randomized, controlled trials of community gardening with urban older adults, and considerations for implementing such interventions are delineated.
Date Created
2011
Agent