As a I start trying to wrap my head around the different models and the values in each I am finding that there tends to be a fairly large overlap of many of the models. I believe that the reason for this is because they are built from one another and often act to improve upon, or at least evaluate, areas that may have been overlooked.
Overview of Case Study
The case study explores a prenatal exercise/health program that was established in order to educate and provide resources to Aboriginal women to decrease the cases of gestational diabetes mellitus (GDM). The purpose of the program is to decrease the occurrences of GDM and type 2 diabetes in the Aboriginal population.
The case study acts as a brief overview of the program and if an evaluator were to engage this program more data would need to be collected in order to make a valid and informed analysis of the program.
The Model
For the purpose of this assignment and the case study provided I am decided to use the Stufflebeam's CIPP model to base the analysis on because it, "is focused on program evaluations, particularly those aimed at effecting long-term, sustainable improvements." (Stufflebeam, 2002, pg. 1) The main goal of the program is to have a long term impact on GDM, and inturn the occurrences of type 2 diabetes in Aboriginal youth and adults. Therefore, the program is intended to continue and improve to meet its goals which take place over many years. The CIPP model also allows for formative (what can be done to improve the program) and summative (is the program successful) analysis to occur (Stufflebeam, 2003).
CIPP is an acronym and stands for context, input, process, and product (impact, effectiveness, sustainability, & transportability).
The context component, "assesses needs, assets, and problems within a defined environment." (Stufflebeam, 2002, pg 4). Through this the evaluator will be able to determine what the needs of the program are; what resources are currently available, including funding; as well as what the current issues are within the selected population and geographical area. By doing this a baseline can be formed from which the program can be based when examining the process and product. The focus of this program was on the city of Saskatoon though transferability was discussed since 80% of the impacted population lives outside of this city.
For the input component the evaluator would compare other strategies that have been tried, or are being used elsewhere to see the impact that these programs have had. During this time the approach to the current program as well as the cost associated with such practices would be examined to see if it is feasible. In this program the costs would be an incredibly important factor to consider considering the number of specialists and expensive resources (pools, exercise equipment) that are being utilized. Other practices may be found to be just as effective but less costly and more readily available to the general population.
The process would examine what is currently happening and how the program has progressed. Since the program occurred over two years and feedback was taken from the participants this would help to see what impact this feedback had on the improvement of the program (formative). It could also what else could be done.
The final stage evaluates the product and how well the program has followed the purpose and met the needs of the target audience. During this stage the effectiveness of the program is explored and also its ability to be maintained over an extended amount of time. In order for this program to have an impact on the population it would need to be implemented long term and it would also have to have the capability to be adapted in order to be transferred and applied elsewhere. Even though the program is based out of Saskatchewan the concern with diabetes amongst Aboriginal populations is an issue nationally. If the program is successful in Saskatchewan then how can it be implemented elsewhere.
Conclusion
Though many evaluation models would have been effective in analysing the program Stufflebeam's CIPP model takes a comprehensive and detailed approach that provides an analysis to explore the longevity and sustainability of the program. Therefore, in this case it has been determined to be the most effective model to apply.
Overview of Case Study
The case study explores a prenatal exercise/health program that was established in order to educate and provide resources to Aboriginal women to decrease the cases of gestational diabetes mellitus (GDM). The purpose of the program is to decrease the occurrences of GDM and type 2 diabetes in the Aboriginal population.
The case study acts as a brief overview of the program and if an evaluator were to engage this program more data would need to be collected in order to make a valid and informed analysis of the program.
The Model
For the purpose of this assignment and the case study provided I am decided to use the Stufflebeam's CIPP model to base the analysis on because it, "is focused on program evaluations, particularly those aimed at effecting long-term, sustainable improvements." (Stufflebeam, 2002, pg. 1) The main goal of the program is to have a long term impact on GDM, and inturn the occurrences of type 2 diabetes in Aboriginal youth and adults. Therefore, the program is intended to continue and improve to meet its goals which take place over many years. The CIPP model also allows for formative (what can be done to improve the program) and summative (is the program successful) analysis to occur (Stufflebeam, 2003).
CIPP is an acronym and stands for context, input, process, and product (impact, effectiveness, sustainability, & transportability).
The context component, "assesses needs, assets, and problems within a defined environment." (Stufflebeam, 2002, pg 4). Through this the evaluator will be able to determine what the needs of the program are; what resources are currently available, including funding; as well as what the current issues are within the selected population and geographical area. By doing this a baseline can be formed from which the program can be based when examining the process and product. The focus of this program was on the city of Saskatoon though transferability was discussed since 80% of the impacted population lives outside of this city.
For the input component the evaluator would compare other strategies that have been tried, or are being used elsewhere to see the impact that these programs have had. During this time the approach to the current program as well as the cost associated with such practices would be examined to see if it is feasible. In this program the costs would be an incredibly important factor to consider considering the number of specialists and expensive resources (pools, exercise equipment) that are being utilized. Other practices may be found to be just as effective but less costly and more readily available to the general population.
The process would examine what is currently happening and how the program has progressed. Since the program occurred over two years and feedback was taken from the participants this would help to see what impact this feedback had on the improvement of the program (formative). It could also what else could be done.
The final stage evaluates the product and how well the program has followed the purpose and met the needs of the target audience. During this stage the effectiveness of the program is explored and also its ability to be maintained over an extended amount of time. In order for this program to have an impact on the population it would need to be implemented long term and it would also have to have the capability to be adapted in order to be transferred and applied elsewhere. Even though the program is based out of Saskatchewan the concern with diabetes amongst Aboriginal populations is an issue nationally. If the program is successful in Saskatchewan then how can it be implemented elsewhere.
Conclusion
Though many evaluation models would have been effective in analysing the program Stufflebeam's CIPP model takes a comprehensive and detailed approach that provides an analysis to explore the longevity and sustainability of the program. Therefore, in this case it has been determined to be the most effective model to apply.
Klomp, H., Dyck, R., and Sheppard, S. (2003). Description and evaluation of a prenatal exercise program for urban Aboriginal women. Canadian Journal of Diabetes, 27: 231–238.
Stufflebeam, D. (2002, June). Cipp evaluation model checklist: A tool for applying the fith installment of the cipp model to assess long-term enterprises. Retrieved from http://www.nylc.org/sites/nylc.org/files/files/250CIPP.pdf
Stufflebeam, D. L. (2003, October). The CIPP model for evaluation. Paper presented at the Annual Conference of the Oregon Program Evaluators’ Network (OPEN), Portland, OR. Retrieved from https://bblearn.usask.ca/bbcswebdav/pid-874585-dt-content-rid-5409047_2/xid-5409047_2
Stufflebeam, D. (2002, June). Cipp evaluation model checklist: A tool for applying the fith installment of the cipp model to assess long-term enterprises. Retrieved from http://www.nylc.org/sites/nylc.org/files/files/250CIPP.pdf
Stufflebeam, D. L. (2003, October). The CIPP model for evaluation. Paper presented at the Annual Conference of the Oregon Program Evaluators’ Network (OPEN), Portland, OR. Retrieved from https://bblearn.usask.ca/bbcswebdav/pid-874585-dt-content-rid-5409047_2/xid-5409047_2