Systematic Evaluation Study Overview

Introduction

Evaluation study is referred as the systematic assessment of overall research process, design, objectives, data collection procedures and finding and analysis of a research study by using relevant evidences. This study is going to make critical analysis of qualitative evaluation of Saleema campaign, a campaign conducted to eliminate Female Genital Mutilation (FGM) and cutting in Sudan. Saleema campaign had been launched during 2008, by National Council of Child Welfare (NCCW) and UNICEF Sudan in support of protecting girls from FGM. The aim behind conducting this campaign was not only to protect girls from this brutal social practice but also to promote strict abandonment of this practice at the community level. Furthermore, those seeking healthcare dissertation help may find valuable insights in evaluating such impactful campaigns, as they highlight the importance of community engagement and the effectiveness of awareness initiatives in health promotion.

This evaluation study is going to make critical discussion of the design, methods, data collection process, finding and analysis process of the Saleema initiatives in terms of evaluating that whether researcher is able to meet all the criteria that are associated with accomplishing a successful research. Additionally, this evaluation study will also critique the ethical aspects in Saleema initiative to analyse that whether the researcher followed all ethical guideline while conducting the study. Finally, the study will conclude that whether the researcher of this Saleema initiatives has successfully met desired objectives.

Ethical Considerations

How ethical issues were addressed in the study, starting with seeking approval from the relevant ethics Review board, followed ethics relating to individual participants involved in the study. This study obtained consent from all participants the approved by George Washington University Institutional Review Board.

In conducting any successful research study, it is important for researcher to follow all the ethical guidelines in terms of maintaining authenticity as well as validity of database (Ryen, 2016). From the overall analysis of Saleema initiative. It can be stated that, researcher have successfully conducted the most important ethical aspects of any research study, the informed consent. As mentioned by Bracken-Roche et al. (2017), informed consent is most important in maintaining ethical values of any research in which the researcher takes full consent from participants regarding their participation in data collection process. In Saleema campaign evaluation study the overall data collection method proves that participants have made their voluntary participation in this research study. Therefore, it can be stated that, researcher have successfully taken informed consent from each participant before participating into data collection process. On the contrary Battiste (2016) argued that, researcher not only assure to get informed consent of participants but also the researcher needs to assure that all the participants would be provided with clear purpose and aim of this data collection process. In this evaluation study, researcher has provided clear information about aims and objectives of data collection method before participation of each participants, that enhance the overall validity and ethical values of this researcher.

Another important ethical aspect that researcher needs to follow is that the data collection process would be bias-less and discrimination free. In this evaluation study, researcher has selected both male and female households from 18 state of Sudan, which eliminate the chances of any type of gender bias. On the contrary Bracken-Roche et al. (2017), argued that, not only gender bias, but also there may be other kind of bias in an evaluation study such as inequality in accessing facilities or advantages that is also needs to be eliminated. In this context, this evaluation study is successful in protecting the overall data collection process from any kind of discrimination and inequality which is proved from systematic collection of databases from each respondent and treatment of each participant with proper respect and dignity.

Concerning the Evaluation Study being a critique, ethical approval was mentioned, and the study was approved by the University Board. In this context Bracken-Roche et al. (2017) argued that, ethical approval of a research study is not only associated with whether the researcher is able to meet all ethical aspects , but also with whether the researcher is able to maintain authenticity and transparency of the entire process till the end of this research process. Here in the Saleema campaign evaluation, the overall research method is organised and conducted in systematic and trustworthy manner. The researcher got the final ethical approval from University Board and UNICEF. In addition to this, the researcher also ensures that the entire research is conducted with maintaining proper confidentiality and privacy. Therefore, in this context it can be stated that researcher has successfully meet the criteria of getting proper ethical approval from ethics committee and university board.

There was no question raised about the truthfulness and knowledge generated. Maybe, the study was conducted as a "Health Audit" which are studies conducted to assess service improvement, including Surveillance. According to research, the Saleema group in Sudan, used the posters, in the campaign to create more awareness and Surveillance, however using the message in the posters instead. There are relevant criteria containing the Research Ethics committee standard operating procedure (Health research Authority 2016).

An Overview Qualitative Research Design and Critique

This section presents an overview and critique of the research design used in the study, that is Qualitative research design, definition included.

As mentioned by Creswell and Creswell (2017), a research design is set of procedures, techniques and tools that are chosen and used by a researcher in terms of meeting research objectives and answering research questions. Qualitative research design is an umbrella term that refers to various research methodologies including ethnography, phenomenology, action research, discuses analysis and grounded theory that use textual and /or visual rather than numerical data to explore meaning and perspective of phenomena. In this evaluation study, quasi-experimental research design is used that is clearly mentioned by the researcher. This study has successfully described different procedures and techniques that are used in terms of conducting entire research such as intervention, research design, statistical analysis, measurement and instrument, data collection and results. On the contrary Leavy (2017), in a successful research study, the researcher needs to clearly discussed what type of research design, philosophy, approach and data collection methods is used by the researcher. In the context, although the evaluation study is able to discuss the overall research techniques and procedures in systematic manner, it is somehow unable to justify the reason behind selecting quasi-experimental research design. Through analysing overall research design in this evaluation study, it can be stated that the quasi-experiment research design is helpful for researcher to make proper qualitative research on Saleema campaign’s initiatives. In this evaluation study, the research is able to investigate and collect the relevant database from the respondents successfully and apply them into the practice to meet research outcomes. On the contrary Creswell and Creswell (2017), argued that, sometimes, quasi-experiment research study is relevant more to make statistical analysis of collected database rather than making theoretical discussion. In this context, it can be stated that in the evaluation study, although the researcher is able to make proper statistical analysis of database collected from respondent, researcher failed to make comprehensive theoretical discussion of database on FGM, that makes a huge literature gap in this evaluation study. In this context, the interviews are more frequently conducted face to face, groups such as focus groups. (Holloway and Wheeler, 2002) Refer grounded theory data saturation as a point where they claim no new information will arise from further sampling. Horne and Darbyshire (2005) suggested that some researchers use the concept of data saturation as convenient stopping point, and it may be irrelevant or impertinent to assess if the work or study being evaluated is achieved or not.

On this note, the qualitative research did not think about community feeling or seek to address how it will affect them abandoning their last FGM practice. Thus, qualitative research explains to the people all the consequences after circumcision, like acute inflammation, accumulation of menstruation, difficulties in given a baby and other. The researcher chose qualitative research because is naturalistic inquiry, can give more details of FMG, Pilkington (2002) suggested that because qualitative method is aimed at understanding of human experiences and ultimately developing the theory. Whereas quantitative studies are concerned with the generalization and reproducibility of findings.

An Overview and critique of the sample & Data Collection methods

Research participants are the four focus groups within 18 states in Sudan. Participants were presented with three poster stimuli from the Saleema and were asked about the content and their reaction. The choice by the evaluators to recruit Saleema groups is justified because all the group were chosen within the States presenting each community. The group was presented with three posters, on this note, it is not written that group contributed in the making of the poster, they were only asked about the content and their reaction, although they had positive opinions to the branding elements in the posters and the campaign as a whole. Incentives offered to the participants to motivate them to carry out the campaign was not reviewed or mentioned in the study.

Sample: Research Participants.

Saleema Campaign Evaluation study has selected four focus groups from each 18 states of Sudan with toral 72 participants. Researcher has ensured that all the ethical values are followed during selecting sample population. In this selection method, both the male and female households from 18 states Sudan have been selected which ensure that there I no gender bias in sample selection. Here each participant has been provided with three posters from Saleema campaign and asked for the content as well as participant’s reactions. From analysing the overall sample selection process of Saleema evaluation study it can be stated that the overall selection is highly relevant with research aims, as sample included both the male and female households from Sudan. Through using both the reaction of females and male households on Saleema campaign posters it was possible for the researcher to analyse what are the community reaction and current social perspectives about FGM and cutting in Sudan. Here the entire selected sample successfully represent the entre community in Sudan, based on which researcher is able to conclude that what is the current intention of the community regarding this malpractice, FGM and how this inhuman practice can be abolished from the society. Focus group questions were designed using the conceptional framework drawn from prevalent health behaviour theories. Specifically, this included health Branding theory, e.g. Brand, equity and social marking principles. E. G. Product, price, place, promotion. This structure sought to assist in organizing suggestions around message content, channels for delivering target populations, and methods of promotion for greater receptivity. On this note, it mentions that there was a conceptional framework drawn from health behaviours. I.T. is also know that all the focus groups were recorded, transcribed, and translated by a team from Ahfad university from Arabic to English. The step was completed by a UNICEF staff member in Sudan.

The report indicated that, the Government developed a national campaign in Sudan, called Saleema, to change social norms discouraging FGM. They are four main types of FGM, ranging in severity from type 1 to IV, FGM prevalence is highest in 27 countries, Africa, and the Middle East. In Sudan, FGM is highly prevalent among all age groups of girls and women, with a national prevalence rate of 87%, but there decline among the younger age cohorts (age 25 and below and 52% of women believe the practise should stop. The world health organization (WHO 2000) and other global health development organization supported that is harmful practice should be stopped. On this study, other countries are not included. It can be argued that the campaign took place in Sudan due to the high rate of 87%. The report did not explain the type 4 FGM practice, maybe because it is more in another country, which is potentially biased.

Data collection Method: Individual interviews

An in-depth interview is structure encounter between researcher and research participant to elicit or bring out information during a conversation (Carter and Henderson 2007) In the evaluation focus groups were asking the question about the campaign, which is the form of continued awareness. During their discussion, was the social marking principals, where the advocacy, training and posters were suggested to highlight the harms of FGM through leader’s community.

The posters were able to explain, more about the campaign of FGM. The in-depth nature of interviews allows researchers to explore fully may be the factors underpinning participants answer or opinions, feelings and beliefs. It also allows the researcher to observe the body language and facial expression. The UNICEF staff member in Sudan ensures that all focus groups were recorded and transcribed and translated in English. Besides, in-depth interviews in the evaluation study were appropriate because it enables the researcher to together information in the language that will have participants can have their voice. Their main aim is to focus on changing norms and preventing FGM by way of choice and community cohesion. Johnson et al. (2018) everybody is now aware of FGM due to the campaign all over, people attitude changed towards FGM. One of the community ladies said when she attended the workshop, almost half of the states "individual "mentioned to be engaged with the campaign and promote the Saleema messages.

Additionally, an individual outline that" education is the foundation and it is essential to raise their daughters in a right way, to be decent, Saleema, educated and understanding in other to lead the society and help their people”. IN teams of understanding, findings show that participants demonstrated their understanding of FGM as a breach of human rights and directly violence to women. There is increasing awareness of health implications, mental health issues, fear, lack of confidence among women. In the Saleema groups, men and young people participated, have witnessed the health implication with their partners, and want to protect their daughters. "Participants said that messaging should hight light the harms of FGM or compare people who were circumcised versus who is not, it can be argued that men are not directly affected, and men can use FGM to control women.

In-depth interviews are used in place of focus group if potential Participants are not comfortable talking openly in the group, and it also provides much more detailed information, e.g. The Saleema posters capture the full spectrum of the campaign because of detailed information. In Addison, the focus group can make jokes in the form of communication or storytelling in the sessions, which would not be recorded. Some of the group suggested that there is a light of limitations. The study presents qualitative results only and may be subject to selection bias. However, the sampling strategy utilized mitigated this issue to an extent (Johnson et al. (2018).Of course, with such a sensitive topic, there could be a bias, with the results for those that felt uncomfortable to discuss FGM in front of others or more confident in their interpretation of the posters.

Evaluation Study Reporting Standard

The evaluation report achieves an excellent reporting standard, but one focus groups are missing, and the results are cross-sectional. Consequently, they do not represent perceptions over time.

There are also potential drawbacks to the focus groups being coded with individuals not living in Sudan, yet the transcripts were translated by individuals who are bilingual in Sudan. There was also a coding question that arose regarding the specific wording and culture. Generalizability of the results outside of Sudan and other localities was limited in scope according to the study.

On a positive note Saleema group campaign, change people opinions towards FGM and targeted older women and individuals in a rural village. Overall, the campaign standard of the Evaluation study required more honesty and openness in other areas, such as how the Saleema groups were recruited was not determined, in presenting the posters for the campaign.

Conclusion

This critique began by ethical approval and consent to the participant, the study obtained written consent from all participants, but the study indicated that consent for publication is not applicable and that all quotes are de-identified. The study design and collection, interpretation of data was not analysed to the participant and the interpretation data, all were writing in the manuscripts.

On a positive note, FGM was a sensitive topic, and some people felt comfortable now discussing FGM in front of others. The three posters represented common themes designed for the Saleema campaign with bright red and green colours; the participant was able to compare and express their feelings in the posters. For example, the first poster said" I am not afraid of change, second eliciting interpretations of strength and choice, the 3rd poster conveying change of FGM norms. The posters capture the full spectrum of the campaign; the focus group, the participatory approach gave more voice to the community.

Suggested that the evaluation study was well analyses, connecting to the aim of the study. The author has done well as the participant felt and promise that continuing campaign efforts will decrease the harms of FGM in Sudan.

References:

Battiste, M., 2016. Research Ethics for Chapter Protecting Indigenous Knowledge and Heritage. Ethical futures in qualitative research: Decolonizing the politics of knowledge, 111.

Beauchamp T., and Childress J. (2001) principles of Biomedical Ethics. 5th edn. Oxford University Press, Oxford

Bracken-Roche, D., Bell, E., Macdonald, M.E. and Racine, E., 2017. The concept of ‘vulnerability’in research ethics: an in-depth analysis of policies and guidelines. Health research policy and systems, 15(1), p.8.

Burns N., and Grove S. (1999) Understanding Nursing Research.2nd.edn. WB Saunders, Philadelphia

Carolyn B. (2006). Conducting in-depth interview; A guide for Designing and

Carter, S. and Henderson, L. (2007): Approaches to qualitative data collection in social science. In Bowling, A and Ebrahim, S(eds) Handbook of Health Research methods: Investigation Measurement and Analysis: Maidenhead: Open University

complications of female genital mutilation including sequelae in child birth: a

conductional In-depth interviews for Evaluation Input.

Creswell, J.W. and Creswell, J.D., 2017. Research design: Qualitative, quantitative, and mixed methods approaches. Sage publications.

Fossey E, Harvey C, McDermott F, and Davidson L (2002) Understanding and evaluating qualitative research. Aust N Z J Psychiatry 36(6): 717-32

Genital mutilation and cutting in Sudan.

Holloway I, Wheeler S (2002) Qualitative Research in Nursing. 2nd edn. Blackwell, Oxford

Jackson N. and Walter E. (2002). Evaluating studies in public health Intervention

John, C., A ., Douglas, W.,E., Barrett, N., Badri, H., Abdalla, T. and Donahue, C.

John, C., Douglas, W., E., Barrett, N., Badri, h., Abdalla, T. and Donahue, c. Available at:

Koch T (2006) Establishing rigour in qualitative research: the decision trail. J Adv Nurs 53(1): 882-90

Kotch T, Harrington A (1998) Reconceptualising rigour: the case for reflexivity. J Adv Nurs 28(4): 882-90

Leavy, P., 2017. Research design: Quantitative, qualitative, mixed methods, arts-based, and community-based participatory research approaches. Guilford Publications.

Pilkington, F. (2002) Scientific merit and research ethics. Nurs Sci Q 15(3): 196-200.

Polit D, Beck C (2006) Essentials of Nursing Care: Methods, Appraisal and Utilization. 6th edn. Lippincott Williams and Wilkins, Philadephia

Ryen, A., 2016. Research ethics and qualitative research. Qualitative research, 3, pp.31-48.

Smith, L .(1992) Ethical issues in Interviewing. J Adv Nurs 17(1): 98-103

Smith, L .(1992) Ethical issues in Interviewing. J Adv Nurs 17(1): 98-103

Thorne, S. Darbyshire, P. (2005) Land mines in the field: a modest proposal for improving the craft of qualitative health research. Qual Health Res 15(8): 1105-13

UNICEF (2013). Female genital mutilation/cutting: a statistical overview and

Vishnevsky ,T. Beanlands, H. (2004) Qualitative research. Nephrol Nurs J 31(2): 234-8

World Health Organization (2000), Department, Women and health. Health