Creswell 10, Standards of Validation and Evaluation

Alex-

I just saw your comment from my previous Creswell post and thought I would look back at my notes on chapter 10 for a posting ... I guess I missed that one!

Creswell's chapter 10 is on validation and evaluation of information in qualitative research.

What does he mean here? Essentially he is exploring of the role the researcher plays in being truly responsible for the data. This responsibility takes many forms, and the approaches and language used in representing this responsibility differ across the theoretical approaches mentioned by Creswell.

Part of his initial discussion seems to focus on the need for qualitative research to present an understanding of, and commitment to, academic rigor. Information for a study is only important vis-a-vis its relation to the world -- both how was the information collected (where and by whom) and how is it being represented and verified (what is being said and how).

Creswell posits that researchers have an obligation to all sides of these tasks. Methodological approaches are important because they provide the guidelines for validation and evaluation, as well as being tools of verification for the researcher.

Firstly a researcher must begin to understand their own role in the process before anything. This should be articulated for the reader, and in some cases even articulated with the participants. Not only can this provide clarification for the reader, but it also frames the lens from which the researcher is presenting their argument. This illuminates potential compromising situations of power, bias, or ethical dilemma in ways that help frame the findings of the study.

Secondly the researcher must then be certain their method of collection is most appropriate for the study. This can be done in many ways -- considering the advice of other experts, other participants, or by researching relevant literature should all act as guiding principles in deciding what is appropriate for the study. Often the research question itself can be a guide in this process.

The last two items provide a framework of evaluation of the data. This process is both in the actual coding and the subsequent interpretation and re-representation of the data. Creswell states this happens in multiple ways and seems as though it should not be limited to only one or two approaches. Rigor is tested over time -- this process certainly seems as though it could involve a large portion of time for the researcher. Some of this occurs as the researcher seeks saturation in the data, but also through triangulation, member checking, peer review, the use of a cultural ambassador, as well as continued engagement with the literature. It would seem the more voices who are allowed to speak into the process, the clearer it should become for the researcher and therefore the more critical evaluation of the findings can occur. This provides the researcher the ability to affirm findings and also gives the researcher a position of expertise in the area of research.

Certainly other aspects of qualitative research are important, however it would seem to me that a solid qualitative research project in information gathering and design is meaningless should the researcher not carefully consider rigorous validation and evaluation of both the methodological approaches, but also in the findings and presentation of the data.

Faith Integration Reflection

It has taken some time to compose this into a suitable reflection, so I decided to take a little extra time and then post it here on the blog.

While I would not say that the last 2 years have provided a "crisis of faith" period for me, I do believe I have been challenged to consider the integration of faith in my life through new lenses. Partly due to discussions and revelations from my studying, much of this reconsideration has occurred because of life situations I have encountered throughout this journey. While some of these have been specifically personal situations -- the loss of a baby from miscarriage -- or others professional -- the search for new professional roles -- I do not see a great distinction between personal and professional since I see my working world as decidedly personal in its interaction with my personhood.

At times these crises moments cause me to consider abandoning my faith wholesale. Who needs it anyway? Part of me, at times, becomes cynical toward the idea of living as Christ follower, yet I am compelled to reconsider and "try again." It is during these moments of "trying again" where I reaffirm my understanding of faith in action and recommit myself to goals greater than myself. In these times I find myself engaging new challenges of life by reminding myself about the past and my goals for the future. I just cannot envision a future without God -- albeit that future relationship has surely changed!! (Possibly and hopefully it is continually changing).

Qualitative methodology is something with which I struggle. Not only do I find it difficult to frame conceptually and theoretically, I find it strikingly difficult to comprehend practically. Who am I to tell the story of someone else?

Alex keeps saying, "focus on the story of the other." Part of me argues that, in the end, I serve my needs through this work and therefore I am telling my story in a roundabout fashion. Possibly this is researcher bias at work. . .maybe I am just a horrible researcher! This driving philosophy of qualitative research, however, has possibly impacted my faith the most throughout the past semester. It presents the great challenge of story -- telling someone else's story is the gift of qualitative research.

Quantitative research allows me to embrace a true feeling of objectivity, "here are my data, this is what they seem to be telling us." For whatever reason I have been drawn to this approach; this approach is where I feel most comfortable.

Qualitative research means nothing without the voice of the other. The gift of this voice is the foundation of the research. During my work collecting data I continued reflecting on how blessed I felt by sharing in the conversation with my participants. I felt duly inadequate to be the individual with responsibility of providing venue to each of their voices. What a gift to cherish. For a brief moment I have felt God smile upon the participants. Not because anything I am doing or asking is groundbreaking or life-altering, but because I have been provided the gift of receiving these comments -- they were given to me as though I now hold guardianship over them.

Some of this reflection came to light during and shortly after the actual interviews, but it was my manipulation of the data that truly illuminated this reality. As I coded and wrestled with themes in the data I would write the name of the participant next to the code or idea. Through this process I kept saying to myself, "this is Suzie's thought and I have now provided it some kind of tangible permanence." I now have the responsibility of working with this thought appropriately and responsibly.

In a small way this has affirmed for me the importance I have to The Creator. He gives me the freedom of thought and expression. Yet, despite my ability to be of mobile agency, I am under His authority . . . what I know is that his representation and guardianship of my being and thoughts is perfect -- especially where mine is imperfect.

I many not be representing these thoughts in an appropriate or clear manner, however it all comes together to represent my new understanding of qualitative research. Has it altered my orientation toward quantitative research methods? No, but it has illuminated a new world for me and given me an orientation of openness toward other methodologies. It is even possible for me to say I can delight in the qualitative approach (to an extent!).

The most compelling aspect of qualitative research, for me, is the gift of story. The challenge for researchers is to take this story, focus on the fact that it is a gift from the participant, and represent it in a way that affirms who they are and whose they are. What a tremendous task in so many ways!