evaluation use « Evaluation is an Everyday Activity

This will be short.

I showed a revised version of Alkin’s Evaluation Theory Tree in last week’s post. It had leaves. It looked like this: Evaluation theory tree edition 2

It was taken from the second edition of Alkin’s book.

I have had two comments about this tree.

There are few women represented in the tree. (True, especially in the draft version; in version above there are more.)
I was reminded about the Fred Carden and Marvin C. Alkin’s article in the Journal of Multidisciplinary Evaluation, 8(17), January 2012. (There are still more leaves and the global south is represented.)

Continue reading →

Recently, I got a copy of Marvin Alkin’s book, Evaluation Roots (his first edition; eventually, I will get the second edition).

In Chapter Two, he and Tina Christie talk about an evaluation theory tree and presents this idea graphically (all be it in draft form).

Think of your typical tree with three strong branches (no leaves) and two roots. Using this metaphor, the authors explain the development of evaluation theory as it appears in western (read global north) societies. evaluation theory tree

As you can see, the roots are “accountability and control” (positivist paradigm?) and social inquiry (post-positivist paradigm?). Continue reading →

Recently, I drafted a paper about a capacity building; I’ll be presenting it at the 2014 AEA conference. The example on which I was reporting was regional and voluntary; it took a dedication, a commitment from participants. During the drafting of that paper, I had think about the parts of the program; what would be necessary for individuals who were interested in evaluation and had did not have a degree. I went back to the competencies listed in the AJE article (March 2005) that I cited in a previous post. I found it interesting to see that the choices I made (after consulting with evaluation colleagues) were listed in the competencies identified by Stevahn et al., yet they list so much more. So the question occurs to me is: To be competent, to build institutional evaluation capacity are all those needed? Continue reading →

Within the last 24 hours I’ve had two experiences that remind me of how tenuous our connection is to others.

Yesterday, I was at the library to return several books and pick up a hold. As I went to check out using the digitally connected self-check out station, I got an “out of service” message. Not thinking much of it, as I had received that message before, I moved to another machine. And got the same message! So I went to the main desk. There was a person in front of me; she was taking a lot of time. Turns out it wasn’t her; it was the internet (or intranet, don’t know which). There was no connection! After several minutes, a paper system was implemented and I was assured that the book would be listed by this evening. That the library had a back up system impressed me; I’ve often wondered what would happen if the electricity went out for a long periods of time since the card catalogs are no longer available.
Also, yesterday, I received a phone call on my office land line (!), which is a rare occurrence these days. On the other end was a long time friend and colleague. We are working feverishly on finishing a NDE volume. We have an August 22 deadline and I will be out of town taking my youngest daughter to college. Family trumps everything. He was calling because the gardeners at his condo had cut the cable to his internet, television, and most importantly, his wi-fi. He couldn’t Skype me (our usual form of communication)! He didn’t expect resumption of service until the next day (August 20 at 9:47am PT he went back on line–he lives in the Eastern Time Zone). Continue reading →

Wikipedia says the phrase of “dog days” refers to the sultry (read: HOT) days of summer, typically July and August in the northern hemisphere. In Oregon, it is definitely August. It was 100.4 yesterday; 96 the day before. I didn’t sleep well, even with fans and cool evenings (low 60s). This is the hottest summer I’ve experienced in the 16 years I’ve been in Oregon–there were 10 days of hot weather in May, June, and July; and now so far in August. The Dog days are also when the star Sirius can be seen (assuming there is no cloud cover, a common phenomenon in Oregon–if not the winter rainy season, then summer thunderstorms.) Dog days were thought to be when “the Sea boiled, the Wine turned sour, Dogs grew mad, and all other creatures became languid; causing to man (sic), among other diseases, burning fevers, hysterics, and phrensies.” according to Brady’s Clavis Calendaria, 1813 (A Compendious Analysis of the Calendar; Illustrated with Ecclesiastica, Historical, and Classical Anecdotes 2 volumes). Continue reading →

Many of you have numerous lists for summer reading (NY Times, NPR, Goodreads, Amazon, others…). My question is what are you reading to further your knowledge about evaluation? Perhaps you are; perhaps you’re not. So I’m going to give you one more list 🙂 …yes, it is evaluative.

If you want something light: Regression to the Mean by Ernest R. House. It is a novel. It is about evaluation. It explains what evaluators do from a political perspective.

If you want something qualitative: Qualitative Data Analysis by Matthew B. Miles, A. Michael Huberman, and Johnny Saldana. It is the new 3rd edition which Sage (the publisher) commissioned. A good thing, too, as both Miles and Huberman are no longer able to do a revision. My new go-to book.

If you want something on needs assessment: Bridging the Gap Between Asset/Capacity Building and Needs Assessment by James W. Altschuld. Bridging the Gap-altschuld Most needs assessments start with what is lacking (i.e., needed); this proposes that an assessment start with what is present (assets) and build from there, and in the process, meeting needs.

If you want something on higher education: College (Un)bound by Jeff Selingo. college unbound by jeffry selingo The state of higher education and some viable alternatives by a contributing editor at the Chronicle of Higher Education. Yes, it is evaluative.

Most of these I’ve mentioned before. I’ve read the above. I recommend them.

Continue reading →

Recently I came across some old note of mine, from some meeting several years ago. I though it would be useful in my writing so I saved it; actually there were two notes that were similar in content. They both relate to blogging, although at the time I didn’t know I would be blogging.

I lump them all under the title of taking a stand, although stance would probably be more descriptive.

The notes are these:

Know your audience.
Be proactive to anticipate needs.
Be reactive to meet needs.
Be authentic.
Be direct.
Be unapologetic.

Continue reading →

The US has been a country for 238 years. A long time. Perhaps it is an opportunity to reflect on what are the rights, privileges, and obligations of citizenship. Perhaps it is just another holiday. Perhaps it is just a time for blueberry pie and peach ice cream. Perhaps it is a…fill in the blank.

I’m not feeling particularly patriotic. I am feeling very evaluative. Recently I viewed a map indicating that on a US passport an individual could travel to 172 different countries. The only country passports which were more powerful (i.e., able to visit more countries) were UK, Finland and Sweden. I wonder to where (what country) can’t I travel on my US passport? That question requires evidence. That is evaluative. I value my US passport. My girls and I travel with them even though driver’s license would be easier. (Being able to fly to Paris at a Continue reading →

What makes a blog engaging?

We know that blogs and blogging outreach to community members–those who have subscribed as well as those using various search engines to find a topical response.

Do the various forms of accessing the blog make a difference in whether the reader is engaged?

This is not a casual question, dear Readers. I will be presenting a poster at the Engagement Scholarship Consortium in October (which will be held in Edmonton, Alberta). I want to know. I want to be able to present to the various audiences at that meeting what my readers think. I realize that reading evaluation blogs may yield a response that is different from reading blogs related to food, or sustainability, or food sustainability, or climate chaos, or parenthood, or some other topic. There are enough evaluation blogs populating the internet that I think that there is some interest. I think my readers are engaged. Continue reading →

I had a comment about last week’s post on Sustainability and Evaluation. I will share it here. I wonder what you readers think of this comment:

In preventive health/health promotion, ‘sustainability’ has generally been used to indicate that the intervention program, or elements of it, or benefits of it, are continued beyond the life of the funded program. It is about extending the value of the investment in a program, beyond the life of the funded program. So it’s about a legacy, about the continuation of things achieved, about leaving things, circumstances or communities better off than when you first arrived (more empowered, more resourceful, more able to continue improvements on their own).

I wonder how that fits with the definitions I provided? Is this a different sustainability? Does it speak to the future generations? Does that include equity and justice? Continue reading →

Evaluation is an Everyday Activity

Program Evaluation Discussions

Tag Archives: evaluation use

More about the Alkin’s Evaluation Theory Tree

Evaluation theory tree

Capacity building and competencies

Evaluation and the electronic age

Dog days of summer

Summer Reading

Taking a stand

Tomorrow is July 4th

I want you to tell me…

Wednesday’s musings

Contact Info