Filed Under (program evaluation) by Molly on 30-09-2014

Recently, I drafted a paper about a capacity building; I’ll be presenting it at the 2014 AEA conference. The example on which I was reporting was regional and voluntary; it took a dedication, a commitment from participants. During the drafting of that paper, I had think about the parts of the program; what would be necessary for individuals who were interested in evaluation and had did not have a degree. I went back to the competencies listed in the AJE article (March 2005) that I cited in a previous post. I found it interesting to see that the choices I made (after consulting with evaluation colleagues) were listed in the competencies identified by Stevahn et al., yet they list so much more. So the question occurs to me is: To be competent, to build institutional evaluation capacity are all those needed? Read the rest of this entry »

Filed Under (program evaluation) by Molly on 25-09-2014

Over the last several months, the Local Arrangements Working Group has been blogging at AEA365. One of ways evaluators can get ready for the upcoming annual conference is to read what the LAWG has to say about the conference. This year, the conference is once again in Denver. AEA was in Denver in 2008. Be forewarned–Denver is the mile high city. The air is rarefied and very dry. It may snow!

The LAWG has a lot to say about the conference and there are A LOT of links in these posts that are worth checking.  For those who have not been to AEA before or for those who have recently embraced evaluation, reading their posts are a wealth of information, as is the AEA website.

I will be presenting at two sessions this year–one on blogging (duh…) and one on capacity building. I see them related. I will also (like last year) be assisting with a professional development session (number 25) with my long time friend and colleague, Jim Altschuld. The professional development session occurs on Wednesday, October 15, 2014 from 8:00am MT – 3:00pm MT. It is titled Practical Ways to Link Needs Assessment (NA) with Asset/Capacity Building. (Just a little advertisement 🙂 ) It will draw from his new book, Bridging the Gap Between Asset/Capacity Building and Needs Assessment. Bridging the Gap-altschuld Read the rest of this entry »

Filed Under (criteria, program evaluation) by Molly on 19-09-2014

I’ve just spent all of August and most of September editing chapters for a volume of New Directions in Evaluation (NDE) on Accreditation, Certification, and Credentialing. These topics all relate to competencies which all relate to building capacity. Now I can site a lot of references for competencies. (For example, Stevahn, King, Ghere, Minnema, 2005, AJE 26(1), pp. 43-59., among others see the work by King and cadre–that one cited just happens to be on my desk right now.) This group has been working on competencies for the last 15 or so years. This is important work–as well as problematic (hence the issue of NDE). I won’t go into details here because the NDE volume pretty much addresses these issues from a variety of perspectives. We (my co-editor, Jim Altschuld and I) have assembled (what I think is) a  stellar collection of writers who have good ideas. Editing an issue of NDE (again) was a valuable experience for me: I learned again why I don’t write the definitive text on anything; I learned again how important Accreditation, Certification, and Credentialing are; I am reminded how complicated it is to assemble a list of competencies that adequately capture what is an evaluator; and I am once again humbled, recognizing that cynicism does not come with the territory–it is acquired.

Now, a bit on competencies and why they are important. Read the rest of this entry »

Filed Under (program evaluation) by Molly on 11-09-2014

This summer I spent a lot of time dealing with needs assessments and talking about needs and assets. It occurred to me that the difference between need and wants has a lot to do with evaluation (among other things). So what are needs? What are wants? How does all this relate to evaluation?


Maslow spoke eloquently about needs in his hierarchy, and although the hierarchy is often presented as a pyramid,Maslow's_hierarchy_of_needs.svg Maslow didn’t present the needs this way. He did present this hierarchy as a set of building blocks with basic needs (physiological) as the foundation, followed by safety, loving/belonging, esteem, and self-actualization. He talks about this theory of motivation in his book, Motivation and Personalitymaslow's motivation and personality (a 3rd edition is available as well). This view of the individual ushered in the humanistic view of psychology (often called the third theory after behaviorism and psychoanalysis). He believed that human could not live without these needs and advocated that they are necessary for survival.


A “want” is often considered a desire based purely in economic, social, or  psychological reality of human existence. It is something that an individual would like to have. (Chocolate, any one?) A want is not essential to human existence; it is only something an individual would like to have. Unfortunately, there are limited resources (as well as a large body of literature) talking about having enoughenough is enough. If you have enough, then wants are few and resources are available for everyone.

Read the rest of this entry »

Filed Under (Methodology, program evaluation) by Molly on 05-09-2014

I just finished a chapter on needs assessment in the public sector–you know that part of the work environment that provides a service to the community and receives part of its funding from the county/state/federal governments. Most of you know I’ve been an academic for at least 31 years, maybe more (depending on when you start the clock). In that time I’ve worked as an internal evaluator, a program planner, and a classroom teacher. Most of what I’ve done has an evaluative component to it. (I actually earned my doctorate in program evaluation when most people in evaluation came from other disciplines.) During that time I’ve worked on many programs/projects in a variety of situations (individual classroom, community, state, and country). I find it really puzzling that evaluators will take on evaluation without having a firm foundation on which to base those evaluations. (I know I have done this; I can offer all manner of excuses, only not here).

If I had been invited to participate in the evaluation at the beginning of the program, at the conceptualization stage, I would have asked if a needs assessment had been done and what was the outcome of that assessment. Was there really a lack (i.e., a need); or was this “need” contrived to do something else (bring in grant money, further a career, make a stakeholder happy, etc.)? Read the rest of this entry »