Evaluation deals with public information and involves the engagement of many different communities. When our work requires we access these communities , we have the responsibility to be professional, use valid methods and share current information. To assist in this effort the American Evaluation Association developed the Guiding Principles for Evaluators to provide an ethical framework within which evaluators should provide services to the public. They are also meant to foster discussion about promising practices and encourage continuing development in the profession.

The Guiding Principles for Evaluators are:

 Systematic Inquiry
 Competence
 Integrity/Honesty
 Respect for People
 Responsibilities for General and Public Welfare
(See Leah’s August 20th blog for more details on each principle).

At the Improve Group we have discussed these principles and endeavor to use them in a proactive way as we conduct our business. They keep us focused on veracity in our research and maintaining a transparent and open process with our clients.

We would encourage everyone who has had, or is planning to invite evaluators to work with their organization to read the detailed explanation of each of the principles and the context in which they were established. They can help you think about what to expect when working with an evaluator and understand why they make some of the recommendations they do.

Posted by admin at 02:44 PM | Permalink | Comments (0) | TrackBacks (0)

Welcome to Research Tidbits, a new monthly feature on the Inside Groove blog. Research Tidbits will highlight useful tips we’ve learned through the years at the Improve Group.

Recently, Marian and I wrote an article on successful transitions in the K-12 education system that will be featured in our forthcoming Fall 2007 company newsletter. While doing some background research on this topic, I was delighted to find that I could download academic articles for free through my membership at the Minneapolis Public Library. This meant that I was able to access a number of academic journals, such as the American Journal of Evaluation, Evaluation & the Health Professions, and Evaluation Review, right at my desk! Any Minneapolis resident with a library card and a password can access these free resources online; however, non-members must go to the library to access them.

Another free resource available to Minnesotans (with a library card) is the Electronic Library for Minnesotans (ELM). Patrons log in with a library card number (no password is needed) and have access to a number of peer-reviewed journals, as well as newspaper and magazine articles. For those without a library card, ELM also shows you how to contact your nearest library.

Although the resources I’ve mentioned are specific to the Minneapolis and Minnesota Public Library systems, I encourage you to contact your local library to see what free resources are available for research. Like me, you might just be surprised at what you find!

Posted by Guest author at 03:14 PM | Permalink | Comments (0) | TrackBacks (0)

Last weekend I watched Minnesota State Fair visitors with physical challenges traverse the fairgrounds with relative ease thanks to wide doorways and ramped sidewalks. I am aware that Minnesota is known for its many health care facilities and its research into health care issues. We are often sighted prominently in those “healthiest places to live lists”. It is not always clear in the list criteria whether this also means a healthy environment for those with disabilities. The following funder wants to honor those places making the effort to be more ‘user-friendly’ to all of their inhabitants.

This week’s pick: The National Organization on Disability (NOD) is asking mayors and city officials to nominate their city for the efforts they make in adopting best practices and concepts in disability programs, services and initiatives. To enter the 2007 Accessible America awards competition use the official application and have it signed by either the mayor or chief elected official of your town. The application should detail how your city or town “provides opportunities for citizens with disabilities to participate fully in community life.” Entries should be postmarked by October 31, 2007 and the winning town will receive a cash prize of $25,000.

Bonus pick: As an avid gardener who currently lives in an apartment and sighs whenever spring comes and there is no dirt to play in I couldn’t help but highlight this opportunity. The National Gardening Association (NGA) Healthy Sprouts Award supports schools and organizations who will be planting a garden in 2008. There must be at least 15 gardeners between the ages of 3 and 18 participating. Twenty awards will be given out and they include gift certificates, seeds and nutrition education information. The application deadline is October 15, 2007. See their web site for more information.

Posted by admin at 01:53 PM | Permalink | Comments (0) | TrackBacks (0)

Eric Wong received a notice from a friend in St. Louis County about an upcoming conference in Rochester, MN (Oct. 22-23). The Midwest Government Performance Conference aims to give government staff some tools for thinking about performance in new ways.

Posted by admin at 04:01 PM | Permalink | Comments (0) | TrackBacks (0)

We have recently witnessed a lot of events challenging people’s capacity to be real heroes. The folks who ran to help at the moment of the 35W bridge collapse and the miners working tirelessly toward their trapped comrades display inspiring acts of heroism. These actions are grand and visible and we all feel gratitude towards those who are strong enough to embrace them. But, there are countless other heroes who do things every day that make a major change in people’s lives. The funder I am highlighting is a well-known corporation that has set aside money to reward those who dedicate themselves to the benefit of others by the deeds they do that seem second nature to them.

This week’s pick: The Volvo Life Awards of the Volvo automobile corporation looks to honor everyday heroes making a positive change for others. Awards are given in four categories:

o Two awards are made to individuals making valuable contributions to society in the areas of safety, quality of life, and the environment,
o One Butterfly Award is is selected, recognizing child heroes (age 16 and under),
o One “America’s Greatest Hometown Hero” grand winner is chosen from the two quality of life finalists.

The Butterfly Award winner receives $25,000 for the charity of his or her choice and the two quality of life winners receive $100,000 for their charities. The Grand Award winner receives a new Volvo every three years for life. Awardees also take part in a Volvo for life Award documentary and receive a trip to New York City as the awards ceremony guests of honor.

To learn more details about nominating and about the online public voting go to the Volvo Awards website.

Posted by admin at 01:26 PM | Permalink | Comments (0) | TrackBacks (0)

A reminder to all of our friends, colleagues and clients that the Improve Group office will be closed on Wedneday, August 22 for our annual retreat. We use the day-long retreat each year to reflect on the previous years accomplishments and challenges, find ways to make our work better, and learn a new skill. We'll blog later about what we learned in the past year.

We'd love to hear your organization's retreat stories (good bad and ugly!) please feel free to send them via our comments.

Posted by admin at 03:55 PM | Permalink | Comments (0) | TrackBacks (0)

The American Evaluation Association (AEA) recently re-worked the Guiding Principles for Evaluators. These principles are the ethical foundation of our work. The AEA rightly notes that these principles are meant to inform but cannot account for every possible situation and that occasionally the principles come into conflict with each other.

We recently used the AEA guiding principles at a staff meeting to talk about how they guide our work. We examined many recent projects, including our work with the Minnesota Department of Human Services, the Northwest Minnesota Council of Collaboratives, and the Girl Scouts.

The principles follow, along with some example questions that evaluators can ask when using the principles to inform their work:

Systematic Inquiry: How are methods of participant selection important to the credibility of an evaluation? What about methods of data collection?

Competence: How can you decide what dimensions of competence are relevant for an evaluation? What is cultural competence and how will you know its presence?

Integrity/Honesty: How might the idea of integrity or honesty affect different stages of the evaluation?

Respect for People: What are major ways of showing respect for people in an evaluation context?

Responsibilities for General and Public Welfare: Are there limits to an evaluator’s responsibilities for general and public welfare?

Posted by admin at 03:45 PM | Permalink | Comments (0) | TrackBacks (0)

On Friday many of us got to attend one of the most lovely wedding ceremonies we've been to -- thanks to Becky Stewart and Meleck Davis. The couple planned a fabulous surprise - a musical parade by the entire wedding party! We felt really lucky to be included.

Congratulations to the happy couple!

Pictured here from left to right are: Brooke Ahlquist (Improve Group alumna), Liz Radel, Susan Murphy, the groom Meleck Davis, the bride Rebecca Stewart, Marian Kimball Eichinger, Leah Goldstein Moses and Deborah Mattila.

Posted by admin at 03:34 PM | Permalink | Comments (0) | TrackBacks (0)

Last May I spent one hectic afternoon trying to find a care clinic to take my 7-year old who was holding his arm after a fall on the school playground. Every nearby center we stopped at was closed for an hour or so until the evening shift began. We eventually got in and discovered my son had a fractured arm. Even with the inconvenience I felt lucky I had choices and insurance to cover part of the cost. Thinking back on it, I wondered how people cope in rural areas or places that are simply underserved. Even with insurance a trip to a care clinic can be extremely expensive. Hopefully, the grant source I am showcasing today can lend a hand to those clinics who need additional resources for providing affordable health care to their communities.

Today’s pick: The Healthier Minnesota Community Clinic Fund is an independent foundation that provides “grants to safety net providers throughout Minnesota to continue, improve, expand, or develop new essential services; upgrade and support the infrastructure of the community clinic system; and improve community clinics' interaction with the rest of the healthcare system.” The foundation’s fund is currently accepting proposals for its 2008 Traditional Community Clinic grant category. The foundation funds proposals improving provision of direct primary care clinical services, program or project development, and capital projects.

There is a standard application form which must be submitted by September 5th to be considered. Grants of up to $300,000 in up to three-year grants will be available to the 2008 grant period. Visit their website to learn more.

Posted by admin at 02:34 PM | Permalink | Comments (0) | TrackBacks (0)

A while ago I blogged about qualitative and quantitative data, and promised a Dilbert comic when I received permission to use it. Well, here it is:

DILBERT: © Scott Adams/Dist. by United Feature Syndicate, Inc.

Posted by admin at 12:54 PM | Permalink | Comments (0) | TrackBacks (0)

Mashup Roundup

As a former geography and current library and information science student, I have a special interest in maps and their use for displaying and generating information. I am particularly interested in how programmers and end users combine Google Maps with other programs or data sets into mashups; a mashup is a hybrid of data from more than one source or program into a new application. Google Map mashups are interactive, or customizable, thematic maps that tend to answer very specific questions (Can I really dig a hole to China? Answer at: http://map.talleye.com/bighole.php) or contain frequently updated, user-submitted content (What are random people around the world doing right now? Answer at: http://twittervision.com/) to produce a real-time map.

One of my current favorite mashups, www.mapthecandidates.com lets you track the campaign stops of all Democrat and GOP candidates, starting in July 2007, with links to related articles or videos. What I find most impressive about this site is how easy it is to use the interactivity tools to create a map that is the most interesting and relevant to the user. You can use this site to track specific candidates, to look at a particular state or region, and to look at a specific day or time-span. For example, I found that Republican candidate Mitt Romney spent my wedding anniversary campaigning at a number of events in New Hampshire, including at a house party in Salem.

Posted by Guest author at 08:46 AM | Permalink | Comments (0) | TrackBacks (0)

From our Participant Primer series, you'll learn about what it is like to be a participant in interviews, focus groups, observations, or program/administrative data collection.

A common practice at the Improve Group is to also include participants in the design of our research and evaluation work. We like to hear from community members, people who attend programs, and staff:

1) what they hope to learn from an evaluation
2) what is the best method for collecting data
3) any logistical issues we should be aware of in collecting data
4) how they would like to receive information or reports about the evaluation and its results

Recently, I traveled to Mo Ranch near Hunt, Texas to meet with Hispanic Scholarship Fund staff and Peer Counselors (Peer Counselors are college students who are matched with high school students for mentoring and to share information about college). The purpose of the meeting was to ask the group of 19 young adults about their evaluation questions and what they hope to gain by being Peer Counselors. We had a great discussion that will help us as we develop surveys and focus groups for the evaluation.

In my drive from San Antonio to Hunt, TX, I was startled to come across Stonehenge (see below).

A quick Internet search led me to the following amusing articles in Roadside America and Texas Twisted.

Posted by admin at 01:12 PM | Permalink | Comments (0) | TrackBacks (0)

A few years ago someone (I can't remember who it was to give them proper credit!) suggested that the National Association of State Boards of Education was a good resource for education data, information and legislation. I became a member and have been very pleased with the variety of information available on a range of topics from school improvement to nutrition in cafeterias.

The following was the content of a recent email titled "bill watch" - it listed all of the recent bills introduced in the U.S. Senate and House.

** Senate Bills Introduced **

S 1159 (Hagel, Nebraska) introduced the “IDEA Full Funding Act” to amend Part B of IDEA to provide full Federal funding of that part.
S 1167 (Harkin, Iowa) introduced the “Legal Aid Attorney Loan Repayment Act” to amend the Higher Education Act of 1965 in order to provide funding for student loan repayment for civil legal assistance attorneys.
S 1185 (Bingaman, New Mexico) introduced the “Graduation Promise Act of 2007” to provide grants to States to improve high schools and raise graduation rates while ensuring rigorous standards, to develop and implement effective school models for struggling students and dropouts, and to improve State policies to raise graduation rates. I think this is also co-sponsored by Senator Kennedy (Massachusetts).
S 1194 (Dodd, Connecticut) introduced the “No Child Left Behind Reform Act” to improve NCLB.
S 1199 (Wyden, Oregon) introduced the “Nanotechnology in the Schools Act” to strengthen the capacity of eligible institutions to provide instruction in nanotechnology.
S 1217 (Boxer, California) introduced to enhance the safety of elementary and secondary schools, and institutions of higher learning.
S 1228 (Durbin, Illinois) introduced the “Campus Law Enforcement Emergency Response Act of 2007” to amend Section 485(f) of the Higher Education Act of 1965 regarding law enforcement emergencies.
S 1231 (Reed, Rhode Island) introduced the “Preparing, Recruiting and Retaining of Education Professionals (PRREP) Act” to amend Part A of Title II of the Higher Education Act of 1965 to enhance teacher training and teacher preparation programs.
S 1232 (Dodd, Connecticut) introduced the “Food Allergy and Anaphylaxis Management Act of 2007” to direct the Secretary of Health and Human Services in consultation with the Secretary of Education to develop voluntary policy managing the risk of food allergy and anaphylaxis in schools, to establish school-based food allergy management grants.
S 1236 (Murkowski, Alaska) introduced the “School Accountability Improvements Act” to amend the Elementary and Secondary Education Act of 1965 regarding highly qualified teachers, growth models, adequate yearly progress, Native American language programs, and parental involvement.
S 1241 (Grassley, Iowa) introduced to amend the IRS Code of 1986 to clarify student housing eligibility for the low-income housing credit.
S 176 (Clinton, New York) introduced this resolution congratulating charter schools and their students, parents, teachers and administrators across the U.S. for their ongoing contributions to education.
S 1261 (Cantwell, Washington) introduced the “Montgomery GI Bill for Life Act” to amend Title 10 and 38 of the US Code to repeal the 10-year limit on use of the Montgomery GI Bill’s educational assistance benefits.
S 1262 (Enzi, Wyoming) introduced the “Student Loan Accountability and Disclosure Reform Act” to protect students receiving student loans.
S 1278 (Hagel, Nebraska) introduced the “Veterans and Survivors Employment and Training Act of 2007” to amend Title 38, US Code, to expand the scope of programs and education for which accelerated payments of educational assistance under the Montgomery GI Bill may be used.
S 1294 (Durbin, Illinois) introduced the “Homeland Security Education Act” to strengthen national security by encouraging and assisting in the expansion and improvement of educational programs in order to meet critical needs at the elementary, secondary and postsecondary levels.
S 1302 (Kennedy, Massachusetts) introduced the “Keeping Parents and Communities Engaged [PACE] Act” to amend Title V of the Elementary and Secondary Education Act of 1965 to encourage and support parent, family, and community involvement in schools; to provide needed integrated services and comprehensive supports to children; and to ensure that schools are centers of communities for the ultimate goal of assisting students to stay in school, become successful learners, and improve academic achievement.

** House Bills Introduced **
HR 1994 (McKeon, California) introduced to provide more transparency in the financial aid process and to ensure that students are receiving the best information about financial aid opportunities.
HR 2004 (Petri, Wisconsin) introduced the “Higher Education for Freedom Act” to establish and strengthen postsecondary education programs and courses in the subjects of traditional American history, free institutions, and Western civilization available to students preparing to teach these subjects and to other students.
HR 126 (Engel, New York) introduced supporting the goals and ideals of the Day of Silence with respect to discrimination and harassment faced by lesbian, gay, bisexual and transgender individuals in schools.
HR 2017 (Holt, New Jersey) introduced to provide access and assistance to increase college attendance and completion of part-time students.
HR 2023 (Tancredo, Colorado) introduced to establish a student loan forgiveness program for members of the Sudanese Diaspora to enable them to return to southern Sudan and contribute to the reconstruction effort of southern Sudan.
HR 334 (Miller, North Carolina) introduced a resolution supporting the goals and ideals of National Community College Month.
HR 2063 (Lowey, New York) introduced to direct the to direct the Secretary of Health and Human Services in consultation with the Secretary of Education to develop voluntary policy managing the risk of food allergy and anaphylaxis in schools, to establish school-based food allergy management grants.
HR 2070 (Udall, Colorado) introduced to amend Part A of Elementary and Secondary Education Act of 1965 regarding adequate yearly progress and assessments.
HR 2073 (Kennedy, Rhode Island) introduced to increase the number of well-trained mental health service professionals, including those in schools, who provide clinical mental health care to children and adolescents.
HR 344 (Boustany, Louisiana) introduced this resolution congratulating charter schools and their students, parents, teachers and administrators across the U.S. for their ongoing contributions to education.
HR 2087 (DeLauro, Connecticut) introduced to improve the “No Child Left Behind Act of 2001.”
HR 2111 (Holt, New Jersey) introduced to amend the Elementary and Secondary Education Act of 1965 to establish a partnership program in foreign languages.

Posted by admin at 12:41 PM | Permalink | Comments (0) | TrackBacks (0)

Last Monday Leah and I presented a session on community engagement at the Minnesota Council of Nonprofits’ Leadership Conference. MNCN was very successful at putting together this extremely well-attended event aimed at bringing tools and training on Network Leadership - Connecting Individuals, Organizations and Communities to nonprofit leaders.

After visiting with our session participants I saw a great deal of enthusiasm around acting upon lessons learned that day coupled with a concern for how they could fund the changes that would help them to improve their outreach. This reminded me of that long-standing need for grants for capacity building and organizational effectiveness. I decided the best funder to highlight is one that has been an institution in Saint Paul and who really seems to know what the non-profits need to keep progressing with their missions.

Today’s Pick: The Otto Bremer Foundation founded in 1944 has a great interest in allowing all people opportunities to participate within their communities for the improvement of those communities. The Foundation has a number of funding categories but the area I am focusing on today is their Organizational Effectiveness Program (OEP). The Foundation accepts proposals for Organizational Effectiveness throughout the year and funds the following:

• Assessment and self-assessment tools
• Board development/governance
• Long-term strategic planning
• Human resources, including staff training and development; volunteer support and retention;
• and/or personal sytems development
• Financial planning and management of financial/accounting systems
• Organizational restructuring
• Program evaluation/measuring results
• Utilization of technology (Does not include the purchase of computers and related hardware or software.)

Proposals may be in the format of your choice. The amount to request is also open keeping in mind The Otto Bremer Foundation prefers making a number of smaller grants. More details on what to include in your application can be found on the OEP page of their website.

Posted by admin at 09:12 AM | Permalink | Comments (0) | TrackBacks (0)

Over the last week, the Improve Group has shared information at the request of the Minnesota Council of Foundations and the Minnesota Council of Nonprofits.

Last Wednesday (Aug. 1), Leah spent three hours talking with local foundations about evaluation at the August session of the Effective Grantmaking series. Interestingly, she had just met with a program officer from a local foundation and had a lively debate about the ethics of grantmakers evaluating programs -- how much do agendas and priorities change when a major funder evaluates their efforts? There was also an article in the New York Times (registration required) talking about what happens when major philanthropic initiatives are evaluated to lukewarm (or strikingly negative) results.

The participants in the workshop seemed equally concerned with the practical aspects of evaluation - how do you get people to give you data, how do you ask questions that get at the information you need, and how do you target some funds for evaluation work when the foundation has a mandate to invest in direct-service organizations. We talked through some pragmatic tools (such as using an on-line survey to supplement or replace grantee annual reports) and the formality of evaluation required at different funding and investment levels.

Yesterday (Aug. 6), Susan and Leah presented at the Minnesota Council of Nonprofits Network Leadership Conference about community engagement. Key among their messages was that engagement shouldn't be too difficult, but does take time and yes, money. The results of community engagement should be better programs, more support for new or changing initiatives, and a better sense of community needs. Despite having the dreaded after-lunch time slot, over 70 people attended the session and had great insights to share with their colleagues, including: (1) don't assume that because you are interested in something, others will be too; (2) you will continue to see the rewards of engagement years later when your community sees you as a leader on a specific issue; and (3) tap into youth or local experts to help you with something that feels intimidating (such as blogging!)

We are considering expanding the community engagement presentation into a larger workshop as part of the Improve Group's workshop series. Is this a topic that interests your organization? Let us know!

Posted by admin at 08:07 AM | Permalink | Comments (0) | TrackBacks (0)

Hi to all of our friends outside of the Twin Cities who might be thinking of the Improve Group today! We checked in with all of our staff last night and got in touch with almost everyone. The bridge that collapsed is part of Marian's commute home, but she wasn't nearby at the time. All the rest of us commute different ways.

We feel really sad and at a loss today. I still feel like I don't know much about what happened, what the scale of the tragedy is, etc. I'm anxious to hear from friends and colleagues who commute north to south or vice versa, so please drop us an email or phone call if you get a chance.

Posted by admin at 06:54 AM | Permalink | Comments (0) | TrackBacks (0)