Evaluation lessons - Define universal project outcomes

Vivienne Riddoch, Regeneration & Renewal, 9 March 2009

Project: People and Places programme.

Period of evaluation: 2008.

Evaluating organisation: Wavehill Consulting.

Evaluation commissioned by: Good causes distributor the Big Lottery Fund (BLF).

Aims and outline of project: Launched in 2005, the £66 million People and Places scheme is the largest BLF programme in Wales. The initiative aims to enable the development of strong communities, social justice and local environments. It is demand-led, with applicants defining their own priorities and the needs they wish to address.

KEY LESSONS

The key lesson from the evaluation is that the programme's demand-led approach has created a number of challenges. This means that an unusually diverse range of projects are funded, the report says. While this can be viewed as positive, it makes it hard to assess outcomes on a programme-wide basis, it says. A set of core desired outcomes and indicators should therefore be established in order to assess projects.

While the programme is open to applicants across Wales, its demand-led nature does not guarantee that funding reaches areas with most need, the report concludes. It urges the BLF to consider using a more formal analysis tool, such as the Welsh Index of Multiple Deprivation, as well as looking at why there are a greater number of successful applications from certain areas. The report also notes that many grants go to established bodies and facilities rather than new ones.

The demand-led approach is also staff- and time-intensive, particularly because there are so many applications to assess, and the report therefore recommends that the additional costs of using this approach be kept under review. Many recipients commented on the long time it took to process applications, but the evaluation acknowledges that a robust appraisal system is essential to a demand-led approach.

The report highlights three benefits of the local community being involved in the planning and running of projects in various ways, such as by volunteering and representation on steering groups. These are that it allows projects to access local knowledge, generates greater interest in projects and improve projects' sustainability. The fact that the community stands to benefit from schemes is a strong motivator for involvement. More than half the projects surveyed were already enjoying positive community outcomes, including improved facilities, skills, health and wellbeing.

- Evaluation of the People and Places Programme Annual Report 2008 - Final Report is available via www.regen.net/doc

Contact us. Do you know of an evaluation report with important lessons for other regeneration professionals? If so, contact Adam Branson on adam.branson@haymarket.com