Accountability

Background

Independent evaluation at the IMF: Role, recent work and future agenda

21 April 2017 | Minutes

Presenters:

Charles Collyns, Director, IMF Independent Evaluation Office (IEO)

Ruben Lamdany, Deputy Director, IMF Independent Evaluation Office (IEO)

Moderator: Luiz Vieira, Bretton Woods Project

Summary:

This session will focus on the IMF’s Independent Evaluation Office’s (IEO) work in strengthening accountability and learning at the Fund. The speakers will explain the IEO’s mandate and governance structure, highlight some of the main achievements in the 16 years of IEO evaluations, and lay out the current work program. Participants will have the opportunity to provide feedback on how well the IEO has achieved its objectives and make suggestions on the IEO’s future agenda.

Moderator – Introduction

·        Thank IEO for initiative and for reaching out to civil society partners – we agree that CSO input into the IEO’s work programme is quite useful.

·        This initiative seems particularly timely given the IMF’s recent changes in rhetoric, if not perhaps policy focus on inequality, gender, labour and the dysfunctional state of the international tax regime.

Mr. Collyns:

New to the IEO – three months.

Introduction to IEO.

Established in 2001 as a result of aftermath of Asian Crisis – Need for objective evaluation. Broad mandate – strengthen IMF’s capacity to support global stability.

Not an auditor, or inspection general – assess degree to which IMF accomplishes objectives. IEO has a strategic rather than tactical focus.

Tasks:

1. Support executive board – extremely busy – useful to have a longer-term perspective.

2. Improve learning culture – suffers from institutional inertia – introduce external ideas. Need to better benefit from external views.

3, Strengthen external legitimacy: Increase transparency and information. Bring in outside views into the Fund.

Governance:

Independent of management and staff. Staffed largely from outside Fund, with some seconded staff.

Director is appointed by the Board – however arms length relationship.

IEO have access to virtually all information. Staff are compelled to speak with IEO. There were some challenges with this during European evaluation. Fallout from the issue has resulted in reaffirmation of fundamental pillar. Establishing a new information-sharing protocol.

Periodic five-year evaluation of IEO.

Some reports have not had expected results. Independent budget – 0.5% of IMF’s administrative budget – however strategic mandate allows for impact.

Bank of England and France are considering similar arrangements.

Aim to liaise with external agents on topic selection. Very important decision.  Once topic is selected, issue paper is launched. Recent financial surveillance concept note is out– comments are welcome.

Current evaluation – Social protection – try to also speak with affected populations.

Report goes to the Board for discussion. Board will endorse or not recommendations. Up to management to develop implementation plan.

Subsequent monitoring function of implementation plan.

Mr. Lamdany:

Reports are available. Views are particularly welcome at development stage of issues paper – prior to report. Encourages input into reports – Inputs unfortunately remain quite limited to date.

New initiative – looking back at previous themes. Less than 10% of previous, initial report. Provides a sense of impact of previous work.

Also has a newsletter.

Few hundred lessons and recommendations – which can be broken down into six general themes:

1. Lack of guidance and oversight

2. Organisational silos – difficult to integrate insights

3. Insufficient attention to risks – uneven – insufficient in developed markets and overly cautious in developing economies

4. Insufficient country specificity – in most countries 1 person – in larger countries up to three

5. Need for even-handedness in analysis and advice across countries – countries are either feel or are treated differently

6. Significant degree of group-think. Fail to see alternative perspectives.

These will always be a perennial struggle for the Fund.

85% of recommendations were endorsed by the Board – in majority of these that has been some action.

25% of 85% there is sufficient action to move on. 25% little to no action.

Fund eliminated structural compliance criteria based on IEO recommendation.

Fund is working to make data more useful, also resulting from recommendation.

Working with Executive Board to do a triage of recommendations.

Two external evaluations to date. Next panel is being created.

Mr. Collyns:

Current work programme:

Three evaluations are ongoing – Social protection responding to increased attention on vulnerable groups, including workers. Macro-critical. Report nearly complete. Board will discuss during the summer.

2. Fragile states – evaluation is just now beginning

3. Financial surveillance – has IMF improved its ability to identify risks? Concept note is now posted. Seeking comments.

Beginning to look beyond these evaluations – limited in capacity, must be selective. Menu of options will be posted.

Issues that remain outstanding:

Some inaction – due to over level of detail

Issues around management of the institution remain challenge.

Recommended that staff remain involved in the same country for three years to deepen understanding. No apparent action

Recommendation of quota reform – for a while recommendation was not implemented.

IMF – Research and policy disjuncture – many times research is not particularly robust – Fund must act quickly.  Fund is not a research institution. In some cases advise to countries can be quite shallow – eg, social protection. Research is in its infancy. Difficult to contextualise research and policies.

ITUC:

Question about the process:

Consultation on stakeholders – has had very limited contact with IEO – represent 181 million workers. Some evaluation area have had massive impacts on workers. What criteria are used for selection.  Support recommendation for additional outreach.  Also no follow-up after discussion on social protection. At times reports miss key areas.

Topics for future consideration – IMF involvement in labour-market reform.

New Rules for Global Finance:

Social protection – any mention of climate issues?

NSW University:

Question of enven handedness – any chance to revisit issue?

IEO: Social protection does not cover climate change – although the Fund is stepping up its work in the area.

Key to balance continued focus with new macro-critical areas.

New policy for even-handedness – in its surveillance – countries can bring attention to these areas. However work remains to be done in loans/ programme situations.

Sorry that it has not reached to ITUC more frequently – consultations are done principally by paper. Will be sure to improve consultation. Face-to-face events will remain limited.

Honduras – Transparency Honduras – Inter-american convention against corruption. Issue concerning IMF role in financial transparency.

Evaluation – HIPC at that time debt was at 2%, now debt has once again ballooned.

Human Rights Watch – IEO – military expenditures . A: no, very difficult to assess military spending. Suggest that CSOs push the Fund to look into the area.

Reports are evidence-based – perhaps only place to raise the issue would be in fiscal expenditure report.

 

More background on this issue

Accountability

Background

27 September 2017 | Inside the institutions

The Parliamentary Network on the World Bank and IMF

This Inside the Institutions looks at how the Parliamentary Network on the World Bank and IMF has facilitated interactions between members of parliament and the Bank and Fund.

Rights

Background

18 April 2017 | Minutes

World Bank Inspection Panel - emerging lessons on environmental assessment

Notes from a meeting at the IMF/World Bank 2017 spring meetings launching the third report in the Inspection Panel's new series on "emerging lessons", on environmental assessment.

Accountability

Background

27 September 2017

Follow BWP’s coverage of the World Bank and IMF annual meetings

The World Bank and IMF’s annual meetings will be held on 13-15 October 2017 in Washington DC, the Civil Society Policy Forum will take place from 9-13 October. Check for updates on Bretton Woods Meeting Dispatch page.

Accountability

Background

21 April 2017 | Minutes

Independent evaluation at the IMF: Role, recent work and future agenda

Notes from 2017 World Bank and IMF spring meetings session of IEO and its future work programme,

IFI governance

Background

31 January 2017 | Inside the institutions

The World Bank’s Independent Evaluation Group

This Inside the Institutions looks at the World Bank's Independent Evaluation Group, including how it is structured and the different elements of the evaluation process.

Rights

Background

20 November 2015 | Minutes

UK civil society meeting with Minister of State Desmond Swayne

Notes from a meeting on 7 September 2015 between the Minister of State of the UK Department for International Development (DFID) and civil society representatives, focusing on the World Bank's safeguards review.

IFI governance

Background

10 October 2014 | Minutes

UK civil society meeting with UK World Bank Executive Director Gwen Hines

Notes of a meeting with World Bank executive director Gwen Hines in October 2014.

IFI governance

Background

12 April 2014

An overview of the World Bank Group's new country engagement model

Trade

Background

11 April 2014 | Minutes

The future of Doing Business

IFI governance

Background

11 April 2014

What does real accountability mean in practice?

Accountability

Background

11 April 2014

Compliance Advisor Ombudsman (CAO) and dispute resolution process

IFI governance

Background

10 April 2014 | Minutes

CSOs - Inspection Panel meeting and discussion

Rights

Background

10 April 2014 | Minutes

Smart assessment: Capturing and managing human rights risks

IFI governance

Background

9 April 2014

IFC – Dinant and lessons learned

IFI governance

Background

8 April 2014

CSO roundtable with World Bank Group executive directors

Rights

Background

7 April 2014

Multilateral Development Banks & human rights: Issues, challenges, opportunities

Rights

Background

17 May 2013 | Minutes

Notes of IFC-CSO discussion of CAO financial markets audit

IFC has responsed to a letter from a number of NGOs sent to President Kim. These notes are from a 19 April 2013 meeting at IFC headquarters in Washington DC.

UK

Background

9 October 2008 | Minutes

Highlights: Meeting of UK NGOs with UK Alternate Executive Director to the World Bank

Meeting between UK NGOs and UK Alternate Execituve Director to the World Bank Caroline Sergeant on 5 September 2008.

IFI governance

Background

30 September 2008 | Minutes

UK NGO meeting with the Secretary of State for International Development, on the World Bank

Summary of meeting: the main agenda items were (1) World Bank governance; and (2) Climate change.

Accountability

Background

22 June 2006 | Items

Inspection Panel

Established in 1993, the Inspection Panel was created to address the concerns of those who are affected by Bank-funded projects and to ensure the Bank adheres to its operational policies throughout its projects. The three panel members are elected by the Bank's executive board to serve non-renewable five-year terms, but remain independent of Bank management. The current chairperson is Edith Brown Weiss; the other current members are Tongroj Onchan and Werner Kiene.

Latest articles on this issue

Accountability

News

CSOs await Guidance Notes for new Bank safeguards

Tier 1 Guidance Notes, outlining implementation of the new Environmental and Social Framework, could be published at the end of October.

27 September 2017

Accountability

Background

Follow BWP’s coverage of the World Bank and IMF annual meetings

The World Bank and IMF’s annual meetings will be held on 13-15 October 2017 in Washington DC, the Civil Society Policy Forum will take place from 9-13 October. Check for updates on Bretton Woods Meeting Dispatch page.

27 September 2017

Accountability

Background

The Parliamentary Network on the World Bank and IMF

This Inside the Institutions looks at how the Parliamentary Network on the World Bank and IMF has facilitated interactions between members of parliament and the Bank and Fund.

27 September 2017 | Inside the institutions

Infrastructure

Commentary

Landmark community dialogue in Nepal: Is the World Bank learning?

Following longstanding conflict over a World Bank-funded power line project in Nepal, dating back to 2009, communities express hope that a World Bank-supported dialogue initiative will result in a fair dispute resolution process and meaningful consultation.

22 May 2017

Environment

News

IPN calls for improved supervision of environmental assessments

IPN launched third Emerging Lessons Series report on the environmental assessment of World Bank projects at the IMF and World Bank spring meetings.

3 July 2017

Accountability

News

CAO opens case in Chile on World Bank project Alto Maipo

In March CAO found a complaint on behalf of communities affected by IFC’s investment in the Alto Maipo hydroelectric project in Chile eligible for further assessment.

3 July 2017

Accountability

News

Civil society calls for greater independence of Inspection Panel

In April, Civil Society Organisations (CSOs) wrote a letter to the World Bank executive directors calling for the inclusion of independent external stakeholders on the selection committee of the Inspection Panel.

3 July 2017

Accountability

News

IEO request for input in future evaluations

The IMF’s Independent Evaluation Office (IEO) is requesting input on topics for its future evaluations.

3 July 2017

Accountability

Background

Independent evaluation at the IMF: Role, recent work and future agenda

Notes from 2017 World Bank and IMF spring meetings session of IEO and its future work programme,

21 April 2017 | Minutes

Rights

Background

World Bank Inspection Panel - emerging lessons on environmental assessment

Notes from a meeting at the IMF/World Bank 2017 spring meetings launching the third report in the Inspection Panel's new series on "emerging lessons", on environmental assessment.

18 April 2017 | Minutes