Tender document of a consultancy for the final evaluation for the Healthcare Aid for Syrian Refugees Project in Jordan, October 2021

Islamic Relief Worldwide

Islamic Relief is an international aid and development charity, which aims to alleviate the suffering of the world's poorest people. It is an independent Non-Governmental Organisation (NGO) founded in the UK in 1984.

As well as responding to disasters and emergencies, Islamic Relief promotes sustainable economic and social development by working with local communities - regardless of race, religion or gender.

Our vision:

Inspired by our Islamic faith and guided by our values, we envisage a caring world where communities are empowered, social obligations are fulfilled and people respond as one to the suffering of others.

Our mission:

Exemplifying our Islamic values, we will mobilise resources, build partnerships, and develop local capacity, as we work to:

Enable communities to mitigate the effect of disasters, prepare for their occurrence and respond by providing relief, protection and recovery.

Promote integrated development and environmental custodianship with a focus on sustainable livelihoods.

Support the marginalised and vulnerable to voice their needs and address root causes of poverty.

We allocate these resources regardless of race, political affiliation, gender or belief, and without expecting anything in return.

Islamic Relief Worldwide (IRW) has consultative status with the UN Economic and Social Council, and is a signatory to the International Red Cross and Red Crescent Code of Conduct. IRW is committed to the Sustainable Development Goals (SDGs) through raising awareness of the issues that affect poor communities and through its work on the ground. Islamic Relief are one of only 14 charities that have fulfilled the criteria and have become members of the Disasters Emergency Committee (www.dec.org.uk)

IRW endeavours to work closely with local communities, focussing on capacity-building and empowerment to help them achieve development without dependency.

Please see our website for more information http://www.islamic-relief.org/

Islamic Relief Jordan

Islamic Relief began working in Jordan in 1997, with an orphan and child welfare programme. We remain committed to serving those in need in Jordan, providing emergency aid and helping them to establish livelihoods so that they can increase their food security and reduce their dependence on aid.

Jordan has one of the highest numbers of refugees per capita in the world, and welcomes millions of people from countries including Syria, Iraq, Yemen and Palestine, who are now living in camps and host communities. The country currently hosts 1.3 million Syrians, accounting for more than 10 per cent of Jordan’s total population. This places huge pressures on education, health, housing and water.

The Covid-19 pandemic has exacerbated socioeconomic challenges for everyone, refugees and host communities alike. Over a third of Syrian refugees lost their source of income amidst the pandemic, leaving them struggling to pay rent or buy food. The strict ongoing lockdown has resulted in the Covid-19 crisis increasing poverty by around 38 per cent among Jordanians, and by 18 per cent among Syrian refugees. Women, girls and other vulnerable groups are bearing the brunt of the situation. Over 50 per cent of adolescent girls reported they are doing more household chores as a result of the pandemic and the lockdown measures.

IR Jordan has specialised teams and departments in place for humanitarian aid and early recovery assistance, health support, shelter and winter survival, food security, education, livelihoods, water, sanitation and hygiene, and child sponsorship and protection.

Project background

Addressing refugees' healthcare needs is an important priority in the relief effort in Jordan and other countries hosting Syrian refugees. Thousands of Syrian refugees who fled for their safety have suffered from a wide range of health issues and face ongoing health access and affordability challenges. Islamic Relief Jordan launched the Healthcare Aid for Syrian Refugees project to enhance access to healthcare services for Syrian refugees in Jordan.

The phase 1 of this project started in October 15, 2017 and shall end on the 15th of October 2021.

Project Impact:

Reduced mortality rate and improved health situation for the Syrian refugees and poor Jordanians families in Jordan

Project outcomes:

1. Improved health conditions for the targeted beneficiaries in Jordan through mobile health facility

2. Improved quality of life and access to healthcare services of the targeted population

Project outputs:

1.1: 30,000 beneficiaries in Jordan benefited from quality primary healthcare services through 2 mobile clinics.

1.2: Enhanced health knowledge through awareness sessions provision for 1000 beneficiaries in Jordan during project duration.

2.1: Improved access for secondary and tertiary healthcare for 610 beneficiaries in Jordan during the project period

Project Components

Target number of patients

Primary healthcare via 2 mobile health clinics 30,000

Secondary and tertiary care intervention through contracted hospitals ** 610

Haemodialysis services for refugees at the contracted hospitals 10 patients for 36 months

Health awareness raising 1,000

Major Activities:

· Project preparation, procurement and tendering, contracting hospitals, prepare a list of medications, beneficiaries and location selection, etc.

· Conduct an assessment on the most important health topics that need to be highlighted among the society

· Provide treatment and medical examination for the targeted beneficiaries in the targeted areas via mobile health clinics.

· Provide secondary and tertiary care intervention through contracted hospitals for 600 beneficiaries

· Coverage of the hemodialysis services for ten refugees in 36 months at the contracted hospitals at different locations of Jordan.

· Conduct supportive activities to reach out to more beneficiaries with high-quality service (e.g. free medical days, volunteer doctors, etc.)

· Contact other NGOs, CBOs, and individuals to help gather people to have awareness sessions

· Distribution of healthy materials according to the need and the topic discussed in the sessions

IR Jordan is implementing this project across the following locations Ramtha, Mafraq, Jarash, Amman, Irbid, Ajlun, Karak, Ma’an, Tafilah and other areas across Jordan. The evaluator will focus on primary and secondary health care, health awareness, and capacity building for the final evaluation. In addition, it will focus on the overall project and programme level.

Objectives of the evaluation

This evaluation has been commissioned by Islamic Relief Worldwide (IRW) in line with agreed internal policies (IR MEAL framework) and external policies of the donor. The purpose of this evaluation is to assess overall performance of the project with reference to the outcomes and outputs as well as draw lessons for future programme. This evaluation should take into consideration the OECD/DAC Evaluation Criteria to assess the performance of the project, as well as use the Core Humanitarian Standards (CHS) to evaluate the quality of the interventions and the aspects of accountability.

The following objectives can be considered for the final evaluation for the Healthcare Aid for Syrian Refugees Project in Jordan. The specific objectives of this assignment are to:

· Evaluate the appropriateness of the project interventions, approaches, and methodology.

· Assess the effectiveness and relevance of mobile clinics, services and equipment transfer for the mobile clinics

· Evaluate the efficiency, effectiveness & impact of the project in light of the overall project goal, specific objective, and results

· Assess the value for money considerations in relation to each component of the project, considering economy, efficiency, effectiveness and equity.

· Assess the socio-economic changes/effects in the lives of targeted households as a result of project interventions and the impact of any changes arising due changes or implementation of government policies related to health.

· Evaluate the sustainability of project results, impact, and approach at different levels (household level, community level, and organization level).

· Examine the effectiveness and impact of mainstreaming issues, including gender, protection, disability, child rights, etc.

· Identifying lessons learned and good practices of the project to inform both IRW and IR Jordan's future health response and the wider humanitarian health sector in a similar context.

Evaluation criteria and questions

The evaluation should respond to the following evaluation questions and any others deemed appropriate by the evaluation team, supported by evidence, triangulated data and views of key project participants and relevant wider stakeholders.

Relevance:

· Was the design of the intervention relevant and appropriate to the wider context?

· Is the intervention in line with the needs and highest priorities of the most vulnerable groups (women, men, boys and girls)?

· Is the intervention design and objectives aligned with the priorities of the government and overall health sector and health cluster strategy?

· Did the design and implementation of the intervention consider and build on available local capacities?

· Was the design and implementation of all interventions age, gender and disability-sensitive?

· Are services geographically and socio-culturally accessible and financially affordable to those most in need?

· Who is excluded from services or are there any differences in access within or between different populations?

· Does the host population have access to the services, and why or why not? What are the implications of this for these populations and the health and nutrition service providers?

Coherence:

· To what extent were context factors (political stability/instability, population movements, etc.) considered in the design and delivery of the intervention?

· How are interventions being conducted with relationship to the Jordan national health system (supportive or done in parallel)?

· To what extent was IRW’s intervention coherent with policies and programmes of other stakeholders and service provider operating within the same context?

· To what extent was the intervention design and delivery in line with health and humanitarian principles?

· What have been the synergies between the intervention and other IR Jordan interventions?

Efficiency

· What were the alternative options and was the intervention and key components of the project cost-efficient considering alternative options?

· Was the intervention and key components of the project implemented efficiently compared to alternatives?

· Did the targeting of the intervention result in an equitable allocation of resources?

· Was the intervention implemented in a timely way?

Effectiveness:

· Were relevant technical and quality standards for health interventions in a humanitarian context followed and met?

· How do interventions and programs compare against health quality standards, as defined in national and/or international guidelines (WHO, Sphere, etc.)?

· Were (are) the planned outputs and outcomes achieved? Were these appropriate and meaningful?

· What major factors influenced the achievement or non-achievement of the outcomes?

· Were there any unintended (positive or negative) outcomes arising from the intervention for participants or non-participants?

· Is the achievement of outcomes leading to/likely to lead to achievement of the project’s overall objective?

· What major factors influenced, supported or hindered this?

· Were results delivered equitably for men, and women, boys and girls, person with disability and from different age groups?

Impact:

· What were the long lasting or transformational effects of the intervention on participants’ lives (intended and unintended)?

· Did a specific part of the intervention achieve greater impact than another?

· Were there any age, disability or gender-specific impacts?

· Did the intervention influence the gender context?

· Are there any positive or negative, intended or unintended, effects or long-lasting impacts at the individual, institutional or wider health systems level?

· Have or should any components of the project be replicated or scaled-up by others?

· Did the intervention contribute to long-term intended results?

Sustainability:

· To what extent did the intervention implementation consider sustainability, such as capacity building of national and local government institutions, communities and other partners?

· To what extent were the various interventions sustainable, providing on going benefit to individuals and communities beyond the project time period?

· How long will these benefits realistically continue for without additional support?

· Were environmental consideration, relevant to the interventions, adequately factored into the design of the project?

In addition, IRW is a certified CHS agency and therefore uses the CHS standards as an overarching framework to assess the quality and accountability of programmes and to complement the DAC criteria when undertaking evaluations. We believe this can be integrated with the DAC criteria in the following way:

Relevance

· CHS Commitment 1: Humanitarian response is appropriate and relevant.

· CHS Commitment 4: Humanitarian response is based upon communication, participation, and feedback

Effectiveness

· CHS Commitment 2: Humanitarian response is effective and timely.

· CHS Commitment 5: Complaints are welcomed and addressed.

· CHS Commitment 8: Staff is supported to do their job effectively, and are treated fairly and equitably.

Efficiency

· CHS Commitment 2: Humanitarian response is effective and timely.

· CHS Commitment 9: Resources are managed and used responsibly for their intended purpose.

Coherence

· CHS Commitment 6: Humanitarian responses are coordinated and complementary.

Sustainability

· CHS Commitment 3: Humanitarian response strengthens local capacities and avoids negative effects.

Impact

· CHS Commitment 3: Humanitarian response strengthens local capacities and avoids negative effects

· CHS Commitment 6: Humanitarian responses are coordinated and complementary.

· CHS Commitment 7: Humanitarian actors continuously learn and improve.

The evaluation should consider CHS 9 commitments while presenting findings on relevant DAC criteria e.g while presenting analysis on ‘Effectiveness’ the evaluator should be able to reflect on whether or not feedback and complaints mechanisms contributed in fulfilling needs of patients, if not, then why not.

Methodology and approach

We would like the evaluators to outline their proposed methodology and requirements for this consultancy – allowing for a maximum of 20 working days. The consultant should consider appropriate quantitative and qualitative methods, in the design of their evaluation methodology. The overall evaluation should also assess the extent of rights holders (beneficiary) involvement throughout the project cycle.

We are looking for an evaluation consultant/team to meet the above objectives and scope through a mixed method (quantitative and qualitative) approach, including but not limited to:

· Desk review of secondary data and IRW project documentation

· Feedback surveys with statistically representative sample (with a minimum 95% confidence level and 10% margin of error) of project participants/patients stratified for each output area:

o A): 30,000 Mobile primary health clinic patients

o B): 610 Secondary care/tertiary care patients

o C): 10 Haemodialysis patients

o D): 1,000 Health awareness recipients

· FGD with communities and rights holders – with proportionate sampling

· Key informant interviews with IR staff, peer agencies operating in the health sector, public and private health service providers and technical health agencies, WHO/UN health cluster leads, and government health authorities (local and national)

· Facilitating and documenting a half-day lesson learned workshop on the project (up to 20 participants), to inform the evaluation report and any phase 2 interventions. Participants would include IR Jordan project team members and appropriate external project stakeholders at a suitable location if Covid-19 safe or shall be undertaken using remote methods. [The cost of the workshop (venue hire if required), excluding the consultant’s time, will be covered separately and should not be included in the consultancy budget].

Required competencies

The successful team will have the following competencies:

· Possess sectoral experience and knowledge in evaluating primary and secondary health care, public health, health awareness in humanitarian settings.

· Demonstrate evidence of experience in evaluating humanitarian and/or development action

· Possess knowledge and practical experience of using quality standards such as Core Humanitarian Standard (CHS) and Sphere Health Standards

· Possess strong statistical/quantitative and qualitative research skills

· Be able to fluently communicate in English and the local languages (Arabic). If local translators are required, this should be budgeted.

· Have excellent written skills in English

· Have the legal right to travel to and within Jordan and be able to conduct evaluations in respective country.

The chosen evaluation team or consultant will be supported by IRW Programme Quality (PQ) team, the IRW Regional team and IR Jordan’s senior management, MEAL and project team.

Project outputs

The consultant is expected to produce:

1. A detailed work plan and inception report, to be approved by IRW, setting out the detailed methodology, schedule and deliverables prior to commencing the field study.

2. A Covid-19 risk assessment with proposed mitigation measures related to conducting this evaluation, setting out different contingencies in case of challenges to the evaluation due to Covid-19 or other issues.

3. A full report with the following sections:

a) Title of Report: Final evaluation for the Healthcare Aid Project for Syrian Refugees in Jordan, 2021

b) Consultancy organization and any partner names

c) Name of person who compiled the report including summary of role/contribution of others in the team

d) Period during which the review was undertaken

e) Acknowledgements

f) Abbreviations

g) Table of contents

h) Executive summary – Max 4 pages including summary of recommendations and overview of projects and key findings

i) Main report – max 30 pages – (The consultant is invited to propose a suitable report structure layout)

j) Annexes

· Lessons learned report compiled from the facilitated lessons learned workshop

· Terms of reference for the review

· Profile of the review team members

· Review schedule

· Documents consulted during the desk review

· Persons participating in the review (designations only - names anonymised)

· Additional key overview tables, graphs or charts etc. created and used to support analysis and inform findings

· Bibliography

1. Anonymised copies of all data collected in Excel or appropriate format which would enable cross-checking and any additional analysis.

2. A presentation of draft findings will be made by the consultant remotely to IRW Programme Quality team, Regional Desk and IR Jordan team

3. Subsequent to final report, the consultant will present key findings and recommendations and facilitate a learning workshop with IRW (programme quality, MEAL team, head of region, desk coordinators/officers, technical advisors) and relevant staff of IR Jordan. Please allow for a maximum of 2 hours for this session.

4. A further presentation would need to be made to IRUSA (project donor) on the overall findings and key recommendations. Please allow for a maximum of 90 minutes for this session

The work plan, inception report, draft report, final report, presentations, etc., and communication language with IRW International Office must be in English.

Timetable and reporting information

The evaluation is expected to run for a maximum of 20 working days, starting by the 23rd November 2021 and ending before the 20th of January 2022 January 2022

Below are tentative dates to be confirmed by the consultant at inception report stage.

Date

Description

Responsibility

26^th October 2021 Tender live date IRW

15^th November 2021 Final date for submission of bid proposal Consultant

15^th – 16^th November 2021 Proposals considered, short-listing and follow up enquiries completed IRW

17^th – 22^nd November 2021 Consultant interview and final selection (+ signing contracts) IRW

23^rd – 24^th Nov 2021 Meeting with the consultant and agree on an evaluation methodology, plan of action, working schedule IRW

24^th – 1^st Dec 2021 Review of documentation, preparation of tools, initial discussion with IRJ and submission of Inception Report – with all evaluation tools for review (at least 5 days before commencing the evaluation) Consultant

1^st - 3rd Dec 2021 Feedback and finalisation of the Inception report IR Jordan/IRW

6^th – 16^th December 2021 Evaluation including Quant and Qual Field Data collection/Lessons workshop Consultant

16^th - 22^nd December 2021 Analysis of evaluation quantitative and qualitative data, and submission of the first draft (including all collected data in anonymised manner) to IR Jordan/IRW for comments. Consultant

23^rd December 201 Initial Presentation of Findings Consultant

6^th January 2022 IRW/IR Jordan office responses to draft report. IR Jordan/IRW

11^th January 2022 Final report submitted to IRW Consultant

17-20^th January 2022 (TBC) Final Presentation with IR key stakeholders (2 hours * 2) Consultant

Reporting information;

Contract duration: Duration to be specified by the consultant

Direct report: Programme Impact & Learning Manager

Job Title: Consultant; Final evaluation for the Healthcare Aid for Syrian Refugees Project in Jordan, 2021

The consultant will communicate in the first instance with and will forward deliverables to the IRW Programme Quality team.

Proposal to tender and costing:

Consultants (single or teams) interested in carrying out this work must:

a) Submit a proposal/bid, including the following;

i. Detailed cover letter/proposal outlining a methodology and approach briefing note

ii. CV or outline of relevant skills and experience possessed by the consultant who will be carrying out the tasks and any other personnel who will work on the project

iii. Example (s) of relevant work

iv. The consultancy daily rate

v. Expenses policy of the tendering consultant. Incurred expenses will not be included but will be agreed in advance of any contract signed

vi. Be able to complete the project within the timeframe stated above

Vii. be able to demonstrate experience of humanitarian review for similar work

Payment terms and conditions

Payment will be made in accordance with the deliverables and deadlines as follows:

· 40% of the total amount – submission of the inception report

· 30% of the total amount – submission of the first draft of the evaluation report

· 30% of the total amount – submission of the final report including all outputs and attachments mentioned above**

We can be flexible with payment terms, invoices are normally paid on net payment terms of 28 days from the time of the invoice date.

Additional information and conditions of contract

During the consultancy period,

IRW will only cover:

· The costs and expenses associated with in-country, work-related transportation for the consultant and the assessment team

· International and local travel for the consultant and the local team

· Accommodation while in the field

· Training venues

· Consultancy fees

IRW will not cover:

· Tax obligations as required by the country in which he/she will file income tax

· Any pre/post assignment medical costs. These should be covered by the consultant

· Medical and travel insurance arrangements and costs. These should be covered by the consultant

How to apply:

Consultancy contract

This will be for an initial period that is to be specified by the consultant commencing from November 2021. The selected candidate is expected to work from their home/office and be reporting to the Programme Impact & Learning Manager or team member designated for this study.

The terms upon which the consultant will be engaged are as per the consultancy agreement. The invoice is to be submitted at the end of the month and will be paid on net payment terms 28 days though we can be flexible.

All potential applicants must fill in the table beneath in Appendix 1 to help collate key data pertaining to this tender. The applicant must be clear about other expenses being claimed in relation to this consultancy and these must be specified clearly.

For this consultancy all applicants are required to submit a covering letter with a company profile(s) and CV’s of all consultants including the lead consultant(s).

A proposal including, planned activities, methodology, deliverables, timeline, references and cost proposal (including expenses) are expected.

Other relevant supporting documents should be included as the consultants sees fit.

All applicants must have a valid visa or a permit to work in the UK (if travel is required to the UK) and to the places where this project is required to be undertaken.

Tender dates and contact details

All proposals are required to be submitted by Monday 15^th November 2021 at 1.00pm UK time pursuant to the attached guidelines for submitting a quotation and these be returned to tendering@irworldwide.org

For any issues relating to the tender or its contents please email directly to tendering@irworldwide.org

Following submission, IRW may engage in further discussion with applicants concerning tenders in order to ensure mutual understanding and an optimal agreement.

Quotations must include the following information for assessment purposes.

1. Payment terms (as mentioned above)

2. Best value for money including a full break down of costs including taxes, expenses and any VAT

3. References (two are preferred)

4. Technical competency for this role

5. Demonstrable experience of developing a similar project

Note: The criteria are subject to change.

Framework agreements

Islamic Relief Worldwide may enter into framework agreements with suppliers/consultants who can support us in similar evaluations in the future. We therefore request those interested companies/consultants to fill in the table below and return this with the schedule 1 beneath with their proposal before the above deadline.

Company name

Day rate for 1 year

Day rate for 2 year

Preferred duration (1 or 2 years)

Earliest start date

Can sign an agreement (yes or no)

Islamic Relief Worldwide is not under any obligations to enter into framework agreements with prospective and potential suppliers/consultants and it is at the discretion of the evaluation committee to proceed with this option.

Appendix 1

Please fill in the table below. It is essential all sections be completed and where relevant additional expenses be specified in detail. In case of questions about how to complete the table below, please contact tendering@irworldwide.org **

Cost of a consultancy for the final evaluation for the Healthcare Aid for Syrian Refugees Project in Jordan, October, 2021

Full name of all consultants working on this project

Full company trading name

No of proposed hours per week

No. of proposed days

Preferred days

Non preferred days**

Earliest available start date

Expected project finish date

Day rate (required for invoicing purposes) £

Total cost for consultancy in GBP (less taxes and expenses) £

Expenses (flights) £

Expenses (accommodation) £

Expenses (transfers) £

Expenses (in country travel) £

Expenses (visa) £

Expenses (security) £

Expenses (food) £

Expenses (print/stationary) £**

Expenses other (please specify) £

Total expenses £

Total VAT or taxes £

Total cost for consultancy in GBP (inclusive of taxes and expenses) £

Note

The applicant is expected to take responsibility for paying full taxes and social charges in his/her country of residence.