World Class Blogs

Monitoring: Free Tips and Handbook

Introduction:

Monitoring and Evaluation

Do you want to know and learn about Monitoring and its importance in the development and humanitarian sector? Let’s begin the learning and understand the actual meaning of monitoring and its usage and methods in the NGO sector.

Many lessons were learned over the years, some by success, some by failure, it totally depends on your timeline. Through it all, we have seen the potential strength and amazing resilience of the communities in their own society. What we have come to realize is that all communities, no matter how poor, have resources (many that still need to be identified) that can be tapped, so that, they can develop. To tap these huge national resources, mobilization and management training are needed which can help them to identify their need easily.

Along the way, all the stakeholders need to know how well the intervention (mobilization and management training) is working and can do smoothly. Stakeholders include community members, leaders, field mobilizers, coordinators, managers, administrators, and planners at the local, district, and central levels. This handbook, directed mainly at the field workers (and recommended for all others involved) provides some guidance, advice, tips, and recommendations for setting up a system of needed monitoring, so as to let them all know how well it is working.

Monitoring Introduction:

This handbook, which is a companion to “Handbook for Mobilizers,” and “Handbook to Generate Wealth,”  focuses on the monitoring and evaluation aspects of community strengthening. To complement the other two handbooks, this third one goes into more detail about the purpose and methods of monitoring, from the community level to the national level.

While these three handbooks are intended primarily for community workers in the field, we recommend that they also be read by planners, administrators, and managers involved in empowering low-income communities. Like the other two, this is a “how-to” book. There is a minimum of description, theory, and history; there is an emphasis on skills, methods, and principles.

1. Principles of Monitoring:

This chapter explains what monitoring is and the purposes it serves at the field level.

1.1 What is Monitoring?

Monitoring is the regular observation and recording of activities taking place in a project or program. It is a process of routinely gathering information on all aspects of the project.

To monitor is to check on how project activities are progressing. It is observation; ─systematic and purposeful observation.

Monitoring also involves giving feedback about the progress of the project to the donors, implementors, and beneficiaries of the project.

Reporting enables the gathered information to be used in making decisions for improving project performance.

1.2 Purpose of Monitoring:

Monitoring is very important in project planning and implementation.

It is like watching where you are going while riding a bicycle; you can adjust as you go along and ensure that you are on the right track.

Monitoring provides information that will be useful in:

2. Monitoring, Planning, and Implementation:

A project is a series of activities (investments) that aim at solving particular problems within a given time frame and in a particular location. The investments include time, money, and human and material resources. Before achieving the objectives, a project goes through several stages. Monitoring should take place at and be integrated into all stages of the project cycle.

The three basic stages include::

Monitoring should be executed by all individuals and institutions which have an interest (stakeholders) in the project. To efficiently implement a project, the people planning and implementing it should plan for all the interrelated stages from the beginning.

In the “Handbook for Mobilizers,” we said the key questions of planning and management were: (1) What do we want? (2) What do we have? (3) How do we use what we have to get what we want? and (4) What will happen when we do? They can be modified, using “where,” instead of “what,” while the principles are the same.

The questions become: 

Where are we?

Where do we want to go?

How do we get there? and

What happens as we do?

2.1 Situation Analysis and Problem Definition:

This asks the question, “Where are we?” (What do we have?).

Situation analysis is a process through which the general characteristics and problems of the community are identified. It involves the identification and definition of the characteristics and problems specific to particular categories of people in the community. These could be people with disabilities, women, youth, peasants, traders, and artisans.

Situation analysis is done by collecting information necessary to understand the community as a whole and individuals within the community. Information should be collected on what happened in the past, what is currently happening, and what is expected to happen in the future, based on the community’s experiences.

Information necessary to understand the community includes, among others:

Information for situation analysis and problem definition should be collected with the involvement of the community members using several techniques. This is to ensure valid, reliable, and comprehensive information about the community and its problems.

Some of the following techniques could be used:

Situation analysis is very important before any attempts to solve the problem because:

A situation analysis should be continuous, in order to provide additional information during project implementation, monitoring and re-planning. Situation analysis and problem identification should be monitored to ensure that correct and updated information is always available about the community and its problems.

Since monitoring should be integrated into all aspects or phases of the process, let us go through each phase and look at the monitoring concerns associated with each.

2.2. Setting Goals and Objectives:

Goal setting asks the question, “Where do we want to go?” (What do we want?).

Before any attempts to implement a project, the planners, implementors, and beneficiaries should set up goals and objectives. See Brainstorm for a participatory method to do this.

A goal is a general statement of what should be done to solve a problem. It defines broadly, what is expected out of a project. A goal emerges from the problem that needs to be addressed and signals the final destination of a project. Objectives are finite subsets of a goal and should be specific, in order to be achievable.

The objectives should be “SMART.” They should be:

Specific: clear about what, where, when, and how the situation will be changed;

Measurable: able to quantify the targets and benefits;

Achievable: able to attain the objective (knowing the resources and capacities at the disposal of the community)

Realistic: able to obtain the level of change reflected in the objective; and

Time-bound: stating the time period in which they will each be accomplished.

To achieve the objectives of a project, it is essential to assess the resources available within the community and those that can be accessed from external sources. See the World-Class Blogs website.

The planners, implementors, and community members should also identify the constraints they may face in executing the project and how they can overcome them. Based on the extent of the constraints and positive forces, the implementors may decide to continue with the project or to drop it.

The goals and objectives provide the basis for monitoring and evaluating a project. They are the yardsticks upon which project success or failure is measured.

Generating Structures and Strategies:

This aspect asks the third key question, “How do we get there?” (How do we get what we want with what we have?).

The planners and implementors (communities and their enablers) should decide on how they are going to implement a project, which is the strategy. Agreeing on the strategy involves determining all items (inputs) that are needed to carry out the project, defining the different groups or individuals and their particular roles they are to play in the project. These groups and individuals that undertake particular roles in the project are called “actors.”

Generating the structures and strategies therefore involves:

After establishing the appropriateness of the decisions, the executive should discuss and agree with all actors on how the project will be implemented. This is called designing a work plan. (How do we get what we want?). A work plan is a description of the necessary activities set out in stages, with a rough indication of the timing.

In order to draw a good work plan, the implementors should:

The work plan guides project implementation and a basis for project monitoring. It, therefore, helps to:

The implementers and planners have to agree on monitoring indicators. Monitoring indicators are quantitative and qualitative signs (criteria) for measuring or assessing the achievement of project activities and objectives. The indicators will show the extent to which the objectives of every activity have been achieved. Monitoring indicators should be explicit, pertinent, and objectively verifiable.

Monitoring Indicators are of four types, namely;

Writing down the structures and strategies helps in project monitoring because they specify what will be done during project implementation. Planning must indicate what should be monitored, who should monitor, and how monitoring should be undertaken.

2.4. Implementation:

Monitoring implementation asks the fourth key question “What happens when we do?”

Implementation is the stage where all the planned activities are put into action. Before the implementation of a project, the implementors (spearheaded by the project committee or executive) should identify their strength and weaknesses (internal forces), opportunities, and threats (external forces).

The strength and opportunities are positive forces that should be exploited to efficiently implement a project. The weaknesses and threats are hindrances that can hamper project implementation. The implementors should ensure that they devise means of overcoming them.

Monitoring is important in this implementation phase to ensure that the project is implemented as per the schedule. This is a continuous process that should be put in place before project implementation starts.

As such, the monitoring activities should appear on the work plan and should involve all stakeholders. If activities are not going on well, arrangements should be made to identify the problem so that it can be corrected.

Monitoring is also important to ensure that activities are implemented as planned. This helps the implementors to measure how well they are achieving their targets. This is based on the understanding that the process through which a project is implemented has a lot of effect on its use, operation, and maintenance.

Therefore the implementation of the project on target is not satisfactory hence a need for implementors to ask themselves and answer the question, “How well do we get there?” (What happens when we do?).

2.5. Summary of the Relationship:

The above illustrates the close relationship between monitoring, planning, and implementation.
It demonstrates that:

There is a close and mutually reinforcing (supportive) relationship between planning, implementation, and monitoring. One of the three cannot be done in isolation from the other two, and when doing one of the three, the planners and implementors have to cater to the others.

3. Evaluation:

Evaluation is a process of judging value on what a project or program has achieved particularly in relation to activities planned and overall objectives. It involves value judgment and hence it is different from monitoring (which is observation and reporting of observations).

3.2. Purpose of Evaluation:

Evaluation is important to identify the constraints or bottlenecks that hinder the project in achieving its objectives. Solutions to the constraints can then be identified and implemented.

The evaluation also enables the project planners and implementers to assess the benefits and costs that accrue to the intended direct and indirect beneficiaries of the project. If the project implemented is, for example, the protection of a spring, evaluation highlights the benefits to the people who fetch and use water and the cost to the people whose land is wasted and whose crops are destroyed during the process of water collection.

Evaluation is essential for drawing lessons from the project implementation experience and using the lessons in the planning of other projects in that community and elsewhere.

Finally, the evaluation should provide a clear picture of the extent to which the intended objectives of the activities and the project have been realized.

3.3. The Process of Evaluation:

Evaluation can and should be done: (a) before, (b) during, and (c) after implementation.

Before project implementation, evaluation is needed in order to:

During project implementation: Evaluation should be a continuous process and should take place in all project implementation activities. This enables the project planners and implementors to progressively review the project strategies according to the changing circumstances in order to attain the desired activity and project objectives.

After project implementation: This is to retrace the project planning and implementation process, and results after project implementation. This further helps in:

4. Management Information:

Management information and information management are different; management information is a kind of information (the data); information management is a kind of management (the system).

Information management is the process of analyzing and using information that has been collected and stored in order to enable managers (at all levels) to make informed decisions. Management information is the information needed in order to make management decisions.

Monitoring provides information about what is going on in the project. This information is collected during the planning and implementation phases. The information helps to detect if anything is going wrong in the project. Management can therefore find solutions to ensure success.

4.1. The Importance of Management Information:

Management Information is important to:

4.2. How to Use Information Management:

To be able to use the information to make management decisions, the information should be managed (collected, stored, and analyzed). Whereas information management (the process of collecting and storing information) and management information (the information needed to make informed decisions) are different; they always reinforce each other and cannot be separated in day-to-day operations.

Management information therefore involves:

Determining Information Needed for Management: During project planning, management and monitoring, much information is generated. Some are needed for making management decisions on the spot; others for later management decisions. A good management information system should therefore assist the project managers to know the information they need to collect, for different management decisions at different times.

Collecting and Analysing Information for Information Management: Information can be got from reports of technical people, village books, forms filled by the different actors, community meetings, interviews, observation, and community maps.

Storing Information: It is important to store information for further references. Information can be stored in the village book, project reports, forms, and in the mind. The major principle in information storage is the ease with which it can be retrieved.

Using Information: Information can be used for solving community problems, determining resources (amount and nature), soliciting their support, and determining future projects.

Dissemination or Flow of Information: For information to be adequately used it needs to be shared with other stakeholders or users. The other stakeholders can also use this information for their management decisions and they can help the one collecting information to draw meaning and use it for management purposes.

Information should be shared between the village, parish, sub-county, district, national office, NGOs, and the donor.

Management information is part and parcel of monitoring because such information is got during monitoring and helps in the planning and implementation of monitoring activities.

Whether it is from the staff or stakeholders, one of the most effective ways of getting useful monitoring information is through the Annual Review. Although it is described in its role of getting participatory management information, it is equally applicable in obtaining monitoring information.

5. Participation in Project Monitoring:

Monitoring is a vital management and implementation role that cannot be left to only one stakeholder. As many individuals and institutions as possible that have any interest in the project, at all levels, should participate in monitoring.

5.1. Advantages of Participation:

The advantages of participation in monitoring include: (a) a common undertaking, (b) enhancing accountability, (c) better decisions, (d) performance improvement, (e) improved design, and (f) more information.

Common Understanding of Problems and Identification of Solutions: Participative monitoring helps stakeholders to get a shared understanding of the problems facing the community or project (their causes, magnitude, effects, and implications).

This facilitates the identification of solutions. These solutions are more likely to be appropriate because they are derived from a current situation.

Benefits the Target Groups and Enhances Accountability: Participation in monitoring ensures that the people to which the project was intended are the ones benefiting from it.

It increases the awareness of people’s rights, which elicits their participation in guarding against project resource misappropriation. Guarding against resource misappropriation makes project implementation less expensive.

Making Appropriate Decisions: Monitoring provides information necessary for making management decisions.

When many people participate in monitoring it means that they have participated in providing management information and contributed to decision making. The decisions from this are more likely to be acceptable and relevant to the majority of the population. This makes human and resource mobilization for project implementation easier.

Performance Improvement During Monitoring, if a performance deviation is discovered solutions can be devised. Finding appropriate decisions that can be implemented requires the participation of those people who will put the solution into practice.

Therefore participation in monitoring can help improve project performance.

Design of Projects: The information generated during project monitoring helps in re-designing projects in that locality to make them more acceptable.

The lessons learned can also be used in the design of similar projects elsewhere.

Collection of Information: If many people participate in monitoring they are more likely to come up with more accurate information. This is because, information that is omitted by one party, can be collected by the other.

Each stakeholder is putting varying emphasis on the different aspects of the project using different methods. Alternatively, one party knowing that the information they are collecting will be verified forestalls deliberate wrong reporting.

5.2. Challenges of Participation in Monitoring:

Whereas participation in monitoring has a number of virtues, it is likely to face a number of challenges. The challenges include: (a) high costs, (b) variations in information, and (c) inaccuracies.

High Initial Costs: Participation in monitoring requires many resources (eg time, transport, and performance-related allowances). It is a demanding process that can over-stretch volunteer spirit at the community level and financial resources at the district and national levels. Therefore it must be simple and focused on vital elements.

Quantity and Variety of Information: Monitoring requires the collection, documentation, and sharing of a wide range of information. This requires many skills that are lacking in the communities. It, therefore, necessitates much time and resources for capacity building. It also risks wrong reporting.

Inaccuracy of Information: Some stakeholders, from the community to the national level, may intentionally provide wrong information to depict better performance and outputs or because of community or project differences. To counteract wrong or incorrect reporting needs sensitization and consensus-building which is difficult to attain.

The advantages of participation in monitoring are evidently more than the challenges. It is, therefore, necessary to encourage and support participatory monitoring as we devise means to counteract the challenges.

6. Levels of Monitoring:

Monitoring should be carried out by all stakeholders at all levels. Each level, however, has specific objectives for monitoring, methods, and therefore roles.

For monitoring to be effective, there is a need for a mechanism of giving feedback to all people involved at all levels (community, district, national, and donor).

6.1. Monitoring at Community Level:

Community-level is where implementation and utilization of the benefits of the project take place. In most cases, it is at the village and parish levels. At this level, the major purpose of monitoring is to improve the implementation and management of projects. The interest of the community as a whole in monitoring school construction, for example, is to ensure that the construction of the school (an output) is being done as planned.

The specific objectives for monitoring at this level, therefore, include, (a) ensuring that the projects are implemented on time, (b) that they are of good quality, and (c) that the project inputs are well utilized.

Monitoring at this level involves: Identifying a community project. This should be identified in a participatory manner to reflect the community’s needs and stimulate people’s interest in its implementation and monitoring.

If the process of project identification is not well done and does not reflect community interests, it is likely that the communities will not participate in the monitoring of the implementation activities;

Identifying the team(s) to spearhead the monitoring of the project in the community. The roles of each team, how they should carry out the monitoring process, and the use and sharing of information generated with other groups within and without the community, should be specified and explained;

Design a work plan that guides project monitoring. The work plan should specify the activities in the order that they will be executed and the individuals to execute them. This helps the people monitoring to know the activities that should be carried out by particular individuals in a given period of time. If the activities are not carried out, the people monitoring get guidance in coming up with a solution(s);

Determine the major activities from the work plan. Whereas all activities in the work plan are necessary and should be monitored, it is useful to identify the major activities on the basis of which objectives and indicators would be set. For example, if the preparatory activities in a school construction project include, community mobilization, borrowing of hoes from the neighboring village, digging of the soil, and fetching of water for brick making, the major activity summarizing all the sub-activities could be brick making.

Determine the indicators for each activity objective. The indicators help the team monitor to tell how far they have gone in achieving the objectives of each activity. In our example, one indicator could be the number of bricks made. And

Compare what is happening with what was planned should be done in the process to tell whether the project is on schedule and as planned. The monitors should check the indicators to measure how far they have reached in achieving the objectives. This should involve looking at the quality of work to ensure that it is good. The monitoring team may need to involve a technical person like a local artisan or a technician from the district to ascertain the quality of the project (if it is of construction).

The monitoring team should then agree on how often they should visit the project site as a means of verifying what is taking place. For a community project, to avoid big deviations from the work plan, monitoring visits should be carried out at least once a week. During the project visits, the team should look at what is happening (observe) and talk to everybody who is involved in the project;

For each activity, the monitoring team should identify the objectives. For example, the objective of brick making as an activity during the school construction project could be; to make ten thousand bricks by the end of February.

Whenever a monitoring visit is carried out, those monitoring should write down their findings. They can use a form attached in the annex or agree on any other reporting format that captures the findings of the exercise in relation to the work plan. The findings from the monitoring visits should be discussed with other members of the implementation committee. The monitoring and implementation teams should use the information collected to detect and solve the problems facing the project.

The monitoring and implementation teams should store the information well and use it for future actions and to inform other stakeholders. At each site, there should be a file in which copies of monitoring reports and other documents related to the project are kept.

6.2. Monitoring at District and Sub-County Level:

The district and sub-county officials should get information from the community monitoring (monitoring performance in relation to turning the inputs into outputs). They should also monitor the outcome of the project (eg the effect of school construction on the enrolment levels). The district should also monitor the increase in strength, capacity, and power of the target community to stimulate its own development.

The objectives, therefore, include: supporting the improvement in project performance and measuring the applicability of the way the project was designed in relation to community strengthening.

The methods for monitoring that can be adopted at this level include (a) routine monitoring and (b) qualitative support.

Routine Monitoring and Supervisory Support: This requires the District Project Co-ordinator, Community Development Assistant, other technical staff, and politicians at the district and sub-county to visit the project sites to ascertain what is happening in relation to what was planned.

A copy of the work plan and community monitoring reports should be kept in the project site file. This will help whoever wants to compare progress with the work plan and get comments from the monitoring team to do so without necessarily tracing the members of the monitoring team who may not be readily available.

During routine monitoring, discussions should be made with all the people involved in the implementation and monitoring of the project. Look at the manner in which each team performs its duties (as a means of verifying the increase in community capacity).

Make and record comments about good and bad elements in the project. Recommend solutions showing who should undertake them, with financial, time, and the negative effects that may accrue to the project if they are not taken. A copy of the comments should be left in the project site file/book and the other discussed and filed at the district.

The sub-counties and districts should organize discussions of project progress at least once a month. Also, fill and submit a project progress report as part of the routine monthly reporting to the district and national office respectively.

The major issues to look at during the district and sub-county routine monitoring include:

Qualitative Enquiry: The district, in liaison with the sub-county, should organize Focus Group Discussions, Key Informant Interviews, and Community Group Discussions, with communities and other key informants at least twice a year.

These inquiries would help the district to:

These qualitative inquiries should be simple and involve the community members to reduce the costs and enable the community members to learn how to conduct them as a means of community strengthening. The outputs should be analyzed in relation to the community and routine district findings and should also be used to discuss solutions.

Findings should be well documented and shared at the national level in order to assist national-level management information.

The major issues during the qualitative inquiries include:

Before qualitative inquiries, each district and sub-county should identify and discuss any management information gaps to form periodic themes. Specific designs would also be agreed upon at this stage.

6.3. Monitoring at National and Donor Level:

Monitoring at the national and donor level is to find out if project inputs are well used (desired outputs are being realized), project design is appropriate, and for learning.

The objectives of monitoring at this level include:

The methods for monitoring at this level include: (a) routine monitoring, (b) action research and qualitative inquiries, and (c) surveys.

Routine Monitoring: Routine monitoring should be done on a quarterly basis by project staff and the ministry’s planning unit to check on the levels of activities and objectives. Since the national level gets information about the projects and activities through monthly district progress reports, national routine monitoring should be limited in scope. It should cover aspects that appear contradictory, problematic, very satisfactory, or unique. These would enable the national office to provide the necessary support and draw lessons.

Action Research and Qualitative Enquiries: The national office should carry out in-depth qualitative inquiries once a year. These should focus on drawing lessons from the project design and implementation experiences for replication.

Therefore, the major issues at this level include:

Surveys: Surveys should also be conducted to gather quantifiable data and supplement the information generated through other methods. These can be contracted to research institutions such as universities.

6.4. Monitoring Issues and Procedures at Different Levels:

Monitoring issues and procedures are described here for each level. This is to emphasize that the stakeholders should spearhead but not exclusively carry out all monitoring. In practice, the issues and procedures of the different stakeholders overlap. Each stakeholder should support others in monitoring responsibilities.

The issues mentioned here are not exhaustive but indicate what should be done. Each level should therefore collect information on any other issues deemed relevant to the particular situations.

These are presented as three tables (1) community level, (2) district level, and (3) national level, indicating the key issues at each level.

6.5. Community Level:

At the community level the three main actors who have a stake in the community strengthening intervention are the:

The following table looks at the main issues of interest, monitoring indicators, means of observing, frequency, and suggested monitoring procedures, for each of these three stakeholders.

StakeholderIssueMonitoring IndicatorsMeans of observationFrequencyMonitoring Procedure
Executive CommitteeTimely Implementation of ProjectsA number of project activities were implemented in time.Routine project visitsWeeklyMembers use routine monitoring form
Appropriate use of project resourcesNo materials misusedRoutine project visits. Project quality checksWeeklyMembers use routine monitoring form
Check quality using the technician’s guidelines
Proper collection and storage of project informationPercentage of projects with project site files; the number of reports in site filesReviewing the project site filesWeeklyMembers of the project committee review the project site file, reports, and comments
Community MobilizersRealistic project implementation work planNumber of project work plans with well-sequenced activitiesCompare activities in the work plan with how they are implementedMonthlyMobilizers (1) review the sequence of project work plans with a technical person, and (2) conduct monthly project site visits
Community participation in project activitiesNumber of persons performing their rolesA number of activities. Amount of resources provided by the communityMonthlyProject site visits; Discussions with people about their contributions.
Project Development CommitteeAccountability of Project ResourcesPercentage of resources accounted forResource accountability formQuarterlyPDC members use the project resource accountability form

7. Reporting:

Reporting is a major activity during project monitoring. It is the way in which information about the process and output of activities, and not just the activities, is shared between the stakeholders of the project. See also Report Writing.

In the case of a school construction project, reporting does not end at mentioning the number of times the community met to make bricks and build the school walls but also mentions the number of bricks and school walls that were constructed plus the process through which they were accomplished.

In community projects, reporting is mainly done in two ways: verbal and written.

7.1. Verbal Reporting:

This is a process where reporting is done orally. It is the commonest means of reporting. The community members find it easier and more effective to communicate to others in words.

The advantages of verbal reporting are:

The challenges of verbal reporting include:

7.2. Written Reporting:

During monitoring, it is important to report the results of activities, not just the activities. Write what you observe, along with reviewing reports of technical people.

The advantages of written reports are:

The challenges of written reports are:

7.3. Reporting Roles of Key Stake Holders:

Community-level

Project Committees:

Community Mobilizers:

Parish Development Committees:

Local Council One and Two:

Sub-County and District Level

Community Development Assistant:

Community Development Officer (District Co-ordinator):

National Office

National Coordinator:

For more blogs visit our main page World Class Blogs and business website Sherakat Network.

Exit mobile version