INTRODUCTION

Reliable information is essential for making the case for changes to deliver safe and healthy journeys to school. Robust data helps correctly identify problems, target populations, prioritise risk factors, and identify appropriate solutions.

Often, data is weak or even not available, particularly in low- and middle-income country settings. Given constraints on resources, data gathering exercises must be affordable. This is a key premise of many of the approaches included in this toolkit.

SAFE STREETS


Official data on injuries and fatalities in a school area is often unavailable, weak or incomplete. This is where school area assessments can prove effective in identifying the level of risk and the exposure of children to road traffic as they go to and from school.

This section provides a guidance on assessing risk, and basic information on crucial monitoring and evaluation processes, including establishing a baseline before implementation, and how to assess the ongoing impact of schemes. Alongside data on injuries, it is also important to collect wider data on perceptions of safety, and experiences of the built environment.

Identification of 'high risk' schools

Whilst crashes can occur anywhere and at any given time, some locations have more crashes than others. Tackling road safety in these “hot spots” is one of the most traditional approaches to road safety and is known to reduce casualties. Identifying and focusing on these locations makes it possible to set priorities and maximise the impact of limited resources. On average, targeting high risk locations results in an 18% reduction in casualties, and in most cases is cost-effective.

Lists of all schools in the area can usually be obtained from local authorities, ideally in spreadsheet format. By analysing secondary data and speaking with the head teacher of schools, identify schools where there is a high rate of road traffic injuries and deaths. Examples of secondary data that may be of use in identifying hot spots are police data, hospital registries, newspaper reports, and school registries.

School Area Road Safety Assessments and Improvements (SARSAI) projects have used the following steps to identify schools with high rates of injury:

  1. Obtain list of schools and contact details
  2. Ring all head teachers (or visit schools, if possible) and ask for number of road traffic injuries among pupils in the last year (anecdotal data) as well as the school population
  3. Estimate a value for road traffic injury rates by dividing the number of injuries at the school by the population (Estimated RTI rate = no. of injuries/school population)
  4. Visit the schools with the highest estimated injury rate to see if they are suitable for SARSAI. In one Amend study, all the schools identified had estimated initial injury rates between 0.2% - 1%.

Appropriate schools for Amend-type interventions:

SARSAI focuses on schools where minor infrastructural improvements can lead to major reductions in road traffic injuries. If the school is near a major highway, it may not be a suitable candidate for SARSAI, because larger infrastructural changes such as overhead footbridges or major intersection alterations are not within the scope of SARSAI-based projects.

For more on Amend and SARSAI visit www.amend.org

Site visits

At each school site visit, make a note of surrounding roads, school entrances (whether they are on a main road or side road), footpaths, existing traffic-calming measures, etc to assess whether the school is an appropriate choice for the project.

During the site visit, observe student flow at drop-off and pick-up times. Where are the heavy foot traffic areas? What hazards are the children exposed to on their journeys to and from school? If necessary ask permission to follow students as they travel by foot and make a note of any areas where accidents are likely.

Key features to look out for during sites visits are:

  1. What are the most likely dangers to children? Speeding traffic? High traffic volume? Type of vehicles? E.g. Motorcycles weaving between vehicles or overtaking stopped vehicles? Large vehicles like trucks which limit children's visibility? Parked vehicles which limit visibility?
  2. Are there designated crossing areas e.g. zebra crossings, pedestrian traffic signals? If not, is there room to provide this?
  3. Are there safe places for children to walk away from traffic e.g. footpaths? Do the footpaths connect crossing points to the school entrance? If not, is there the opportunity to provide this?
  4. Are there traffic calming features in place? E.g. humps, rumble strips, chicanes etc to slow vehicles down? If not, is there the opportunity to provide this?
  5. What is the road alignment like? Are there bends or slopes which might make it difficult to provide zebra crossings and speed humps at safe locations?

Interview and focus groups (pupils, teachers, parents, community around school)

These interviews and discussions build a picture of what a student’s journey to school looks like. What are the challenges faced by the students, parents and school staff? 

  1. Pupil catchment area surveys

    This is used to understand and visualise where students live. Ask school administrative staff for a list of the catchment neighbourhoods for the school based on their school records. In a similar “hands-up” approach, ascertain class by class where students travel to and from school. Use this information to compile a visual catchment map e.g. on Google.

  2. Mode of transport surveys

    This survey is used to determine how students travel to and from school each day. Instructions on how to carry out a comprehensive mode of transport survey are Tool icon here. Time and resource availability may necessitate the survey being simplified to a quick hands up count, class-by-class. Try to ascertain the main mode of transports for the students, e.g. do they spend most of their journey to/from school walking, in a car, bus etc.

  3. Pedestrian counts

    Pedestrian counts are used to determine the number of pedestrians crossing the road at a particular stretch within the school zone. Previous site assessments will have identified heavy foot flow areas where students cross roads to get to and from school. Observations of how many pedestrians (students and general public) should be taken for a minimum of one hour before school starts and as school finishes on differing days of the week. 

  4. Photovoice

    photovoice.jpgPhotovoice is a qualitative method of community-based participatory research which documents real life situations and commentaries surrounding a particular topic through the medium of photographs. Participants are asked to express their points of view surrounding a research topic, in this case road safety, by taking photographs, combining them with short narratives to give more context. Photographs are collaboratively interpreted and discussed by groups and can be used to highlight specific issues of concern by the participants. This then enables researchers as well as other stakeholders to identify the issues faced by the participants and promotes dialogue to develop effective solutions that address specific needs.

    Save the Children have developed a 10-step guidance document on how to involve children in needs assessments using Photovoice:

    Step 1: Sensitize the community and recruit participants

    Step 2: Conduct a workshop to introduce participants and facilitators in order to establish group dynamics

    Step 3: Set the project goals (remember objectives should be SMART)

    Step 4: Get the children to focus on a specific thematic area (in this case the route to school)

    Step 5: Introduce the use of cameras and photography to the children

    Step 6: Provide guidance to children on how to “speak out through photography”

    Step 7: Discuss strategies for taking pictures with the children

    Step 8: Discuss ways to capture stories and develop captions for pictures

    Step 9: Plan to exhibit or showcase the children’s pictures

    Step 10: Go public through meetings, workshops, media, etc.

    Tool icon The Save the Children Photovoice guide can be downloaded here.

    Please be aware of the ethical and safety issues surrounding the involvement of children in projects of this nature. Be sure to obtain the necessary permissions at all levels before embarking on such a project.

    Safe Kids Worldwide used Photovoice effectively to document the pedestrian-related issues facing children, parents and teachers through a project entitled: “PHOTOVOICE: Children’s Perspectives on Road Traffic Safety”. The project successfully captured on film the environments children faced while walking in Brazil, Canada, China, India, Korea, Mexico, Philippines, Thailand, the United States and Vietnam. A total of 5,743 photographs were taken by students aged 9-14 in the 10 countries. The subsequent discussions and accompanying narratives enabled participants to effectively advocate for permanent infrastructure changes which led to a safer journey to school for the students. Safe Kids Worldwide provided a number of grants to these communities permitting the implementation of permanent infrastructural changes to the risks identified through the photographs. A sample of before and after shots from this particular project can be found here.

Traffic counts

Traffic volume studies are conducted to determine the number, movements, and classifications of roadway vehicles at a given location. They can help identify critical flow time periods, determine the influence of large vehicles or pedestrians on vehicular traffic flow, or document traffic volume trends. Similar to pedestrian counts, these are conducted around peak school times at the beginning and end of the school day and at 15 minute intervals at various locations around the school. Detailed instructions how to carry out a traffic volume count can be found Tool icon here.

Speed surveys

Assessment of traffic speed around the school will be vital in determining high-risk areas and the effectiveness of traffic calming measures in reducing speed. Tool icon Detailed instructions how to carry out a speed survey can be found in the 'Speed Observation Studies section'.

  • Star Ratings for Schools (S4RS)

    Image credit: Gonzalo Rodriguez Foundation
    The Star Ratings for School (SR4S) is a systematic evidence-based approach to measure, monitor and communicate the risk on roads around schools. The easy-to-use universal application is a low-cost way to support quick interventions that start saving lives and preventing serious injuries from day one.

    The United Nations has included road safety in its Sustainable Development Goal (SDG) 3.6, calling for road deaths and serious injuries to be halved by 2020. SR4S is key to meeting these global targets for child and adolescent pedestrians. SR4S combines a central web application and a data collection Android app that harness the power of the iRAP Star Rating for Pedestrians to calculate Star Rating at spot locations, where 1-star is the least safe and 5-star is the safest.

    SR4S:
    • Measures safety before and after road improvements.
    • Provides an evidence-based rating of road safety.
    • Supports education campaigns for students, drivers and the wider community for safe travel around schools.
    • Guides decision-makers in prioritising road upgrades around schools by assessing different options.

  • For iRAP visit www.irap.org
  • Find out more on Star Ratings for Schools
  • Partners for success

    Effective road safety interventions involve a number of stakeholders working collaboratively and positively together. Stakeholders can be important allies when it comes to communicating the vision, objectives and results of a project to a wider audience. If an important stakeholder is not engaged throughout the process, they are more likely to prove obstructive to it.

    The major stakeholders may include:

    • The local community
    • Governmental authorities (both local and national)
    • Road authorities
    • Private organisations
    • Health agencies
    • Educational agencies
    • Council administrations
    • Local civil society organisations.

  • Secure funding

    Adequate funding needs to be secured for every aspect of the planned project. The costs that must be covered include:

    • Working hours of the team directly involved in carrying out the project
    • Training activities undertaken by the team
    • Production of communication materials
    • Supporting outreach activities like engagement meetings and surveys
    • Implementing findings such as road upgrades
    • Mass media campaigns
  • Identify high-risk schools

    Select the schools that will be assessed. It is important to prioritise high-risk locations, but it is also clever to align the school zone assessment plans with the strategy from road authorities and municipalities. Check for any data or preliminary risk studies that may have already been conducted by relevant parties, such as crash data, a Pedestrian Plan that highlights areas for improvement, or an existing school zones programme with priority school areas already mapped.

  • Engage with the schools

    Establish contact with the school principal and the wider school community to explain the project’s aims. This means clearly stating the project objectives, listening to their input and gaining their support. The school community must fully understand the potential benefits of the project and how they can be involved. Communicating with parents and the surrounding neighbours gives a good opportunity to amplify the voice of the project and gather public support for making positive changes to the road safety profile of the area.

    Image credit: iRAP

  • Choose an assessment approach

    The objectives of the project and most appropriate approach to a school assessment (educational, enforcement or engineering, for instance) must be decided based on the specific features of the local area. This will be identified from site visits and input from the school community; a multiple assessment approach is always encouraged.
  • Build capacity on assessments

    Build and develop assessment teams and make the most of their skills when it comes to infrastructure data collection. The Star Ratings can be undertaken by any trained road safety professional. Project partners responsible for Star Rating for Schools data collection are required to attend formal training delivered by the International Road Assessment Programme (iRAP) or a SR4S Lead Partner. To enrol in the SR4S Webinar series course, please register here. iRAP provides also a range of free software, methodology documents, research and technical papers, presentations and specification documents to support partners worldwide

  • Assess infrastructure safety

    Identify a team for data collection with good technical skills and preferably experienced on SR4S data collection or supervised by a skilled data collector, and the critical locations around the school to be assessed. Collect data using SR4S and submit your data to Quality Assurance.

    Image credit: iRAP


    After the locations assessed are approved in the Quality Assurance process, it is possible to Calculate the Star Ratings and check the assessment results. Once the risk is measured, effective treatments to mitigate the risk can be considered by exploring different countermeasure scenarios. The treatments may include active speed management, infrastructure treatments at the site or the relocation of a school entrance to a safer location.

    Image credit: iRAP


    When the implementation process has been completed, the assessment team will be able to reassess the network and celebrate the safety improvements. The implementation of the treatments can ultimately be tracked so that the partner and funder can see the benefits of their investment and the school teaching staff can educate the pupils on the correct use of the treatments.
  • Advocate for road upgrades

    Document the main findings, identify the potential countermeasures for the locations assessed and convey them to the different interested parties. Translate technical information into compelling messages that help the programme to connect to its stakeholders.

    Image credit: BIGRS 2018

  • Celebrate success

    Inform the broader audience and celebrate the success of the project. After finishing any road upgrades and reporting the results, communicate with the project stakeholders regarding the results of the modifications and acknowledge the different partners of the project, their roles and relevance.

  • Grow success

    When the school assessment project has been successfully conducted and the results have been documented and shared look beyond the scope of the project and identify how to maximise its achievements. These achievements will build a case for attracting the interest of government and other partners in spreading awareness, attracting funding for road upgrades and incorporating other schools into the project.

Monitoring and evaluation is an important aspect of any project and are often overlooked. Monitoring refers to the systematic collection of data regarding the performance of a road safety programme or intervention during or after its implementation. Evaluation involves the analysis of this data to determine the effectiveness of the programme.

Monitoring and Evaluation are fundamental aspects of good programme management:

Quality Accountability Learning
  • To provide data on programme progress and effectiveness
  • To improve program management and decision-making
  • To provide data to plan future resource needs
  • To provide data useful for policy-making and advocacy
  • To allow accountability to stakeholders, including donors, partners, and project users or beneficiaries
  • To provide opportunities to learn from experience of the current project
  • To provide evidence about what works to inform future program and scaling up

 

To ensure M & E is relevant to your stakeholders it is important that you consider their information needs, as well as your own. You will therefore need to identify the key internal and external stakeholders, and decide how to involve them in the design, implementation, analysis and/or communication of findings. Set up regular project team meetings to discuss M & E results.

  1. Identify the purpose and scope of the M&E system
  2. Plan for data collection and management
  3. Plan for data analysis
  4. Plan for information reporting and utilization
  5. Plan for M&E human resources and capacity building
  6. Prepare the M&E budget

It is useful to build the monitoring and evaluation framework alongside planning the intervention and base it around the main objectives of the project. Early M&E planning allows for preparation of adequate time, resources and personnel before project implementation. It also informs the project design process itself as it requires people to realistically consider how practical it is to do everything they intend to measure.

An agreed M&E framework is essential in order to carry out monitoring and evaluation systematically.

This framework serves as a plan for monitoring and evaluation, and specifies:

  • What is to be monitored and evaluated?
  • What activities are needed to monitor and evaluate?
  • Who is responsible for monitoring and evaluation?
  • When monitoring and evaluation is planned?
  • How monitoring and evaluation are carried out?
  • What monitoring and evaluation resources are required?
  • What are the risks and assumptions in carrying out M&E activities?

Linking project objectives and activities with indicators that can be used to measure processes is a fundamental aspect of planning M&E. This exercise can be aided by using simple templates such as the logic framework (see below) which subdivides project objectives into: inputs, activities, outputs, short-term outcomes, long-term outcomes, impact. In reality the pathway is unlikely to be linear as there maybe multiple outcomes and feedback loops along the way but visualising the project in the form of a change pathway can be useful.

Inputs
Activities
Outputs
Short-term
outcomes
Long-term
outcomes
Impact

Key concepts:

Concept Definition

Aim

The long-term change to which the project will contribute, e.g. reduction of child injuries / deaths / disabilities from road traffic crashes, in city X. The aim is usually a general statement about what the project hopes to achieve.

Objectives

Objectives are the specific steps that need to be taken in order to achieve the aim of the project. In other words, the “how” of the project. Objectives, therefore, always start with a verb, e.g. to collect, to test, to produce, to analyze, etc. They should be as specific as possible (remember SMART objectives: Specific, Measureable, Achievable, Reachable, Timebound).

Inputs

These are the key resources needed to support the project. They include human resources, funds, equipment, etc.

Activities

These are the interventions (or actions) that will be taken that will lead to the outputs. They can include workshops, trainings, infrastructural changes, enforcement, supervision, etc.

Outputs

These are the tangible results of the project such as the number of people trained, the number of workshops conducted, the number of zebra crossings painted, the amount of material distributed, etc. They should lead to the outcomes.

Outcomes

The outcomes are the changes that result from the intervention. They may be short, medium or long-term. They should directly relate to the aim/objective of the programme. They can include changes in knowledge and attitudes (short-term), changes in behaviour (medium term) and finally reductions in injuries, deaths and disability.

Choosing the right indicators to measure inputs, outputs and outcomes will depend on what questions are needing to be answered so having a clear aim for the evaluation is essential. The breadth of an evaluation will always be limited by the resources available, but a well-designed, simple evaluation can be as useful as a more complex and costly one.

An indicator is a variable that measures some aspect of a program that is directly related to that program’s objectives. Indicators can be either quantitative or qualitative and will measure magnitude and changes. They should be:

  • Clearly defined: valid, precise
  • Meaningful: can be linked to program objectives
  • Measurable: from available data sources or from easy-to-execute studies
  • Reliable: consistently measurable by different observers
  • Non-directional: does not assume positive or negative values

Avoid vague indicators such as “number of people who “know” about speed reduction in the area.” Better to use “proportion of parents who can correctly state the new speed limit surrounding the school” as measured through a parent survey.

Examples of indicators for each part of the framework for the evaluation of a road safety program in a school are given below:

choosing-your-indicators.jpg

Generally, you are likely to need information to track and assess what has changed (both intended and unintended) and understand the reasons for changes - i.e. what factors/organisations/individuals have facilitated/constrained change (including your contribution). Secondary data sources such as police data, vital registries, school registers or hospital data may be available and often provide a good source of outcome data. However, as secondary data is not designed specifically for program needs, it is important to avoid the trap of using irrelevant secondary data just because it is available. Check the relevance of secondary data for:

  • Population – does it cover the population about which you need data?
  • Time period – does it cover the same time period during which you need data?
  • Data variables – are the characteristics measured relevant for what you are researching? For example, just because the data may be on road safety, if your program focuses on speed reduction, a road safety study on helmet wearing rates may not be relevant.

There are many different types of studies that will help in collecting the necessary data for your indicators – they can be both qualitative and quantitative. Qualitative data such as in-depth interviews and focus group discussions can be used in the formative evaluation to provide information on why an intervention may or may not have worked and whether the program went to plan. There is a hierarchy of quantitative methods for examining the effectiveness of a program ranging from randomised-controlled trials to before-after studies with no control group. Whilst the former is more rigorous and is the gold standard by which evidence is assessed, it is also the most expensive type of evaluation to carry out. Conversely, the before-after study is cheaper, but it can only provide weak indicative evidence as to a program’s effectiveness. Using a quasi-experimental design such as a controlled before-after study is often more practical and involves measuring the outcome of interest e.g. vehicle speeds before and after the intervention for both the target population and an control population A control group allows trends that may have been occurring in the population separately from those happening as a result of the programme to be taken into account.

Types of studies that can be carried out are:

Tool Description Usefulness Disadvantages

Survey

Written questionnaire designed to measure indicators

Systematic, can be given to a large number of people

Not possible to explore answers in greater detail

Interview

Ask specific information regarding indicators

Flexible, can be done in-person or by phone

Requires interviewing skills so as not to ask leading questions

Focus Groups

Skilled facilitator mediates a conversation with 6-12 people

Cheap, allows opinions from a larger group at one time

People influence one another, feelings may not be shared honestly

Observational study

Roadside observations of risk factor behavior
e.g. speed, helmet wearing.

Relatively cheap. Allows estimation of risk factor behavior such as speed, seatbelt wearing rates, helmet wearing etc.

Not always accurate and relies on observation skills of researcher leading to potential bias. Time consuming

Mobility survey

A self-administered questionnaire which collects data on usual mode of travel to school and road injury

Reliable and valid method of data collection on mode of travel and attitudes surrounding road safety

Time consuming and potentially costly. Need trained researchers. Large sample size.

 

The methods used for the evaluation will depend on the aim and the budget for the evaluation. However there may be ways to reduce the costs of your evaluation. Ask yourself the following questions:

  1. Is the information necessary and sufficient?
    • Collect only what is necessary for program management and evaluation. Limit information needs to the stated objectives and indicators.

  2. Are there reliable secondary sources of data?
    • As discussed above, secondary data can save considerable time and costs – as long as it is reliable.

  3. Is the sample size adequate but not excessive?
    • Determine the sample size that is necessary to determine change. While sample size calculators are available freely online it may be better to consult a statistician regarding estimating the sample size.

  4. Can the data collection instruments be simplified?
    • Eliminate unnecessary questions from questionnaires and checklists. In addition to saving time and cost, this has the added benefit of reducing survey fatigue among respondents.

  5. Is it possible to use competent local people for the collection of survey data?
    • This can include university students, health workers, teachers, government officials and community workers. There may be associated training costs, but considerable savings can be made by hiring a team of external data collectors, and there is the advantage that local helpers will be familiar with the population, language, etc.

This will depend on your evaluation aims and your resources. At the very least you need to be collecting data on indicators at the very beginning of the project (to build a baseline) and at the end of the project. Collection of process and input indicators should be carried out throughout the implementation of the project. Ideally for observation studies it is useful to collect data at the beginning, part way through, at the end of the intervention.

Groups can learn from each other: what was useful, what worked, what tools can be shared, etc. Sharing of problems encountered and how these were overcome can benefit others and avoid time wasting in future work. Dissemination is important in enabling the PI to connect with other individuals, groups or organizations conducting similar projects (create a network).

Results can be shared through:

  • Report writing
  • Social media (FB and Twitter)
  • Online resources (organizational website)
  • Conferences, meetings and workshops
  • Articles (scientific and newspaper) and reports

Amend, in partnership with the United States Centers for Disease Control and Prevention, conducted a multi-year population-based control study impact evaluation of SARSAI and found that the SARSAI programme results in a statistically significant reduction in the number of children injured in road traffic. For every 286 children whose schools are part of the SARSAI programme, one RTI is prevented per year. This is the first known road safety programme of any type proven to reduce RTI among children in sub-Saharan Africa. The methodology consisted of before and after household surveys in catchment areas of both intervention and control schools allowing for a more rigorous evaluation. Details of this evaluation can be found here.

School registers can provide a fast, simple and cheap means of injury surveillance. They may already possess an electronic or paper-based database of student attendance and collect data pertaining to the absence. It is worth approaching the headmaster to see if there is an existing system of reporting child absences. If there is none, it is good to ask about the feasibility of implementing one (or augmenting the existing one) with the help of school administration staff. It could be as simple as a logbook or a simple excel spreadsheet with drop down menus to record the following variables for any children reported as absent:

  • Name
  • Gender
  • Age (or year at school)
  • Reason for missing school (sickness, sustained injury, holiday, family member unwell and unable to get to school, death etc)
  • If injury:
    • Date/time of injury
    • Cause of injury sustained (road traffic, fall, burn, assault etc)
    • Type of injury sustained (e.g. broken arm, head injury, stab wound etc)
    • Activity at time of injury (walking to/from school, playing etc)
    • Location of injury (home, school, sports field etc)
    • Outcome (minor injury – no medical treatment; moderate injury – seen in ER, severe injury – admitted to hospital, death)
    • Number of days missed from school

Speed data from specific sites like school zones is very hard to find. Often police data pertains to major highways, or if there is a speed camera within a school zone, harnessing that data from the relevant authorities may be problematic. Speed observation studies are a reliable way to obtain such information and can be used to help evaluate speed management to reduce child pedestrian injuries.

Site Selection

  • Readings must be taken at a sufficient number of stations to ensure an accurate representation of the traffic speeds throughout the study section.
  • Safety is a major aspect of all station selections. Ensure that the data collector is not located in a dangerous situation.
  • At least one site outside the school gate. 4-6 sites elsewhere in school zone at differing locations e.g. intersections, busy main road, side road, other entrances to school.
  • Vehicles need to be in free-flowing condition

Area Review

During the area review, the investigator should note the following elements:

  • The general environment of the area (e.g., rural, commercial, residential);
  • Pavement condition;
  • Driveway locations;
  • Geometric restrictions (e.g., crest vertical curves, horizontal curves);
  • Location of existing speed limit signs and other traffic control devices;
  • Location of no passing zones; and
  • Location of nearby traffic generators (e.g., factories, malls, schools, churches).

Timing of observations

  • Day selection: depends on what you are looking for.
    • Two week days (minimum), two weekend days e.g. Sun, Tues, Thurs, Sat (can change depending on study design).
  • Time selection: 60 minute slots from 7am to 7pm to catch rush hour, school drop off/pick up.
  • Ideally want to be recording for 2 weeks before intervention is put in place and for two weeks right after, then 3 months, 6 months, 1 year etc. Reality may be different – do the maximum amount your budget allows. (Minimum is 1 week pre and 1 week post at 3 months and 1 week at 6 months).

Training

  • Researchers/data collectors need to be trained to correctly measure speed using a radar. (Ensure radar is calibrated).
  • They should be familiar with the data collection form.
  • 4 researchers are usually needed per site, working in 1-2 hour shifts. (One to hold radar and shout out speed, the other to note vehicle type and record speed on form).
  • Ensure they are safe, visible, and have plenty of food and water.
  • Quality control (check forms every now and again / drive by sites to assess safety and ensure consistency)
  • Data collectors should be inconspicuous to make sure they don’t change driver behaviour.

Field Documentation

  • Time: Record the start time, end time and any down time. For any down times note when and why the study was interrupted, and when it was restarted.
  • Survey Data: During the speed study, survey and site data must be collected. Data should include information about existing speed zones, prevailing speeds, location of residence and business developments, locations of crash sites, roadway alignment, traffic volumes and general roadside physical characteristics. Also note any visibility restrictions and other deficiencies that may affect the overall prevailing speeds.
  • Weather Data and Road Surface Conditions: Note the type of weather and road surface conditions at the time of the study.
  • Miscellaneous: Note any additional information that may have affected speeds at a given point (e.g., special events, pedestrians, pavement condition, nearby maintenance or construction operation enforcement efforts).

Survey Tool

Speed observation forms are relatively easy to create as a word document and printed on A4 paper for data collectors to use on-site. An example from AMEND is shown below:

speed-observation-form.jpg

  • Measure speed of oncoming vehicles on one side of the road. Swap to other side every other hour.
  • Make a note of type of vehicle AND speed.
  • If amount of traffic makes it difficult to measure every car passing checkpoint then decide on a fixed sampling frame e.g. every other car, every 4th car.
  • Multiple lanes: try and gain an average speed across all lanes i.e. measure speeds of cars on all lanes traveling in same direction. 1st car in nearest lane, 2nd car in middle lane, 3rd car in farthest lane, 4th car in nearest lane etc.

The Traffic Conflict Technique (TCT) is a simple, evidence-based, low-cost method of proactively collecting observational data to evaluate the safety of intersections and stretches of roadways before and after a road safety improvement is made.

TCTs can help decision makers select and evaluate the most effective strategies for improving road safety and preventing injuries. TCTs involve counting and studying traffic conflicts and are particularly helpful in locations where data are scarce.

Using the TCT Toolkit in school zones

Since children regularly travel within school zones, the Toolkit specifically focuses on traffic conflicts between student pedestrians and cyclists and cars, buses, motorized 2- and 3-wheelers, etc. occurring in and around school zones in low- and middle-income countries. These types of traffic conflicts are referred to as pedestrian-vehicle conflicts.

The TCT Toolkit has been developed by the National Foundation for the Centers for Disease Control and Prevention (CDC Foundation) in partnership with the FIA Foundation. It is a comprehensive guide designed for anyone interested in improving road safety. It describes five different methods previously developed by road safety experts to evaluate the impact of a road safety intervention by collecting and analyzing traffic conflict data and focuses on preventing crashes and injuries among children on their way to and from school.

Steps involved in TCT

The process begins with assessing existing road user risk and then progresses to collecting and analyzing traffic conflict data to inform the selection and implementation of the road safety intervention(s). Using the pedestrian-vehicle data collection methods, traffic conflict data are collected both before (pre-intervention) and after (post-intervention) the implementation of the road safety intervention(s). Comparing the pre- and post-intervention data is useful to evaluate whether the intervention is effective in reducing traffic conflicts, and thus, reducing potential crashes, injuries and deaths.

Click here to access The Traffic Conflict Technique Toolkit

In collaboration with Bernard van Leer’s Urban95 program, Gehl has developed tools to better understand the experience of small children (ages 0-5) and their caregivers in the built environment. The Urban95 program aims to create healthy, prosperous, and vibrant cities where babies, toddlers and their families can thrive. This initiative is meant to make lasting change in the urban landscape and provide opportunities that can shape the first five years of a child’s life. The tools presented in this guide are an adaptation of the Gehl tools but tailored to small children and their caregivers. Following this mindset, the guide assumes that by focusing on the urban realm’s most vulnerable users we can better build cities that are good for everyone.

Below is an overview of the tools in this guide. Please visit the guide for more details. The guide contains directions and worksheets for each tool.

The People Moving Count tool records people moving through an area at a given time. It allows us to understand who is moving through and their form of mobility.

The Stationary Activity Mapping tool observes what kinds of stationary activities are happening in a place. It allows us to understand who is present and how a place invites for different uses.

The Urban95 Quality Criteria tool assesses specific urban qualities from the perspective of caregivers and young children. It is an informative discussion tool that allows us to highlight central characteristics of a public space for human well-being.

The Intercept Survey tool captures information about why caretakers and their children are spending time in a place. This allows us to gain deeper insight into what the other survey tools uncover.

The Sensory Mapping maps how children’s senses can be used in the built environment. It allows us to gain knowledge on what environmental prompts can be stimulating for small children 0–5.

Contains excerpts from Bernard van Leer Foundation document

Schools in Lusaka benefit from road safety improvements

Amend, with a local NGO partner and local engineer, worked in collaboration with the Mayor of Lusaka's office to implement road safety infrastructure improvements around Justin Kabwe Primary Schools in Lusaka. The school has a population of 3,220 pupils and four road traffic injuries amongst pupils were reported among the student population in the last year. The road in front of the school is quite busy with vehicular traffic.

A road safety situation assessment carried out before any improvements were done revealed that an average of 652 vehicles per hour use the road in the morning peak hour when children are going to school. At school opening times, 215 pedestrians per hour cross the road in front of the school (of which 135 are pupils of Justin Kabwe Primary School). 1,610 pedestrians per hour were found to walk along the road in front of the school (of which 1,304 were pupils of Justin Kabwe) during this same time.

Following the technical assessments of the school area and interviews with children, teachers and the wider community near the school, proposals were designed and put forward to improve the road safety situation around the school. These improvements comprised:

  • Footpaths around the school to facilitate pedestrian movement
  • A raised zebra crossing to facilitate pedestrian’s ability to cross the road safely
  • Rumble strips to alert drivers to the presence of the crossing point ahead
  • A dedicated pedestrian gate
  • Signage
  • Bollards

Road Safety education was also administered to all the pupils at the school. The lessons had a theoretical classroom portion and a practical portion carried out in the schoolyard.

Before implementation of the road safety improvements, in the 85% cases speed was above 30km/hr but this dropped by 56% to 14km/hr after implementation, demonstrating a much safer environment for pedestrians.

BEFORE

zambia-case-study-before.png

AFTER

zambia-case-study-before.png

Pilot school zone safety project contributes to legislation on reduced speeds in Vietnamese school zones.

In 2018, AIP Foundation launched its Slow Zones, Safe Zones project to improve school zone safety through targeted speed reduction interventions. Two target schools were chosen based on a selection process that considered road traffic crash figures, commitment of school administrators, and each school’s proximity to high-traffic areas.

Pre-intervention assessments showed that:

  • Target schools received scores below “three stars” on the Star Rating for Schools application
  • 100% of observed vehicles recorded speeds over 30 km/h
  • 6% of respondents could correctly identify the current speed limit

Preliminary impacts from the project’s mid-term evaluation in 2019 showed:

  • Target schools scoring at “five stars” on the Star Rating for Schools application
  • Reduction in average speed of drivers around school zones by 5 km/h (motorcycles), 11 km/h (cars), and 15-20 km/h (large vehicles)
  • Improved parent knowledge of existing speed limits from 15.9% to 72.5%

Final results from the first phase of Slow Zones, Safe Zones will be made available in 2021. Read more about Slow Zones, Safe Zones here.

 

CLEAN AIR

There is limited capacity in developing cities to build databases on air quality levels, emission sources, and health. Likewise, it takes time and resources to establish plans and measures to manage air pollution. This section provides mechanisms to assess air pollution levels for children in cities and specific localities. This information, helps local governments and community leaders manage air pollution and provides fundamental knowledge on the components of a strategic air quality management (AQM) framework. This information is essential in developing evidence-based programs and actions to mitigate impacts of air pollution on school children.

Clean Air Asia developed the Clean Air Scorecard Tool (CAST) to provide an objective assessment of a city’s air quality status, management practices, and policies. The CAST allows city stakeholders to identify AQM areas that can be improved and further guide cities in identifying and prioritizing actions.

The CAST includes three indexes: (i) Air Pollution and Health, (ii) Clean Air Management Capacity, and (iii) Clean Air Policies and Actions.

 

Overall structure of the Clean Air Scorecard

Air Pollution and Health Index (APHI)
+
Clean Air Management Capacity Index (CAMC)
+
Clean Air Policies and Actions Index (CAPA)
=
Overall Clean Air Score
  • The Air Pollution and Health Index assesses air pollution levels of cities against WHO guideline values and interim targets. Pollutants included are PM10, PM2.5, SO2, CO, NO2, Pb, and O3.
  • The Clean Air Management Capacity Index assesses a city’s capacity to (1) determine sources of emissions and their contribution to overall air quality (through an emissions inventory), (2) assess the status of air quality (through monitoring, modeling, data analysis and reporting), (3) estimate impacts on health, environment and the economy, and (4) reduce air pollution and GHG emissions through an appropriate policy and financing framework.
  • The Clean Air Policies and Actions Index assesses the existence and enforcement of national and local policies and actions to address air pollutants and GHG emissions from mobile, stationary and area sources.

Clean Air Scorecard Report and Application

Category Scores
Fully Developed 81-100
Maturing 61-80
Emerging 41-60
Developing 21-40
Underdeveloped 1-20

Each of the three indices consists of relevant questions for which points are allocated. Higher scores indicate better air quality policies and measures. The three indices each contribute a third of the potential points to the an overall Clean Air Score of 100. Cities are then categorized based on their overall score.

To see the detailed assessment and scoring structure please see the CAST information note here.

The CAST generates a report which indicates the results for each of the indexes and sub-indices and the overall score. These show the city’s strengths and weaknesses for the assessment year. The scorecard also generates the following city’s information:

  • Introduction and city profile;
  • Short- and long-term recommended actions to improve air quality management capacity;
  • Policies and measures to integrate air quality and GHG management; and
  • Identified barriers to applying the co-benefits approach.

Target Stakeholders

The tool can be used by the following:

  • Policymakers in understanding the air quality status in their localities and identify gaps in air quality and GHG management strategies and activities
  • School administrators in identifying concrete policies and programs to reduce emissions within the school vicinity, as well as measures to reduce the exposure of children to these sources in their school journey
  • Educators as the basis for developing tailored knowledge and awareness raising materials, including information on air quality status, impacts of air pollution, solutions at the personal and community level, and management practices of the school and of the local government

Stakeholder Guide in the use of the Clean Air Scorecard

 

Step 1. Identify a focal point from the city environment office. The CAST requires technical inputs from a city official on different aspects of AQM.

Step 2. Identify partners from the academia and civil society. These stakeholders will add credibility to the assessment of the AQM capacity of the city. They will also serve as alternative data providers in case the city environment agency cannot provide information.

Step 3. Undertake the CAST assessment and validate the findings. Organize a validation workshop with different stakeholders to validate the results.

Step 4. Prioritize key AQM areas for immediate project planning. Assess the availability of resources to develop and implement pollution mitigation measures and a Clean Air Action Plan (CAAP). Establish a core working group to oversee the planning process. For example, activate associations within and outside of the school, including parents, community members, and local decisionmakers and involve them in the planning process (see Implementation and Design section).

Step 5. Foster partnerships with other organizations. Collaborate with other organizations and map synergies and opportunities to maximize resources and impacts.

Step 6. Develop a roadmap for air quality improvement. The roadmap will set short, medium, and long-term targets and will define the roles of each stakeholder groups involved.

Step 7. Implement the project and roll out a monitoring and evaluation framework. With support from the local government and collaborators, keep track of the project’s progress and report/disseminate project milestones to a broader audience.

Step 8. Disseminate experience and benchmark good practices on AQM. Utilize the CAST to benchmark AQM good practices to inform scale-up of activities.

To download the Clean Air Scorecard Tool, please click here.

About the Toolkit

The toolkit was developed for primary schools so that they could gain information and plan activities for their students using citizen science to measure local air pollution.

The toolkit enables educators, local decisionmakers, support staff, and school administrators to:

  • Identify areas of poor air quality within the school vicinity
  • Enhance understanding amongst students of the causes (sources) and impacts of air pollution
  • Engage school staff, students and parents/guardians in improving air quality
  • Realize the air quality benefits of well-planned school travel and programs for energy efficiency
  • Set out and implement a 12-week timeline of activities to maximize these benefits
  • Plan for and implement measures to reduce children’s exposure to emissions, within the school and through their travel

Toolkit Use, Application and Target Stakeholders

The toolkit is divided into six sections which are tailored to different users. Each section contains guidance on how to complete activities, ideas, tips, and other resources to support the work.

Section 1: About Air Quality (For educators, local policy- and decisionmakers, and school administrators)

The section’s objective is to equip the user with fundamental knowledge and understanding of air quality, common pollutants and sources, health impacts, and recommendations on reducing emissions at the personal and family level (for students, parents and teachers). The Section sets out a Lesson Plan, activities and worksheets.

Section 2: Linking Cleaner Air 4 Schools to the National Curriculum (For educators)

The section provides an overview of how to deliver the Cleaner Air 4 Primary Schools Programme through the integration of Citizen Science and Social Marketing activities and experiments into a school’s Scheme of Work. It sets out a programme of activities which can be holistically or individually implemented by schools to introduce the air pollution issue to children, to enhance understanding of emission sources, and to introduce mechanisms to affect change. The section provides a guide in planning and implementing a 12-week programme to investigate air quality. Linkages with the National Curriculum through Citizen Science and air quality activities are highlighted.

Section 3: Citizen Science Activities (For educators)

The section provides information on several Citizen Science activities which can be implemented by schools. Resource sheets are provided, including lesson sheets, survey field guides, factsheets, record forms and detailed instructions (including costs) per activity. Guidance on organizing Social Marketing activities such as campaigns are also provided. The section focuses on using findings from investigative Citizen Science activities and identifying the major sources of air pollution around the school (i.e., are vehicles causing more emissions than establishments?), sharing findings and information with the rest of the school and at home, identifying aspects that impact air quality (i.e., school activities, travel plans), incorporating Citizen Science findings into lessons, and tracking impacts of measures and campaigns.

Section 4: Travel Plan Advice (For educators, school administrators, local policy- and decisionmakers)

The section aims to encourage, enable, and empower schools to harness the air quality improvement benefits of strategically planned school trips, to help schools increase and promote sustainable transport for school journeys. The section provides guidance on school travel plans, case studies, and suggested measures at the school and community level to reduce emissions from mobile sources and exposure of children to travel-related air pollutions.

Section 5: Reducing Emissions from School Buildings (For educators, school administrators, local policy- and decisionmakers)

The section aims to identify building-related air pollution emissions. It provides an overview of the typical sources of air pollution from school buildings and provide recommendations to reduce emissions and save on energy costs from school operations.

Section 6: Reducing Exposure to Pollution in School (For school administrators, local policy- and decisionmakers)

The section provides information and advice on reducing the exposure of staff and students to poor air quality. It provides measures and recommendations to reduce exposure of school stakeholders from mobile emissions (e.g., setting Low Emission Zones within the school vicinity), programs to increase carbon capture (e.g., school greening), provision of infrastructure for emission control, and raising awareness to change stakeholder behavior (e.g., promoting non-motorized transport for use in school journeys).

The Cleaner Air 4 Schools Toolkit can be downloaded here.

In London, the Mayor has designed a comprehensive process to assess ways to reduce emissions and exposure to air pollution in and around schools in the city. It includes ideas like:

  • moving school entrances and play areas away from busy roads

  • 'no engine idling' schemes to reduce emissions from the school run

  • local road changes including better road layouts, restricting the most polluting vehicles around schools and pedestrianisation by school entrances

  • adding green infrastructure like ‘barrier bushes’ along busy roads and in playgrounds to help filter fumes

  • encouraging students to walk and cycle to school along less polluted routes

The Mayor is encouraging London boroughs to audit every school within an area of high pollution, and to develop plans to address the issues.

The toolkit is available here

It has been designed for London, and so could have to be adapted for use in different contexts.

Cleaner Air 4 Schools is an innovative collaboration among schools, led by the London Sustainability Exchange, in partnership with UN Environment and Clean Air Asia, which was coordinated and funded by the FIA Foundation. It uses citizen science - an approach which helps communities build an understanding of the issues they face by engaging them in the collection of evidence - and provides the opportunity for children to build the knowledge and language to express and call for real change. By engaging children about the quality of air that they breathe, they can better understand their world and how to improve it. Learning about the health impacts of air pollution empowers them to become advocates of change with their families, the wider community and even local and national policy makers.

Students from Maharaja Agarsain Public School (MAPS) took part in this pioneering project to understand, monitor and act on air pollution around their schools. Using ‘citizen science’ pupils tested air quality in different locations in and around their school for NO2 as a marker of air pollution using diffusion tubes. They also mapped their current routes to school, the hazards they faced, and how those hazards might best be avoided.

The results show that every test site considered at the school showed NO2 levels well above the WHO guideline levels, including in the playground. NO2 levels were highest at the school entrance, which overlooks a narrow road where there are continuous traffic jams with motorized vehicles. Moreover, roadside test sites had twice as high levels of NO2 compared to WHO guideline limits.

Pollution Map from Maharaja Agarsain Public School showing different NO2 levels in and around the school area

 

The experience and its findings resulted in an increased awareness and understanding of both the students and parents of Maharaja Agarsain Public School on the quality of air that they have in the school area. The exercise elicited commitment from air quality champions to promote air pollution mitigation measures that will reduce the exposure of school children. These measures include promoting activities such as car sharing, planting trees and non- motorized transport.

Walkit.com is a free UK-based online urban walking route planner which provides a user a desired walking route based on the following options: shortest route, less busy route, or low pollution route. The application provides the user a walking route map that includes the estimated journey time, calories burned, step count and carbon savings.

LAEI (London Atmospheric Emissions Inventory) is a database of geo–referenced datasets of atmospheric emissions sources and information about the location, rates of emissions and estimates of the quantity of specific pollutants emitted into the air within and around the Greater London area. To have a look on how the London Air Quality Database, visit https://data.london.gov.uk/air-quality/

The initiative has worked with UK’s major cities such as London and Cambridge in introducing air pollution-aware routes which lessen individual’s exposure to air pollution. The initiative generated pollution maps based on local air quality data and modelling. Air quality data was collected from existing air quality monitoring stations in the city while emissions data came from local emissions inventories.

With the support from City Councils, pollution maps were generated by overlaying the city’s road and paths with existing air quality data and modelling results. The map uses annual average concentrations of nitrogen dioxide (NO2), a pollutant associated with road traffic and combustion sources. For the London project, the pollution maps are based on air quality modelling produced by the Greater London Authority (GLA) using information contained in their London Atmospheric Emissions Inventory 2003 (LAEI 2003). Cambridge used its annual average NO2 dataset (baseline year of 2005).

Using pollution-aware maps, users can opt to take “low pollution” walking routes to their destination. These are routes with the least average NO2 concentrations and hence, least exposure for pedestrians along the entire path segment or length. The map will also give estimates of calories burned and carbon dioxide footprint saved by taking the said route. By taking a route, users can contribute on enhancing the map’s footpath data by providing “walking knowledge” where their feedback on the routes are collated to update the pollution-aware maps. Each of the route’s journey detail is recorded and displayed on the webpage as reference for future users.

To support the project, a free SMS-alert service, airTEXT, which disseminated air pollution information in the city was launched in London. Students, parents, and school administrators can subscribe to this service to be informed of the daily air quality bulletins which can help in minimizing their exposure to air.