PEKE ATU KI TE RĀRANGI TAKE MATUA / TIROHANGA REREKĒTANGA NUI
Ngā Tānga Kupu

Evaluation of Investments in the Strengthening Management and Governance Programme

Online survey

The table below shows the steps and activities that were undertaken for the online survey.

Table 4: Step-by-step procedure for the online survey

Table 4: Step-by-step procedure for the online survey
StepActivity
1. Planning process Determining resources – a programme plan was established identifying all the resources needed to implement the survey. These activities included:
  • generating survey questions (peer reviewed by Research, Information and Monitoring Team and programme staff);
  • developing the online tool and hosting the tool on the Te Puni Kōkiri server;
  • testing the survey with a sample of Te Puni Kōkiri staff and one external expert to focus on sufficiency and clarity of content, accessibility, interpretability and any relevant issues with the survey tool;
  • generating an email list of all SMG programme participants from the Te Puni Kōkiri administrative database and validating the list by the programme and regional staff;
    • and
  • informing Te Puni Kōkiri staff of the objectives of the evaluation.
2. Data collection
  • Implementing the survey – sending the web link to all respondents, with instructions on how to complete the survey.
  • Sending reminders to participants to complete the survey.
3. Data analysis Downloading and cleaning data from the Te Puni Kōkiri server and exporting into MS Excel for analysis.
4. Reporting Interpreting data and integrating with the qualitative findings.

The online survey was sent to all 110 organisations that had participated, or were currently participating, in the SMG programme. Best efforts were made to source up-to-date email addresses from regional staff; however, of the 110 organisations:

  • 13 organisations had invalid email addresses (and current email addresses were not able to be sourced);
  • six organisations had duplicate email addresses in the database; and
  • two organisations notified the evaluation team that the key person with knowledge of and information about the SMG programme had left the organisation.

As a result, the total population for the online survey was reduced to 89 organisations.

The online survey was initially run for two weeks (from 3 to 17 March 2008), which generated a 46% response rate. The evaluation team decided to extend the survey for another three weeks (until 7 April) to further increase the response rate. This resulted in only three additional completed surveys.

A total of 45 valid surveys (51%) were completed, which is above the average response rate for online surveys. The literature15 confirmed that the average response rate for online surveys is between 30% and 40%.

 

15 Ritter & Sue (2007).