How - A Step-by-Step Guide to the Te Arotūriki Process - CONTINUED

DETAILS OF CONSULTATION PHASE

Monitoring and Evaluation

An important aim of the Te Arotūruki process is the establishment of sustainable relationships between Māori and scientists. It is hoped that establishing such relationships will set up future opportunities and open doors to research and development pathways previously unexplored or thought unachievable.

Key to establishing ongoing relationships will be the implementation of robust systems to monitor and evaluate and continuously develop and improve how things are done and measurable outputs achieved.

It is important for both scientists and Māori to participate in the monitoring and evaluation stage of Te Arotūruki as this process will be essential to finding new ways to engage and dialogue with Māori. Engaging Māori communities in positive dialogue about controversial technologies will be challenging that will involve bringing together different and opposing positions. Understanding how the process worked and what the pitfalls were will provide creative ideas for having safe and productive, and stimulating conversations with Māori.

The easiest and most effective way to monitor and evaluate how the Te Arotūruki process has worked will be a mixture between survey and face to face conversations (interviews and small working groups).

The poroporoaki (farewell and wind up) process is integral to tikanga Māori processes and can be used as an effective tool to reflect and provide space for evaluation at the end of any focus group or hui that has occurred. A skilled MI will be able to facilitate this process which will is a culturally appropriate and effective way to gain feedback from Māori. Henceforth, the monitoring and evaluation process will need to be ongoing and a continuous iterative process of dialogue between Māori and scientists.

Below are a set of key questions that will guide monitoring of the Te Arotūruki process however, a skilled MI will be able work with Māori and scientists to unravel the key issues by asking the questions needed to get an accurate gage of how to improve the develop the process.

Key questions

• How would you rate this process on a scale of 1-10?
  (Also ask related questions like: What would it take to improve your score by 3 points?. For example, if you gave a score of 5, what would have made you score an 8?)
• What were some of the values that you felt underpinned this process (e.g. manaakitanga, kaitiakitanga, rangatiratanga, gate-keeping, controlling, trusting)?
• Were there sufficient resources available to ensure effective outcomes achieved?
• Did you feel you had sufficient authority throughout to the decisions needed to ensure the process was successful?
• Have there been moves to build capacity or change how things are done in your organisation?
• Were the venue, process, appropriate and effective for good dialogue?
• Did the process affirm tikanga Māori i.e. Māori feel comfortable to talk?
• Was there any shift in your understanding about an issue?
• Was there a shift in your understanding about an organisation\individual?
• Would you be willing to engage in a dialogue process in future?
• Did the process deliver positive outcomes and benefits?
• Has the progress of the research proposal been well communicated?
• How did this process assist or hinder your ability to communicate with the others?
• Was the process clearly defined?
• Were your expectations of this process met?
• Were there unanticipated benefits? (e.g. new knowledge learnt, increased trust, change perceptions?)
• What would help to improve this process for you?
• What was your assessment of the skills and experience of the MI?
• Have you and your colleagues\whanau members benefited from discussion of the issues among yourselves?

We suggest that as you discuss these and capture answers to these questions in the Consultation Plan Template found here.

In conclusion

There will need to be a strategic approach the ensuring that the Te Arotūruki process is effectively monitored and evaluated. Strategic in a sense that a case by case approach is needed as different issues will apply and some questions (outlined above will be more relevant than others).

As stated above the use of face to face interviews, focus group discussions and tikanga based processes such as poroporoaki will provide effective tools to monitor and evaluate outcomes and improve dialogue processes. The MI will play an essential role in ensuring this stage of the process is not overlooked or underutilised.

Long term goals of strategic alliance, joint ventures and mutually beneficial projects and initiatives can be achieved with ongoing commitment to quality control and review of processes based on an open and honest iterative feedback. To be effective the Te Arotūruki is best viewed as a cyclic process that will grow and evolve according to the issues raised and the people involved.

<< BACK