Evaluation of the ndis final Report Kostas Mavromaras, Megan Moskos, Stéphane Mahuteau, Linda Isherwood



Yüklə 1,47 Mb.
səhifə3/69
tarix30.07.2018
ölçüsü1,47 Mb.
#64565
1   2   3   4   5   6   7   8   9   ...   69

NDIS Evaluation Data Sources

1.4.1 Overview


The NDIS evaluation is underpinned by a large evidence base collected by the evaluation team, comprising a quantitative element (consisting of a set of large scale surveys) and a qualitative element (consisting of a large number of in-depth interviews conducted with a broad range of relevant stakeholders groups). A common feature of most evidence bases for the main evaluation is that they collected information on their subjects at different points in time and more than once, in order to observe change and its impacts at the personal level. Thus, we have information at the early stages of the NDIS evaluation (typically from late 2013 to 2015) and at the later stages of the evaluation (typically late 2015 to late 2017). The Older People Study and the Mainstream Study were an exception, in that they did not utilise repeat (longitudinal) sampling, but were only conducted at a single time point, the reason being first, that difficulties in finding older people eligible for the study restricted recruitment and second, the mainstream study only became feasible at the later stages of the evaluation.

The evaluation utilises all data collections making the clear distinction about their respective strengths and weaknesses. The qualitative interviews provide evidence that is diverse and deep, and very broad ranging, but neither statistically generalisable, nor lending itself to make easy comparisons. In contrast, noting that the quantitative large scale survey evidence answers standardised questions in large numbers and is statistically generalisable lending itself to quantifiable comparisons, we recognise that it lacks the flexibility and depth offered by the qualitative evidence. The NDIS evaluation uses all evidence both separately and in an integrated manner which enables us to utilise the complementarities between quantitative and qualitative data.

On the quantitative side, we report the first and second wave of the longitudinal survey of people with disability and their carers. The sampling of people with disability and their carers covered NDIS participants, but also NDIS eligible non-participants (that is, people who would have been eligible to participate, if they were located in a trial site). This enables comparisons to be made between people with disability who are similar insofar as their disability is concerned, but different as to their ability to participate in the NDIS. In addition, we report the two waves of the survey of disability support providers, which included employers, their workers and the self-employed. The sample for these surveys included all providers irrespective of their registration status with the NDIS. In all sampling WA was excluded as a separate evaluation was conducted within that state.

On the qualitative side, we report the findings from the two waves of interviews with NDIS participants and their carers, disability service providers, disability workforce stakeholder organisations, and NDIA staff undertaken as part of the qualitative impact evaluation in the five original trial sites. We also report separately on the two waves of interviews undertaken with the same stakeholder groups for the evaluation of the NDIS in the Barkly Region of the NT; and one wave of interviews undertaken with various stakeholder groups as a part of two additional studies exploring the impact of the NDIS on mainstream health, mental health, education and employment sectors and on older people with disability and the aged care sector.

Table 1.1 summarises the samples sizes on which the evidence in this report is based. It records the number of respondents upon whom the analysis is performed. For the analysis using wave 2 data (third column), the numbers stated in Table 1 are lower than the actual final response rates to the survey (See Table 1.3) because the data collection extended to mid-November 2017 while the needed cut-off point for the data analysis to be included in the report was end September 2017. There are also a few number variations between trial and comparison groups from wave 1 to wave 2 because some people with disability joined the NDIS between wave 1 and wave 2 after being surveyed as comparison in wave 1, but we consider these statistically negligible. This explains the apparently low number of wave 2 comparison individuals, as about 220 wave 1 comparison individuals have moved to a Trial survey in wave 2 (by reporting they have become NDIS participants). We also observed a few individuals who were surveyed as Trial participants in wave 1 but who no longer identified as such in wave 2 and these were subsequently surveyed as members of the comparison group.

A brief overview of each of these evaluation components is provided below. For a more comprehensive overview of the methodologies employed please refer to the NDIS evaluation Initial Report (2015), the NDIS evaluation Intermediate Report (Mavromaras, Moskos and Mahuteau 2016) and the Appendices of this report.



Table .1: NDIS evaluation sample

Quantitative

Wave 1*

Wave 2

Timing of wave 1

Timing of wave 2

The NDIS Survey of People with Disability

-

-

Aug 14 - May 17

Jun 17 - Nov 17

Trial - NDIS participants

3,533

1,355

Aug 14 - May 17

Jun 17 - Nov 17

Comparison - People with disability

2,139

588

Aug 14 - May 17

Jun 17 - Nov 17

Total Trial and Comparison

5,672

1943

Aug 14 - May 17

Jun 17 - Nov 17

The NDIS Survey for Families and Carers

-

-

Aug 14 - May 17

Jun 17 - Nov 17

Trial - Carers

2,713

997

Aug 14 - May 17

Jun 17 - Nov 17

Comparison - Carers

1,738

385

Aug 14 - May 17

Jun 17 - Nov 17

Total Trial and Comparison

4451

1382

Aug 14 - May 17

Jun 17 - Nov 17

*Sample/Responses for waves 1a, 1b and 1c

The NDIS Survey for Families and Carers

Wave 1

Wave 2

Jun 14 - Apr 15

Jun 17 - Nov 17

Outlets

697

255

Jun 14 - Apr 15

Jun 17 - Nov 17

Workers

2,133

n/a

Jun 14 - Apr 15

n/a

Self-employed

272

265

Jun 14 - Apr 15

Jun 17 - Nov 17




Qualitative

Wave 1

Wave 2

Timing of wave 1

Timing of wave 2

The qualitative impact evaluation













Interviews with NDIS participants and their carers

62

61

Aug 14 - Feb 15

Aug 15 – Feb 16

Interviews with disability service providers

25

24

Sep 14 - Nov 14

Sep 15 - Dec 15

Interviews with disability stakeholder organisations

15

14

Sep 14 -Dec 14

Sep 15 - Dec 15

Interviews with NDIA staff

46

39

Oct 14 – Apr 15

Oct 15 - May 16

Interviews with non-NDIS participants

n/a

16

n/a

Sep 15 - Feb 16

The NT NDIS evaluation

-

-

-

-

Interviews with NDIS participants and carers in the Barkly region

31

28

Jul 15 - Mar 16

Oct 16 - Jun 17

Interviews with people with disability and carers in Alice Springs

13

12

Mar 16 -Sep 16

May 17 - Jun 17

Interviews with disability service sector representatives

18

23

Feb 15 - Jun 15

Feb 16 - Oct 16

Interviews with NDIA staff

9

15

Jan 15 - May 15

Jun 16 - Oct 16

The Older People Study

-

-

-

-

Interviews with older people with disability (NDIS participants)

n/a

20

n/a

May 17 – Jun 17

Interviews with older people with disability (Non-NDIS participants)

n/a

26

n/a

May 17 - Jun 17

Interviews with aged care and disability service providers

n/a

21

n/a

Jan 17 - Jun 17

Interviews with stakeholder organisations

n/a

13

n/a

Apr 16 - Aug 16

The Mainstream Study

-

-

-

-

Interviews with representatives from health sector

n/a

15

n/a

Nov 16 – Aug 17

Interviews with representative from mental health sector

n/a

4

n/a

Nov 16 – Aug 17

Interviews with representatives from employment sector

n/a

5

n/a

Nov 16 – Aug 17

Interviews with representatives from education sector

n/a

9

n/a

Nov 16 – Aug 17

Interviews with representatives from national or other sectors

n/a

9

n/a

Nov 16 – Aug 17





Yüklə 1,47 Mb.

Dostları ilə paylaş:
1   2   3   4   5   6   7   8   9   ...   69




Verilənlər bazası müəlliflik hüququ ilə müdafiə olunur ©muhaz.org 2022
rəhbərliyinə müraciət

    Ana səhifə