Surveys are a key tool in collecting information about a "population", whether that population is a set of people, households, businesses or even pieces of equipment. Most surveys use information from a subset or sample of the population, which if done right will lead to an understanding of the whole targeted population. Such sample surveys require proper statistical input in their design and analysis.
Surveys can be a major investment, with results often playing an important role in strategic planning decisions. Therefore, it is critical to invest in a good design, good implementation and the best analysis. Data Analysis Australia's statisticians and survey researchers have years of expertise, specialising in ensuring surveys meet the individual needs of our clients.
Data Analysis Australia consultants can advise on all aspects of survey design, implementation and reporting:
Between 2002 and 2005 Data Analysis Australia carried out the Perth and Regions Travel Survey (PARTS) for a consortium of Western Australian government departments. This was the most comprehensive survey of the movements and activities of Perth residents for decades and involved sampling over 11,000 households, collecting for each a snapshot of a single day's travel for all the people in the household. The detail was unmatched - it even itemised how far people walked to the bus.
The National Preschool Census has been conducted by Data Analysis Australia almost annually since 1993. This survey initially targeted issues of Indigenous education and participation but has expanded to be the major information collection to inform national policy on preschools. It aims to be a Census and regularly achieves response rates in excess of 98%. A unique feature is the merging of survey data with data collected through some of the State and Territory education systems.
Customer Satisfaction Surveys
Data Analysis Australia has been involved with customer satisfaction projects for many government and non-government organisations including the Insurance Commission of Western Australia, Department of Housing and Works, Legal Aid WA and the City of Subiaco, including many others that meet the Auditor General's requirements of achieving a minimum of 5% error at the 95% confidence level.
The Insurance Commission of Western Australia has contracted Data Analysis Australia since 1995 for a number of these surveys including two organisation wide customer satisfaction surveys in 1995 and 1996, and the RiskCover Division Customer Satisfaction Survey annually from 1997 to 2009. The methodology developed for these surveys combines quantitative expertise with qualitative research in order to investigate customer satisfaction. This allows for the development of Division-wide strategic recommendations, whilst also giving specific feedback on customer satisfaction within each key area of service.
From 2002 to 2006, Data Analysis Australia conducted annual client satisfaction surveys for Legal Aid Western Australia. The surveys alternated between family law and criminal law clients on an annual basis. Telephone interviews with clients were conducted under the strictest confidence, since the environment in which respondents find themselves to be clients of Legal Aid are highly sensitive. Data Analysis Australia also produced an index of satisfaction by combining the responses to a number of questions and by weighting the contribution of various surveyed client groups.
Data Analysis Australia has designed and hosted many web-based surveys. Through our in-house software developed using the python language, we have experience in implementing web surveys ranging from the very simple to the extremely complicated. Data Analysis Australia has a thorough understanding of the advantages of the technology that can be exploited, as well as potential pitfalls to the results if not implemented correctly. Some of our web-based surveys have been supplemented by other forms of data collection (such as paper based questionnaires) to reduce biases that can arise if web-based data collection is used alone.
Data Analysis Australia's IT professionals develop the online surveys, so there is a great deal of flexibility in how the survey is set up allowing it to be fully tailored to suit the requirements of the client. The following features can be applied:
Sampling, Weighting and Standard Errors
Data Analysis Australia has provided assistance in designing sampling strategies for numerous clients where sufficient sample was required to allow analysis at an aggregated and disaggregated level. One such example related to a survey of 100 schools across Australia. The sample was designed to ensure a reasonable representation of primary and secondary schools in each state, and a mixture of government, catholic and independent schools, whilst maintaining a minimum of two schools per stratum to enable standard errors to be calculated. Another example was a survey to measure average speed, fuel consumption and tyre life of Western Australian school buses, whereby the sample was designed to enable coverage and analysis of a range of bus types, locations across Western Australia and times of year. Survey weights and standard errors were calculated taking the sampling methodology into account.
The Student Outcomes Surveys (SOS) are a key tool in the ongoing monitoring and improvement in the Vocational Education Training (VET) sector across Australia. Thousands of students were surveyed with a high degree of stratification in the sampling and estimation stages to ensure representation across different institutions, fields of study, age and gender. The high level of stratification and resulting low numbers of respondents in some strata required a complex weighting process to be implemented. Data Analysis Australia provided expert advice on how the weighting processes could be improved in future years, as well as ensuring consistency with previous years' outputs. Data Analysis Australia also calculated the standard errors and confidence intervals for the key tables, ensuring that the effects of the stratification and weighting processes were properly taken into account.