Preliminary evidence of the structural validity and measurement invariance of the Quantitative-CHecklist for Autism in Toddler (Q-CHAT) on Italian unselected children
Abstract
Abstract
The Quantitative-CHecklist for Autism in Toddler (Q-CHAT) is a screening measure developed to detect the early signs of risk of Autism Spectrum Disorders (ASD) in children from 18-24 months of life. After a critical analysis of the validation studies that have analyzed the Q-CHAT, the present paper aimed at testing the structural validity of the questionnaire through Confirmatory Factor Analysis and determining whether it is invariant across gender. Furthermore, the study examined the internal validity of the measure, calculated the risk cut-off score, and evaluated gender differences. Five hundred forty-five questionnaires were completed by parents of children from unselected population (age M = 19.9 months; sd= 1 month; age range = 18-21; 254 girls). Findings gave tolerable demonstration of the expected three-factor structure and measurement invariance across gender. Gender differences were also found as well as correlations among factors as a demonstration of internal validity. The risk cut-off of 43 was calculated based on the 95thpercentile of the distribution. In conclusion, the present study demonstrated preliminary findings of the validity of the Q-CHAT for Italian children. However, our findings suggested also that three items need to be reformulated because they show several psychometric problems and, after that, the factorial validity, measurement invariance, and internal validity should be re-tested. Further longitudinal studies are also needed to examine the validity criterion of the Q-CHAT to test the cut-off score.
References
References
Achenbach, T. M. and Rescorla, L. A. (2000). Manual for the ASEBA preschool forms and profiles, volume 30. Burlington, VT: University of Vermont, Research center for children, youth and families.
Adamson, L. B., Bakeman, R., Suma, K., and Robins, D. L. (2019). An expanded view of joint attention: Skill, engagement, and language in typical development and autism. Child development, 90(1):e1–e18.
Allison, C., Baron-Cohen, S., Wheelwright, S., Charman, T., Richler, J., Pasco, G., and Brayne, C. (2008). The q-chat (quantitative checklist for autism in toddlers): A normally distributed quantitative measure of autistic traits at 18–24 months of age: Preliminary report. Journal of autism and developmental disorders, 38(8):1414–1425.
Anderson, D. K., Liang, J. W., and Lord, C. (2014). Predicting young adult outcome among more and less cognitively able individuals with autism spectrum disorders. Journal of Child Psychology and Psychiatry, 55(5):485–494.
APA (2013). Diagnostic and statistical manual of mental disorders. BMC Med, 17:133– 137.
APA, A. P. A. (1994). Diagnostic and statistical manual of mental disorders. DSM-IV.
Baron-Cohen, S., Allen, J., and Gillberg, C. (1992). Can autism be detected at 18 months?: The needle, the haystack, and the chat. The British Journal of Psychiatry, 161(6):839–843.
Baron-Cohen, S., Cox, A., Baird, G., Swettenham, J., Nightingale, N., Morgan, K., Drew, A., and Charman, T. (1996). Psychological markers in the detection of autism in infancy in a large population. The British Journal of Psychiatry, 168(2):158–163.
Baron-Cohen, S., Wheelwright, S., Cox, A., Baird, G., Charman, T., Swettenham, J., Drew, A., and Doehring, P. (2000). Early identification of autism by the checklist for autism in toddlers (chat). Journal of the royal society of medicine, 93(10):521–525.
Baron-Cohen, S., Wheelwright, S., Skinner, R., Martin, J., and Clubley, E. (2001). The autism-spectrum quotient (aq): Evidence from asperger syndrome/high-functioning autism, malesand females, scientists and mathematicians. Journal of autism and de- velopmental disorders, 31(1):5–17.
Becerra-Culqui, T. A., Lynch, F. L., Owen-Smith, A. A., Spitzer, J., and Croen, L. A. (2018). Parental first concerns and timing of autism spectrum disorder diagnosis. Journal of autism and developmental disorders, 48(10):3367–3376.
Ben-Sasson, A. and Carter, A. S. (2012). The application of the first year inventory for asd screening in israel. Journal of autism and developmental disorders, 42(9):1906– 1916.
Brannick, M. T. (1995). Critical comments on applying covariance structure modeling. Journal of Organizational Behavior, 16(3):201–213.
Byrne, B. (2010). Structural equation modeling with amos: Basic concepts, applications and programming.
Chen, F., Curran, P. J., Bollen, K. A., Kirby, J., and Paxton, P. (2008). An empirical evaluation of the use of fixed cutoff points in rmsea test statistic in structural equation models. Sociological methods & research, 36(4):462–494.
Cheung, G. W. and Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural equation modeling, 9(2):233–255.
Constantino, J. N. and Todd, R. D. (2003). Autistic traits in the general population: a twin study. Archives of general psychiatry, 60(5):524–530.
Daniels, A. M. and Mandell, D. S. (2014). Explaining differences in age at autism 16 spectrum disorder diagnosis: A critical review. Autism, 18(5):583–597.
Dawson, G., Rogers, S., Munson, J., Smith, M., Winter, J., Greenson, J., Donaldson, A., and Varley, J. (2010). Randomized, controlled trial of an intervention for toddlers with autism: the early start denver model. Pediatrics, 125(1):e17–e23.
Dawson, G., Toth, K., Abbott, R., Osterling, J., Munson, J., Estes, A., and Liaw, J. (2004). Early social attention impairments in autism: social orienting, joint attention, and attention to distress. Developmental psychology, 40(2):271.
Franchini, M., Armstrong, V. L., Schaer, M., and Smith, I. M. (2019). Initiation of joint attention and related visual attention processes in infants with autism spectrum disorder: Literature review. Child Neuropsychology, 25(3):287–317.
Gunzler, D., Chen, T., Wu, P., and Zhang, H. (2013). Introduction to mediation analysis with structural equation modeling. Shanghai archives of psychiatry, 25(6):390.
Ingusci, E., Manuti, A., and Callea, A. (2016). Employability as mediator in the relation- ship between the meaning of working and job search behaviours during unemployment. Electronic Journal of Applied Statistical Analysis, 9(1):1–16.
Kelloway, E. K. (1995). Structural equation modelling in perspective. Journal of Orga- nizational Behavior, 16(3):215–224.
Kim, S. H. and Lord, C. (2010). Restricted and repetitive behaviors in toddlers and preschoolers with autism spectrum disorders based on the autism diagnostic observa- tion schedule (ados). Autism Research, 3(4):162–173.
Kline, R. B. (2015). Principles and practice of structural equation modeling. Guilford publications.
Leekam, S., Tandos, J., McConachie, H., Meins, E., Parkinson, K., Wright, C., Turner, M., Arnott, B., Vittorini, L., and Couteur, A. L. (2007). Repetitive behaviours in typi- cally developing 2-year-olds. Journal of Child Psychology and Psychiatry, 48(11):1131– 1138.
Lord, C., Rutter, M., Dilavore, P. C., and Risi, S. (2008). ADOS: Autism diagnostic observation schedule. Hogrefe Boston, MA.
Lord, C., Rutter, M., and Le Couteur, A. (1994). Autism diagnostic interview-revised: a revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. Journal of autism and developmental disorders, 24(5):659–685.
Luyster, R., Lopez, K., and Lord, C. (2007). Characterizing communicative development in children referred for autism spectrum disorders using the macarthur-bates commu- nicative development inventory (cdi). Journal of Child Language, 34(3):623–654.
Magiati, I., Goh, D. A., Lim, S. J., Gan, D. Z. Q., Leong, J., Allison, C., Baron-Cohen, S., Rifkin-Graboi, A., Broekman, B. P., Saw, S. M., et al. (2015). The psychometric properties of the quantitative-checklist for autism in toddlers (q-chat) as a measure of autistic traits in a community sample of singaporean infants and toddlers. Molecular autism, 6(1):40.
Matson, J. L., Dempsey, T., and Fodstad, J. C. (2009). Stereotypies and repeti-
Electronic Journal of Applied Statistical Analysis 17 tive/restrictive behaviours in infants with autism and pervasive developmental dis-
order. Developmental Neurorehabilitation, 12(3):122–127.
Messinger, D. S., Young, G. S., Webb, S. J., Ozonoff, S., Bryson, S. E., Carter, A., Carver, L., Charman, T., Chawarska, K., Curtin, S., et al. (2015). Early sex differences are not autism-specific: A baby siblings research consortium (bsrc) study. Molecular autism, 6(1):32.
Perry, A., Cummings, A., Geier, J. D., Freeman, N. L., Hughes, S., LaRose, L., Man- aghan, T., Reitzel, J.-A., and Williams, J. (2008). Effectiveness of intensive behavioral intervention in a large, community-based program. Research in Autism Spectrum Dis- orders, 2(4):621–642.
Pornprasertmanit, S., Miller, P., Schoemann, A., Rosseel, Y., Quick, C., Garnier- Villarreal, M., Selig, J., Boulton, A., Preacher, K., Coffman, D., et al. (2015). Package ‘semtools’. Retrieved in.
Putnick, D. L. and Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. De- velopmental review, 41:71–90.
Reinhardt, V. P., Wetherby, A. M., Schatschneider, C., and Lord, C. (2015). Exami- nation of sex differences in a large sample of young children with autism spectrum disorder and typical development. Journal of autism and developmental disorders, 45(3):697–706.
Renty, J. and Roeyers, H. (2006). Quality of life in high-functioning adults with autism spectrum disorder: The predictive value of disability and support characteristics. Autism, 10(5):511–524.
Reznick, J. S., Baranek, G. T., Reavis, S., Watson, L. R., and Crais, E. R. (2007). A parent-report instrument for identifying one-year-olds at risk for an eventual diagnosis of autism: the first year inventory. Journal of autism and developmental disorders, 37(9):1691–1710.
Robins, D. L. and Dumont-Mathieu, T. M. (2006). Early screening for autism spectrum disorders: update on the modified checklist for autism in toddlers and other measures. Journal of Developmental & Behavioral Pediatrics, 27(2):S111–S119.
Robins, D. L., Fein, D., Barton, M. L., and Green, J. A. (2001). The modified checklist for autism in toddlers: an initial study investigating the early detection of autism and pervasive developmental disorders. Journal of autism and developmental disorders, 31(2):131–144.
Rosseel, Y. (2012). Lavaan: An r package for structural equation modeling and more. version 0.5–12 (beta). Journal of statistical software, 48(2):1–36.
Rutaa, L., Arduino, G. M., Gagliano, A., Apicella, F., Leonardi, E., Fam`a, F. I., Cheri- coni, N., Costanzo, V., Turco, N., Tartarisco, G., et al. (2019). Psychometric proper- ties, factor structure and cross-cultural validity of the quantitative checklist for autism in toddlers (q-chat) in an italian community setting. Research in Autism Spectrum Disorders, 64:39–48.
Ruzich, E., Allison, C., Smith, P., Watson, P., Auyeung, B., Ring, H., and Baron-Cohen,18S. (2015). Measuring autistic traits in the general population: a systematic review of the autism-spectrum quotient (aq) in a nonclinical population sample of 6,900 typical adult males and females. Molecular autism, 6(1):2.
Sallows, G. O. and Graupner, T. D. (2005). Intensive behavioral treatment for chil- dren with autism: Four-year outcome and predictors. American journal on mental retardation, 110(6):417–438.
Sutera, S., Pandey, J., Esser, E. L., Rosenthal, M. A., Wilson, L. B., Barton, M., Green, J., Hodgson, S., Robins, D. L., Dumont-Mathieu, T., et al. (2007). Predictors of optimal outcome in toddlers diagnosed with autism spectrum disorders. Journal of autism and developmental disorders, 37(1):98–107.
Watson, L. R., Crais, E. R., Baranek, G. T., Dykstra, J. R., and Wilson, K. P. (2013). Communicative gesture use in infants with and without autism: A retrospective home video study. American Journal of Speech-Language Pathology.
WHO (1993). The ICD-10 classification of mental and behavioural disorders: Diagnostic criteria for research, volume 2. World Health Organization.
Zwaigenbaum, L., Bauman, M. L., Choueiri, R., Kasari, C., Carter, A., Granpeesheh, D., Mailloux, Z., Roley, S. S., Wagner, S., Fein, D., et al. (2015). Early intervention for children with autism spectrum disorder under 3 years of age: recommendations for practice and research. Pediatrics, 136(Supplement 1):S60–S81.
Full Text: pdf