# data[].attributes.body
Measuring growth and medium- and longer-term outcomes in malnourished children

# data[].attributes.headline
Skinfold thickness technique: DAPA website

# data[].attributes.subject
Skinfold thickness technique: DAPA website

# data[].attributes.attachment_link.description
The skinfold method, the measurement of subcutaneous fat folds, is the most widely adopted field method for the assessment of body fat, especially in children.

# data[].attributes.body
Here is an OSF link to SHINE School-aged follow-up resources

# data[].attributes.attachment_link.description
The SHINE Follow-up study (PACTR number PACTR202201828512110) aims to re-enrol 1300 children born into the SHINE trial who are now aged 7 years to assess school-aged health, growth, physical and cognitive function using the School Age Health, Activity, Resilience, Anthropometry and Neurocognitive (SAHARAN) toolbox.

# data[].attributes.body
https://pubmed.ncbi.nlm.nih.gov/20961915/

# data[].attributes.attachment_link.title
Field-based fitness assessment in young people: the ALPHA health-related fitness test battery for children and adolescents - PubMed

# data[].attributes.attachment_link.description
The present study summarises the work developed by the ALPHA (Assessing Levels of Physical Activity) study and describes the procedures followed to select the tests included in the ALPHA health-related fitness test battery for children and adolescents. The authors reviewed physical fitness and healt…

# data[].attributes.headline
COSMIN tool & tablet-based tools for assessing cognition

# data[].attributes.subject
COSMIN tool & tablet-based tools for assessing cognition

# data[].attributes.body
Useful review detailing the COSMIN procedure and tablet-based measures of cognitive and executive function in children

# data[].attributes.attachment_link.readable_text
Megan S. McHenry,

Debarati Mukherjee,

Supriya Bhavnani,

Amir Kirolos,

Joe D. Piper,

Maria M. Crespo-Llado,

Melissa J. Gladstone

Subject Areas

For more information about PLOS Subject Areas, click here.

We want your feedback. Do these Subject Areas make sense for this article? Click the target next to the incorrect Subject Area and let us know. Thanks for your help!

Abstract

Interest in measuring cognition in children in low-resourced settings has increased in recent years, but options for cognitive assessments are limited. Researchers are faced with challenges when using existing assessments in these settings, such as trained workforce shortages, less relevant testing stimuli, limitations of proprietary assessments, and inadequate parental knowledge of cognitive milestones. Tablet-based direct child assessments are emerging as a practical solution to these challenges, but evidence of their validity and utility in cross-cultural settings is limited. In this overview, we introduce key concepts of this field while exploring the current landscape of tablet-based assessments for low-resourced settings. We also make recommendations for future directions of this relatively novel field. We conclude that tablet-based assessments are an emerging and promising method of assessing cognition in young children. Further awareness and dissemination of validated tablet-based assessments may increase capacity for child development research and clinical practice in low-resourced settings.

Author summary

Tools that measure cognitive skills are key to identifying children in need of critical interventions to reach their full potential. However, there are barriers inherent in the application of traditional tools, such as the need for trained professionals, the relevance of the testing items, and the time needed to complete the evaluations. This disproportionately impacts populations living in low-resourced settings. Emerging research indicates that tablet computers can easily administer essential cognitive testing across low-resourced settings and overcome many of the barriers from the use of traditional tools. However, no resources are available that succinctly review the key considerations and available options for tablet-based cognitive assessments. Therefore, in this review, we summarize the existing known tablet-based cognitive assessments used in low-resourced settings and evaluate a myriad of factors important for the application of computerized cognitive assessments across different cultural contexts. We also offer recommendations for the future output of tablet-based assessments, which may mediate the gap for use of cognitive testing within low-resourced settings. Overall, we determine that tablet-based assessments are a promising solution among these settings, and further insight and awareness of these tools may increase their utility.

Citation: McHenry MS, Mukherjee D, Bhavnani S, Kirolos A, Piper JD, Crespo-Llado MM, et al. (2023) The current landscape and future of tablet-based cognitive assessments for children in low-resourced settings. PLOS Digit Health 2(2): e0000196. https://doi.org/10.1371/journal.pdig.0000196

Editor: Nitika Pant Pai, Research Institute of the McGill University Health Centre, McGill University, CANADA

Published: February 23, 2023

Copyright: © 2023 McHenry et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Funding: MSM was supported by an NIH Career Development Award (K23MH116808) during the development and writing of this review. DM was supported by the DST-INSPIRE Faculty fellowship awarded by the Indian government during this tenure. SB was supported by the DST-INSPIRE Faculty fellowship (India), the Corporate Social Responsibility initiative of Madura Microfinance Ltd (India) and the Medical Research Council (UK). JP was funded by a Wellcome Trust (grant number 220671/Z/20/Z). AK is supported by a Wellcome Trust Clinical PhD Programme Fellowship with grant reference: 203919/Z/16/Z.

Competing interests: I have read the journal's policy and the authors of this manuscript have the following competing interests: MSM led the adaptation of the NIH Toolbox tests in Dholou and Swahili languages. She was not paid or compensated for this specific work in any formal or consultancy role. DM supported the development and validation of DEEP among preschool children in rural India and was a part of the consortium that developed and validated START. SB co-led the development and validation of DEEP and was also a part of the consortium that developed and validated START. JP has piloted the Plus-EF in rural Zimbabwe. MJG received funding from the Medical Research Council and National Institutes of Health for research which is utilising DEEP in Malawi as well as by Wellcome Trust and Autism Speaks. MJG also has some consultancy funding from the World Health Organisation for support of work on the Global Scales of Early Development (GSED). AK has no COI at this time.

1. Introduction

As global focus shifts from ensuring children survive to enabling them to thrive, millions of children living in low-resourced settings are found to be at-risk of not attaining their full developmental potential [ 1]. This is due to their disproportionately high exposure to risk factors for poor development during critical periods in childhood [ 2], including malnutrition, iron-deficiency anemia, infectious diseases, exposure to violence, exposure to toxins, extreme poverty, maternal depression, and inadequate cognitive stimulation [ 3]. While interventions and programs are being implemented to address these risk factors [ 4, 5], we need to understand how best to optimize neurocognitive outcomes within the context of scarce resources.

Healthy child development comprises a complex interplay of rapid physiological, psychological, and physical changes in response to early environmental experiences, with lasting effects on multiple domains of development, including cognition. Cognitive development in preschool years, through which children develop the skills to acquire, assimilate and apply knowledge, has been demonstrated to be predictive of later outcomes such as IQ and academic achievement [ 6, 7]. Executive function, a key component of cognitive development, is our ability to temporarily manipulate information mentally (working memory), generate different solutions to a problem (cognitive flexibility), and maintain impulse control (inhibition). Executive function enables us to plan, focus attention, set and achieve goals [ 8], and it predicts math, reading, and science achievements in school [ 9- 11]. Deficits in cognitive ability and executive function have long-term impacts across the life-course, starting with poor educational attainment and resulting in loss of adult income, thus impacting the livelihood of families, communities, and countries [ 4]. Therefore, high-quality measures of cognitive development, including executive functioning, are essential to identify children at-risk of not attaining their full developmental potential, triaging them into timely interventions, and finally, monitoring their impact on developmental trajectories within clinical, research, or community-based settings.

Many tools have been used in measurement of cognition and in some cases, executive function, in low-resource settings. Assessing cognitive ability, and in particular, executive function, in children within these settings, may be impeded by a number of challenges. These challenges include using tools with appropriate cultural and language adaptations, training a workforce for high-quality administration, and utilizing tools with adequate reliability and validity, while maintaining affordability and scalability [ 12, 13].

Currently, many neurocognitive assessments depend on observations of child behavior conducted by child development and neuropsychology specialists, who undergo substantial training to become proficient in high quality and consistent administration, scoring and interpretation of assessment tools. Although capacity building and infrastructure in psychological testing has improved in recent years, many countries still have few trained workers qualified to implement these tools [ 14]. Examples of tools used for measuring cognition are the Kaufman-ABC or the Wechsler Preschool and Primary Scale of Intelligence (WPPSI) [ 15, 16] and in younger children, the Bayley Scales for Infant and Toddler Development [ 17]. Measurement of executive function has been measured with tools including, but not limited to, the NEuroPSYchological Asssessment (NEPSY) [ 18, 19], the knock-tap tests [ 20], the Spin the Pots task [ 21], or parent report measures such as the Behavior Rating Inventory of Executive Function (BRIEF) [ 22]. These all vary in reliability and validity [ 13]. Most of these tools have been developed and validated within high-resource settings, although some attempts have been made to develop versions for other settings. This can present further challenges, as most items in neuropsychological assessment tools are contextually related to settings where tools were developed and validated, therefore requiring lengthy and expensive adaptation process for use cross-culturally. This has been attempted in some settings, e.g., Kilifi, Kenya, where a battery was made for an African context; however, difficulties remain in capacity to scale-up training, application, and measurement [ 23]. Furthermore, tools created in high-resource contexts are often proprietary and the cost to administer in low-resourced settings can be prohibitive. There is, thus, a paucity of contextually relevant scalable cognitive assessment tools developed, validated, and used within low-resourced settings [ 24]. We define low-resourced settings as those with a population facing health inequities that negatively impact child development, typically in low- and middle-income countries.

Advances in technology, including the emergence of tablet computers, could be leveraged to aid in the scalable evaluation of cognition and particularly executive function, across a wide range of settings. Tablet computers are readily available, inexpensive, portable, and have functionality without internet. Paper-based childhood developmental assessment tools are increasingly being deployed on tablet computers using basic open data kits or similar programs. This includes the Malawi Developmental Assessment Tool (MDAT) [ 25] and the Global Scales of Early Development (GSED) [ 26]. While this standardizes administration and scoring by minimizing errors, these tools either rely on parent report, assuming parental knowledge of developmental milestones, or behavioral observations of children by non-specialists, which itself is resource-intensive and only partially addresses the workforce challenge.

In recent years, computerized tasks within tablet computers are increasingly being used to evaluate child performance directly. This has the potential to overcome many current challenges of measuring cognition in children globally. These tools permit the administration and scoring of a broad array of tasks that measure specific domains of cognitive functioning with minimal potential for error, while also having the potential to be gamified [ 27], increasing children's interest in these cognitive tasks. Furthermore, with cameras (to capture images and videos during task performance), accelerometers and gyroscopes (to estimate motion and force on the screen) [ 19, 20], timers (to assess latency in responses) [ 28], and microphones (to capture audio), developers can tap into a wide range of child responses to assess their cognitive abilities [ 29]. Such nuanced variables are not feasibly evaluated with traditional pen-and-paper administration of cognitive assessment tools [ 30, 31]. Because the cognitive tasks are administered with a tablet computer rather than skilled observation of child behavior, it requires very little workforce support for administration or scoring, enabling non-specialists with minimal training to administer tasks. While smartphone technology has similar strengths, the smaller screen size presents some limitations and, at this point, only a few cognitive tools are under development for smartphone use. In sum, tablet computers provide opportunities to perform high-quality cognitive assessments of children in a manner that is easily scalable and practical in low-resourced settings.

While this technology appears to be the future of cognitive testing, no known summary of these tools exists. This overview aims to summarize the current landscape of tablet-based cognitive assessment tools used in low-resourced settings that directly measure child performance. We pose considerations for use of these tools with the existing state of the evidence and make recommendations for ways in which this novel field can move forward. This overview is for those who may want to use tools for programmatic and research evaluation and therefore specifically targets information on the feasibility and validity of the tools in their current format, when used in low-resource settings.

2. Methodology for compiling tools

We identified tablet-based cognitive assessment tools by performing a general scoping literature search as well as through reaching out to international content experts working in the field. We aimed to identify peer-reviewed articles providing information on tablet-based cognitive assessment tools from electronic databases that included PubMed and Google Scholar identifying any publications from January 2000 to September 2021. The search terms used included "cognition", "executive function," "pediatrics," "tabled-based assessments," and "children." Inclusion criteria required that the assessment had to measure cognition was used in children under 18 years of age, was used in low-resourced settings, and was used on a tablet computer. Tools were excluded if they were only used in well-resourced settings or performed only on smartphones or laptop/desktop computers. Much of the information gathered required direct interviews with the developers and was not available through peer-reviewed articles. We therefore supplemented our literature search through general search engines, such as Google and Bing, and sought topic experts (i.e., those who lead and consult on projects measuring cognition in low-resourced settings, but do not themselves develop tools) to identify further tools. We emailed each application developer requesting an interview and further information about any other known tablet-based cognitive assessment tools used in low-resourced settings. Through our review of published papers, websites, and interviews with developers, we collected data on domains of cognition and executive function measured, time for training and administration, country of use and present adaptations, psychometric properties of each tool (as published to date), and feasibility of use.

3. Current landscape of tablet-based cognitive assessment tools for children

Numerous commercial and non-commercial tablet-based cognitive assessment tools have been developed in recent years. From our search, we identified 16 tools and described characteristics of each in Table 1 and Fig 1. Most tools were developed in North America, Europe, or Australia and initially used the English language, which was subsequently translated into other languages. Two tools had significant development work performed in India (DEEP and START), which included formative work in the community and iterative development of the user-interface through testing with non-specialist administrators and the target age range of children [ 32]. One tool has been further developed in Brazil (Educational Neuroscience App-Based Learning Environment (ENABLE). From interviews with the tool developers, the primary users of these tools, to date, are researchers, with administration being performed by research staff or community health workers. However, some tools, such as the Early Years Toolbox and NIH Toolbox, have also been used by educators and clinicians as well.

The names of the tools are listed in the Y-axis, with non-commercial tools listed first, followed by commercial tools. The X-axis is the range of ages, in years, for the intended population for the tool's use. The numbers encompassed by () by the tool names indicates the number of languages for which the tool is translated. The numbers within the bands indicate the number of minutes (min) required to complete each test, with the number of tests listed in []. The color of the bands indicates the amount of training required to administer, with blue indicating <4 h of required training, yellow indicating an estimated 4-12 h of required training, pink indicating an estimated >12 h of required training.

While nearly all commercial tools have age ranges that extend into adulthood, the non-commercial tools tend to have more narrow ranges, likely due to a target study population for whom the initial tool was developed. Most assessment tools contain batteries that consist of individual tests, and the length of the assessment is modifiable based on the number of tests selected. For example, Cantab and Cogstate each have over 16 tests that can be administered, depending on the needs of the user [ 33, 34]. Most tools contain tests that each evaluate specific domains of cognition, often focusing on memory, attention, visual-spatial, and inhibition tasks ( Table 2). Babyscreen and the Minnesota Executive Function Scale (MEFS)/EFgo test the youngest age range of children (as young as 18 months of age), but only have 1 test administered measuring multiple sub-domains of cognition [ 35, 36]. The MEFS/Efgo tool administers a test based similar to the Dimensional Change Card Sort task, aiming to measure inhibition, cognitive flexibility, and memory [ 36]. This approach is linked to the challenges of tapping into specific, differentiated dimensions of cognitive tasks within these early ages [ 37].

4. Considerations for identifying the tool(s) of choice

While the concept and aims of these tablet-based cognitive assessment tools are often similar, their strengths and limitations are highlighted for potential users to consider while identifying an appropriate tool for their setting. Some limitations are inherent to the way tools are funded and designed. Non-commercial tools are often developed by academicians with grant funding. These are therefore typically dependent on this funding or other program fees to maintain and update applications along with the tablet operating system. While these tools are often open-source, and hence costs are generally low, researchers often must directly contact developers to arrange for an agreement for tool use. While this benefits smaller projects with budgetary constraints, the lack of available support can cause delays in their implementation or any adjustments required.

Specific tools also have their own strengths and limitations. The Early Years Toolbox is the only tool that is freely downloadable and has instructions on administration on its website, a great strength in its accessibility. However, due to the "open access" nature of the tool, this results in limited knowledge on the full extent on locations of use and the degree of success of cross-cultural administration. This can only be gleaned from published articles and reports of its use, which may be subject to publication bias. A summary of the strengths and limitations for each tool is included in Table 3. Associated psychometrics and additional information about these tools are detailed in the S1 File.

We identified a number of factors we consider important when choosing a tool for use in a low-resourced setting for measuring cognition in early childhood. These include (a) ease of using technology to measure cognition in the early childhood; (b) validity in varying cultural contexts; (c) ease of adaptability for different settings; (d) overcoming workforce challenges; and (e) accessibility.

Use of technology to assess cognition in the early childhood

There is still debate as to whether young children can be assessed appropriately and reliably using technology in the early years. Within this review, most tablet-based tools start testing at 3 years and older. In high-resourced settings, evidence suggests that children as young as 2 years may appropriately engage with digital technologies [ 38, 39]. However, at these early ages, the foundations of executive functioning and cognition are being laid, adding to the challenge of isolating those constructs for testing [ 40]. Measurement of cognition at under 3 years of age may therefore, still be best performed with in-person or parent-report assessment tools [ 41] or with neurophysiological tests or imaging that map neural correlates underlying cognitive functions [ 42]. Many tools, especially non-commercial tools, are gamified, featuring appealing and narrative graphics for children. While this aids in overcoming the challenge of engaging children in assessment tools, the bright and interesting images may inadvertently lead to an overestimation of the domain of attention and impulsivity [ 27].

Validity of tools for varying socioeconomic and cultural settings

An important first step in choosing a cognitive tool is to critically review its measurement properties (such as validity and reliability). The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) guidelines provide a framework to guide this [ 43] and supports the use of both qualitative (acceptability, face, and content validity) and quantitative aspects of validity (construct, cultural, and structural validity) alongside reliability ( Fig 2). While nearly all the tablet-based cognitive tests included in this review (14/16) have some preliminary or published validity data ( S1 File), the detail and rigor of this psychometric testing differs among tools. Some tools have attempted validation against a "gold standard." However, this is complex, particularly in international low-resourced settings since "gold standard assessment tools" are typically developed and validated in high-resourced western settings.

Domains of psychometric properties adapted from the following publication: Mokkink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: A clarification of its content. BMC Medical Research Methodology. 2010;10(1):22.

Evaluating validity of tools can be particularly challenging within settings where children have limited daily exposure to technology or the items contained within the assessment tool. Tools are often developed for children with high exposure to technology, indicating that limited exposure may impact a child's ability to interact with the tool's content in the same meaningful way. However, evidence is emerging that suggests the lack of prior exposure to smart devices may not impact the accuracy with which tablet-based tools can measure cognition [ 28]. Indeed, a "rights-based perspective" would argue that technology coupled with culturally neutral content can benefit children globally. However, our review has identified rigorous psychometric testing as a gap in this field, which warrants additional consideration as tablet-based tools are disseminated widely.

Notably, caution should be taken when interpreting the assessment scores for children who differ significantly, either by language, age, or culture, from the original normative population of the assessment tool. Certain aspects of cognition are more adaptive and highly prioritized in some settings compared to others, and thus, the normative range of scores is likely to differ across settings. Thus, issues will arise when one depends on the normative population data to determine cutoffs for deficits in cognition or to function as a comparison or control group.

Ease of adaptability of tools for different settings

The first generation of tablet-based assessment tools were programmed with a single language in mind, with no ability to adapt for different contexts or languages. More recent tools have built-in functionality to allow for easy adaptability between contexts and languages, as long as the appropriate adaptation methodologies are used. Some tools require very little language for their use. For example, Developmental Assessment on an E-Platform (DEEP) and Babyscreen have little to no language incorporated into the application, making linguistic adaptation an easy task [ 32, 35]. Other tools contain more use of language, resulting in time-intensive adaptation processes involving forward and backward translations and cognitive interviewing to ensure face validity. This process takes multiple cycles and may require full re-programming of the test by assessment tool developers, the case for a recent cultural and linguistic adaptation of the NIH Toolbox for Kenya [ 44]. Even within a single country, certain images may need to be adjusted to accommodate the broadest range of cultures and contexts with the most familiar images used among cultures within the region.

Overcoming workforce challenges

A significant advantage of tablet-based cognitive assessment tools is their ability to simultaneously administer, score, and record, either within the tablet computer itself, or a cloud server. By removing the requirement for a psychologist or highly trained individual to administer the tool, these assessment tools can be administered by non-specialists on a scale far beyond traditional psychological tests. Most of the non-commercial (8/11) and commercial (4/5) tools require only a few hours of training for test administration, allowing for assessors from a broad array of educational and training backgrounds. Nearly all the tests do not require an assessor's observations as part of the scoring. One of the few exceptions is the NIH Toolbox's List Sorting task, which measures working memory and requires an assessor to input whether a verbally repeated series of words is correct or incorrect [ 45]. With minimal input from the assessors, these tablet-administered tools reduce the risk of bias and human error and make great strides in overcoming workforce challenges in low-resourced settings.

Accessibility

While few assessment tools are intended for commercial use, most have been created within academic settings and are freely available with open-source coding ( Table 1). Developers of some tools, e.g., the BENCI and Early Years Toolbox, stipulate at inception that their tools remain free of cost so that they could be easily utilized in low-resourced settings. The few academic, non-commercial tools that require some funding directly relate the costs to the time required to support the developer in adapting the code for a new setting and other factors, such as server maintenance.

For commercial tools, some have a published fee for their use. This can range from a few hundred dollars for a subscription, to many thousand dollars when paying for tests per participant. Costs may vary dependent on the number of tests and administrations included within the assessment battery. While costs associated with the use of commercial assessment tools may be a deterrent for many researchers in low-resourced settings, it ensures tools used are adequately maintained, with up-to-date information technology infrastructure and developers on staff to troubleshoot any data-related issues.

5. Future directions for tablet-based pediatric cognitive assessment tools

This review aimed to summarize the current landscape of tablet-based assessment tools that measure cognition in children, particularly those used in low-resourced settings, as a potential solution to poor healthcare infrastructure and workforce-related barriers. We identified 16 tools that ranged the full spectrum of possibilities: from open-sourced to proprietary, and from those in their early stages of piloting in one region to those with extensive validation in multiple countries. As this novel area of digital pediatric cognitive assessment tools emerge and are pushed up the global mHealth agenda [ 29, 46], it is critical for users to consider a tool's psychometric properties, such as validity and reliability, before integrating it into clinical practice, research, or public health developmental surveillance systems. The COSMIN checklist provides useful guidance, not only to evaluate the validity and utility of a novel digital assessment tool, but also for developers to keep in mind while planning validation studies, or when describing the strengths and limitations of their tools to potential users [ 43].

In the absence of a true "gold-standard," tool developers should aim to generate local normative scores for these novel tools in the target populations, instead of benchmarking them to the available "gold-standards." The developers of the ENABLE and DEEP tool hope to develop a cloud database from their users, so that global sample "norms" can become available in open-source platforms (verbal communication from N. Pitchford and S. Bhavnani, respectively (February 2021)).

Additionally, while this review focuses on tablet-based assessment tools, we are keenly aware that smartphones represent the ultimate game changer in terms of achieving scale. The use of tablet-based assessment tools still requires a trained individual to go into the community or household for administration, whereas a smartphone-based assessment tool could potentially be downloaded onto a phone and then self-administered or administered by a parent within the home. Lead investigators of the NIH Toolbox are involved with the development of self-administered smartphone-based tests, Mobile Toolbox, which they hope will be available for public dissemination in 2023 [ 47]. Given the ubiquity of smartphones globally-over 5 billion subscribers, 70% of those residing in low-resourced settings-and cellular networks connecting 85% of the world's population [ 29], we believe the potential for these cognitive assessment tools to scale will vastly improve with smartphones administration. Tablet-based tools were the focus on this review as there are currently a number of well-studied and validated options available for use in low-resources settings. They also form a useful "bridge" between more expensive and potentially fragile laptop computers and a larger screen than mobile devices. It is clear, however, that smartphones are more accessible and cheaper. Presently, less information is available about applications on these devices for measuring cognition in children, smartphone-based cognitive assessments for other populations, such as adults with dementia, have recently been developed [ 48, 49]. It is likely that this review will need updating considering the fast-moving field and will need to include a focus on smartphone-based tools once data on their validity are available. Over 80% of World Health Organization (WHO) member states use at least 1 mHealth initiative operationalized through smartphones [ 29], with features such as the use of videos and decision support systems, that have proven useful in improving maternal and child health in a variety of low-resourced settings [ 50]. Therefore, the integration of cognitive assessments in smartphones may be the next leap towards optimizing child development at scale across global settings.

The digital administration of these tools also makes it possible to sync data collected from different modalities, such as eye tracking and electroencephalography, to provide a deeper, more integrated level of evaluation. With advances in technology, further spurred by substantial increases in use of telemedicine during the Coronavirus Disease 2019 (COVID-19) pandemic, these assessment tools may facilitate the possibility of virtual, parent-led, in-home well-baby checks in the future [ 51].

A forum to house the available digital tools, regularly updated to reflect the latest progress and associated data, would be valuable to stakeholders with interest in early childhood development. Such an effort has been initiated by the World Bank [ 52]. For this review, we aim to use an example of this and consolidate the information gleaned within the IMPACT Measures Tool database [ 53]. This online and open-source database is based on a research-driven scoring system that allows for the comparison of early childhood and parenting measures based on 4 categories (i.e., cost, usability, cultural relevance, and technical merit) [ 54]. Attending to the current landscape and new demands in low-resourced settings, we thought that the IMPACT database would benefit from the addition of digital measures, but other digital databases, as they emerge, should be considered.

This review has some limitations. Because we did not perform a formal systematic review, it is possible that we have missed some existing literature regarding tools currently being used in low-resourced settings outside of the network of investigators with whom we connected. Further, the dynamic and fast-paced nature of this emerging field would imply that new and updated tools are being added to the existing pool rapidly. Some have not yet been used in low-resourced settings and therefore will have not been included in this review. However, despite these limitations, we believe that this review of the existing tablet-based cognitive assessment tools adds great value, since the current landscape of available tools and possible future directions have not yet been summarized in this field.

Brief considerations for developers of digital cognitive evaluation tools

While this review is primarily targeted for users of tablet-based tools measuring cognition, we provide the following recommendations for tool developers. A primary consideration in the development of new tools should be their scalability. To benefit the large number of children who are faltering in cognition development within low-resourced settings, these tools must have the ability to adopt at scale within clinical practice and health systems. The mHealth Assessment and Planning for Scale (MAPS) toolkit published by the WHO provides a useful guide for iterative assessment of tool readiness for scaling up of mHealth tools, as well as providing strategies to address common barriers inherent in the pathway to scaling up [ 54]. Similarly, "Beyond Scale" launched by the Digital Impact Alliance is a free online course that highlights key challenges and solutions to scaling up mHealth solutions [ 55].

While understanding the importance of scalability, we also strongly recommend that tool developers closely collaborate with stakeholders from low-resourced settings-children and their families, researchers, health system staff, and policy makers-across all phases of development to ensure that the tool is designed optimally for its intended contexts, is affordable for scale-up, and able to be integrated within the health and educational sectors [ 56]. In partnership with key stakeholders, developers should also consider the local laws about data privacy and security. Most of the tools described in this review collect only de-identified study IDs, with password-protected storage on secure servers and varying levels of encryption and password keys. Ensuring security of data within the tablets and cloud storage is an essential feature for this technology.

And finally, cognitive tools only have the potential for meaningful impact when they are disseminated and being utilized. To ensure that information is readily available to others, we recognize that the addition of digital assessment tools in online repositories of child development measures is essential [ 53, 57]. These efforts will help researchers and practitioners to understand and be informed as to what is best for them to use when selecting evaluation tools for their programs in this fast moving and dynamic field.

Conclusions

Tablet-based cognitive assessment tools may finally overcome the barriers of inadequate health systems that lead to poor measurement of child development outcomes in low-resourced settings. Data derived from these tools can then provide the foundation for drafting contextually relevant policies and practices-from the sub-local to the global-to optimize the developmental potential of all children globally.

Supporting information

S1 File. This supplement contains 2 appendices.

Appendix A is a table outlining the psychometric measurement properties of the tablet-based cognitive tools included in this review. Appendix B is another table that describes the additional neurodevelopmental domains evaluated by tablet-based assessments, with contact information of the developers.
https://doi.org/10.1371/journal.pdig.0000196.s001
(DOCX)

Acknowledgments

We would like to thank all of the developers of these tablet-based applications, who willingly answered numerous questions as we strived to understand their tool's function and purpose. Many of these individuals created these tablet-based tools to improve the manner in which cognition is assessed around the world. We appreciate their commitment and dedication to finding effective ways of measuring pediatric cognition globally.

References

1. 12. Neuropsychology of children in Africa: Perspectives on risk and resilience. Boivin MJ, Giordani B, editors. New York, NY, US: Springer Science + Business Media; 2013. p. 347.

2. 29. World Health Organization. mHealth: New horizons for health through mobile technologies: second global survey on eHealth. Switzerland; 2011.

3. 41. Bradley-Johnson S, Johnson CM. Infant and toddler cognitive assessment. Psychoeducational assessment of preschool children, 4th ed. Mahwah, NJ, US: Lawrence Erlbaum Associates Publishers; 2007. 325-57.

4. 53. IMPACT Measures Tool: Scoring Guidebook. [press release]. PsyArXiv, 21 May 2021.

5. 54. World Health Organization. The MAPS toolkit: mHealth assessment and planning for scale. Geneva, Switzerland: World Health Organization; 2015.

6. 55. Digital Impact Alliance. Beyond Scale: How to Make Your Digital Development Program Sustainable. Washington D.C.: Digital Impact Alliance; 2017 [updated 1 Dec 2017; cited 2021 9 Feb]. Available from: https://digitalimpactalliance.org/research/beyond-scale-how-to-make-your-digital-development-program-sustainable/.

7. 57. EC PRISM. IMPACT Measures Tool: EC PRISM. [cited 2021 May 18]. Available from: https://impact.ecprism.org/measures.

# data[].attributes.attachment_link.title
The current landscape and future of tablet-based cognitive assessments for children in low-resourced settings

# data[].attributes.attachment_link.description
Author summary Tools that measure cognitive skills are key to identifying children in need of critical interventions to reach their full potential. However, there are barriers inherent in the application of traditional tools, such as the need for trained professionals, the relevance of the testing items, and the time needed to complete the evaluations.

# data[].attributes.body
Open Science Framework link to Data Collection tools, SOP's, CRF's and training

# data[].attributes.attachment_link.description
Here are resources for assisting in measuring school-age metrics in Low and Middle Income countries. The COG-SAHARAN and GROW-SAHARAN tools are described along with their resources. Further resources will be added shortly. Hosted on the Open Science Framework

# data[].attributes.body
Also note this review:
https://pubmed.ncbi.nlm.nih.gov/25825411/

# data[].attributes.attachment_link.readable_text
The Strategic Impact Evaluation Fund (SIEF) has released a new book for practitioners in the field of early child development. " A Toolkit for Measuring Early Childhood Development in Low- and Middle-Income Countries " offers experts and others a detailed review of the newest tools and how to apply them to successfully measure child development for children from 0 to 8 years.

Authors: Lia C. H. Fernald, Elizabeth Prado, Patricia Kariger, Abbie Raikes
Download the book here Download the accompanying ECD Measurement Inventory here Watch the book launch with author Elizabeth Prado
The Toolkit provides a practical, "how-to" guide for selection and adaptation of child development measurements for use in low- and middle-income countries. Users can follow the proposed step-by-step process to select, adapt, implement, and analyze early childhood development data for diverse purposes and projects. Researchers, evaluators, and program personnel from various disciplines interested in assessing early childhood development in low- and middle-income countries will find the book useful for planning and evaluating interventions, monitoring development over time, or conducting a situation analysis. The book updates and expands a previous 2009 edition, incorporating new research on the use of child development measurement tools in low- and middle-income countries and including collections of common tools put together by organizations such as Saving Brains and the National Institutes of Health.

Along with the accompanying Early Childhood Development Measurement Inventory, this Toolkit provide researchers, evaluators, and program personnel from various disciplines the rationale for measuring particular domains of child development, and offers guidance on current best practices for using this kind of measurement for population monitoring, program evaluation, and exploratory research as relates to early childhood development.

The ECD Measurement Inventory that accompanies this Toolkit contains 147 measurement tools for children under 8 years. For each test it reports the domains assessed, age range for which the tool is appropriate, method of administration, purpose of the assessment, origin and locations of use, logistics, and cost.
RELATED Early Childhood Development Measurement Inventory (Excel)

# data[].attributes.attachment_link.title
Measuring Child Development: A Toolkit for Doing It Right

# data[].attributes.attachment_link.description
The Strategic Impact Evaluation Fund (SIEF) has released a new book for practitioners in the field of early child development. " A Toolkit for Measuring Early Childhood Development in Low- and Middle-Income Countries " offers experts and others a detailed review of the newest tools and how to apply them to successfully measure child development for children from 0 to 8 years.

# data[].attributes.body
MAMI
NCD risk

# data[].attributes.attachment_link.description
Lelijveld, N , , McKenzie, K, Badaloo, A, , Behrane, M, , , , Koulman, A, Swann, J, Wells, J and . 2022. CHANGE Project (CHild malnutrition & Adult NCD: Generating Evidence on mechanistic links to inform future policy/practice). [Online]. London School of Hygiene & Tropical Medicine, London, United Kingdom.

# data[].attributes.body
SAHARAN Toolbox combines growth, body composition, cognitive and physical function measurements at school-age

# data[].attributes.attachment_link.title
Characterising school-age health and function in rural Zimbabwe using the SAHARAN toolbox

# data[].attributes.attachment_link.description
Introduction We developed the School-Age Health, Activity, Resilience, Anthropometry and Neurocognitive (SAHARAN) toolbox to address the shortage of school-age assessment tools that combine growth, physical and cognitive function. Here we present i) development, acceptability and feasibility of the…

# data[].attributes.body
Advantages: Clear validity, reliability can be readily measured
Limitations: beware cut-offs, competing agendas: development (Stunting) vs humanitarian (wasting)

# data[].attributes.body
Stunting
Wasting, SAM, MAM
Underweight
1)

# data[].attributes.attachment_link.readable_text
Undue focus on body size

Being severely small (short or thin) alone is unimportant. What matters is the associated risk of severe adverse outcome (eg, death/disease/developmental delay). Simplicity makes anthropometry useful for epidemiological and clinical case-definitions. Often forgotten is that it is an indirect measure, akin to a proxy measure, an indicator of an underlying problem, analogous to spots in measles or fever in malaria. Better measures of nutritional status such as body composition are available, 5 but are costly and difficult to do in most field settings. Anthropometry is valuable but has imperfect:

Sensitivity: current global metrics focus on population extremes, with terms in table 1 often used interchangeably. Not differentiating state from process identifies most children with malnutrition but misses those with 'normal' anthropometry who are deteriorating and are smaller than they would be in a resource-rich environment and therefore at risk of adverse outcomes (false negative). Thus, true malnutrition-associated burden of disease is underestimated. Neglecting process also risks undue focus on treatment rather than prevention since actions may not occur until a child deteriorates below threshold values.

Specificity: some children are constitutionally small but have no functional/clinical impairment or increased risk (false positive). In others, the underlying problem is not lack of food but another issue (eg, repeated infection, chronic inflammation and disability). Feeding may temporarily increase weight, but relapse follows if the underlying cause is not addressed.

Nutrition 'tribalism'

Different anthropometric deficits are commonly managed by different communities. UN/NGO actors are especially prone to division:

Stunting, often equated with 'chronic malnutrition', is high priority for development actors.

Wasting, often equated with 'acute malnutrition', is high priority for humanitarian actors.

Underweight is widely measured in Growth Monitoring Programmes but not elsewhere, hence impeding interprogramme referrals.

Micronutrient malnutrition is often neglected in the above.

This is unfortunate, as actions on common risk factors and common determinants are too easily missed or diluted.

Inadequate consideration of context

Different individuals and populations may have the same anthropometry but varying levels of risk. Context details are important, yet are often overlooked, for example,

Humanitarian emergencies can lead to sudden deterioration in weight so that even a mild/moderate deficit has high associated risk.

Suboptimal but stable contexts can be associated with populations/individual adaptation and may not have correspondingly high morbidity/mortality.

Focus on severe adverse outcomes

An important clinical maxim is to 'treat the patient, not the numbers'. The ultimate aim of any intervention is to ensure children not only survive but thrive. Severe in our framework refers to clinically important severe adverse outcomes: mortality, morbidity, impaired development. To capture true programme impact, these should be measured wherever possible (since some interventions might improve anthropometry but not mortality; 6 others improve nutrition but not anthropometry). 7 The framework also highlights underlying clinical causes because acute/chronic illness and anthropometric deficits are intimately related: deficits are associated with increased risk of and impaired response to illnesses; illness can exacerbate anthropometric deficit.

Inclusivity (including of long-term consequences)

Different manifestations of malnutrition are more-common or less-common/important in different settings but details are mainly relevant to technical audiences. While widely understood to mean undernutrition, we acknowledge that malnutrition is also used to describe overweight. Severe overweight is widely recognised as obesity so our using 'severe malnutrition' does not risk misunderstanding. It does create opportunities to highlight long term consequences of undernutrition: speaking about mal rather than undernutrition is a reminder that early-life undernutrition increases susceptibility to the harmful effects of adult overweight, especially elevated non-communicable non-communicable disease. 8

Increased linkages and synergies between different nutrition-related programmes

Working towards common mortality/morbidity goals could facilitate interprogramme linkages and more efficient resource utilisation.

'Severe malnutrition' also provides bridging language supporting recent research on relationships between different malnutrition manifestations:

Wasting predisposes to stunting 9 -'chronic' terminology under-recognises the role of acute insults.

Wasting is common in children with low birth weight and disability 10 and many wasted children are stunted-'acute' terminology is usually erroneous.

Children with concurrent wasting/stunting are at particularly high risk of death 11 -programmes should be integrated.

Since all forms of malnutrition are fundamentally social problems of poverty and inequity, our terminology also emphasises the importance of tackling these common determinants. 12

Clarity and familiarity

Both 'severe' and 'malnutrition' are widely understood terms and are easily translatable into most languages worldwide. 'Severe malnutrition' also has historical track-record, having been used alongside older case definitions with different growth references and classifications predating table 1. Children admitted to today's malnutrition programmes differ to those in years past, but common characteristics are increased mortality/health risks compared with those without anthropometric deficit.

Keeping technical arguments internal

As in any field, some issues are novel and/or contested for example.

Use of weight-for-age to identify concurrent wasting/stunting. 11

Mid-upper arm circumference versus weight-for-height to identify children for therapeutic feeding. 13

Recent focus on 'wasting' terminology neglects kwashiorkor. 14

An overarching term provides stability and prevents important technical arguments giving the impression to those outside the sector that experts do not agree on other core issues.

Flexibility for programmes to use locally appropriate admission criteria

Guided by local mortality/morbidity data, individual countries could be freer to set context-specific programme admission criteria for 'severe malnutrition'.

In some settings, even mild/moderate anthropometric deficits are associated with excess mortality: integrated programmes treating both severe and moderate wasting as a continuum are hence important. 15

In other settings, mortality associated with anthropometric deficit is lower - costs of therapeutic/supplementary foods may not justify their benefits. 16

For most technical purposes, quantifying and monitoring global trends and comparisons, current metrics focusing on table 1 terminology remain valid. However, discussions are needed on measuring risk; moving beyond the acute/chronic malnutrition dichotomy; feasibility of improved metrics 17 and calculating a single global estimate of the burden of severe malnutrition.

# data[].attributes.attachment_link.title
‘Severe malnutrition’: thinking deeply, communicating simply

# data[].attributes.attachment_link.description
### Summary box Malnutrition affects millions worldwide and underlies almost half of deaths in children aged <5 years.1 Progress towards Sustainable Development Goal 2 (End hunger) was already slow but coronavirus-related secondary impacts now threaten nutritional crises described as: Biblical, on…