top of page

National Institute for Social & Economic Research (NIESR): Tips by Text Evaluation

Oct 29
3 min read

Updated: Nov 3

Navigator Insight was commissioned by the National Institute of Economic and Social Research (NIESR) to conduct the baseline and endline data collection for the independent evaluation of the ‘Tips by Text’ programme. The purpose of the evaluation, funded by the Education Endowment Foundation (EEF), was to explore the impact of the intervention on children’s early literacy, language, numeracy, and socio-emotional skills, as well as parental confidence and school engagement.

Adapted from the READY4K! programme, Tips by Text is a 9-month text messaging intervention developed by the Behavioural Insights Team (BIT) and Professor Susanna Loeb (Standford Graduate School of Education) and involves the delivery of text nudge messages to the parents of reception-age children. Parents receive three messages per week, including a ‘fact’, ‘tip’ and ‘growth’ text on varying topics.

The evaluation used a randomised controlled trial design, with BIT recruiting 130 schools across four regions: the Northwest, London, the Southeast, and Yorkshire and the Humber. Of these, 65 schools were allocated to the intervention group and 65 to the control group. BIT oversaw school recruitment, onboarding and the parental consent process, providing Navigator with a final list of participating schools and pupils ahead of baseline data collection.

While schools were being recruited, Navigator recruited and trained a team of 70 Education Assessors to conduct the data collection. Recruitment targeted the same geographic regions as the schools to ensure adequate coverage. All Assessors completed a rigorous vetting process, including application, interview, onboarding, enhanced DBS checks and training in safeguarding and assessment administration. Only candidates who met all requirements progressed to conducting assessments.

Ahead of both baseline and endline data collection, Navigator delivered training sessions in Manchester, Liverpool, London, Luton and York for the team of recruited Assessors. Led by two members of the Education Research Team, the sessions introduced the evaluation and emphasised the importance of robust data collection. The sessions covered administration instructions for the outcome measures, the specific requirements of each assessment tool and the settings in which they would be used, as well as guidance on working with young children for research.

Navigator’s team of Education Assessors conducted baseline and endline data collection between September and November 2024 and June and July 2025, respectively. Data collection involved one-to-one assessments with participating pupils using two outcome measures: LanguageScreen and the Head-Toes-Knees-Shoulders Revised (HTKS-R). LanguageScreen, developed by OxEd & Assessment, is an online oral language screener accessed via a web browser. HTKS-R, developed by Oregon State University, is a behavioural assessment of children’s executive function and self-regulation. To streamline HTKS-R administration, Navigator developed a tablet-based approach using AskiaFace software to create a digital scoring form. This enabled Assessors to score assessments in real time and upload completed records immediately to a secure database.

At baseline, Navigator’s Education Research Team liaised with all 130 participating schools to schedule 302 initial assessment days, alongside additional mop-up visits. Assessors completed 2,967 assessments over the eight-week data collection period. At endline, a further 299 assessment days were conducted, with 2,796 assessments completed over seven weeks. Despite over 3% of participating pupils leaving their educational settings between baseline and endline, Navigator achieved an endline completion rate of 94%. Upon project completion, the final baseline and endline datasets were supplied to NIESR for analysis and reporting. Further follow up with the schools involved in the project provided positive feedback from both staff and parents on the delivery of the assessments, and in response to the how the intervention was received.


To find out how Navigator Insight can help your institution or business view things differently, contact us for more information.


Image credit: Yan Krukau (Pexels)


Comments


bottom of page