Logo: Deutsches Institut für Internationale Pädagogische Forschung


National Educational Panel Study (NEPS)

As a consortium’s member DIPF contributes to planning and devoloping the National Educational Panel; one of the project's emphasis is on the working package technology based testing (TBT).

NEPS LogoThe National Educational Panel (NEPS) is a multi-cohort longitudinal sample that has been examining individual educational and competency development of 60.000 children, teenagers and adults for more than 5 years now. With a focus on measurement of competencies NEPS provides the data basis for the examination of educational chances and passages in Germany. Therefore, besides interviews and interrogations competence tests are administered in different domains on a regular basis. In the first project period (2009 till 2013) NEPS was supported by the Federal Ministry for Education and Research (BMBF). Since 2014 the National Educational Panel is continued in the Leibniz Institute for Educational Trajectories (LIfBi) at Otto-Friedrich-University, Bamberg. DIPF is a consortium’s member of NEPS and founding member of LIfBi. Currently several NEPS-core areas are located at DIPF:

  • “Learning Environments” (pillar 2, Prof. Eckhard Klieme)
  • “Upper Secondary Education”  (stage 5, Kai Maaz)
  • “Meta data” (Prof. Marc Rittberger)
  • “Technology Based Testing” (TBT, Prof. Frank Goldhammer)

Work package Technology Based Testing (TBT) 2014-2016

The working package Technology Based Testing (TBT) at NEPS belongs to the methods group of NEPS. TBT at DIPF is located within the interdisciplinary TBA (Technology Based Assessment) - centre and is under the scientific direction of Prof. Frank Goldhammer. TBT closely co-operates with LIfBi and is engaged in innovative interview techniques and testing methods, for example, computer- and internet-based competency assessment.
The working package TBT supports the introduction and realisation of technology-based testing in NEPS with scientifically based services, project specific adaptations of software products and accompanying research. For the domains reading, math, science and ICT Literacy, which are tested several times in the longitudinal study of NEPS, changes concerning measurement instruments due to the computerisation are explored psychometrically based on the combined mode effect and linking studies as well as based on the help of experimental modus variation. Therefore, procedures of quantification and correction of mode effects are investigated and applied precisely that enable an introduction of computer based competency measurement in NEPS.
After successfully introducing technology based testing in the extra-institutional and institutional survey context of NEPS the scientific and development focus is on the use of characteristics of technology-based testing. This aims at the enhancement and optimisation of assessments in regard to validity (for example, simulation based assessment of ICT Literacy, e.g. TECCI or CavE-ICT Pisa) as well as the increase of measurement efficiency (see, for example, HEUREKO and MATE) and the use of log and processing data (see, for example, PROKOM).

Fields of research (psychometrics):

  • Effects of test administration / mode effects/ test equivalence
  • Online assessment and effects of test setting
  • Measurement efficiency and test set / adaptive testing
  • Innovative item and response formats for computer-based testing
  • Use and analysis of log and process data
  • Capturing and modelling of response times

Fields of research (informatics):

  • Response time measurement and analysis of timely accuracy of assessment systems 
  • Workflow support for the implementation of computer-based tasks (ItemManagement Portal)
  • Mobile assessment/Online assessment with mobile devices
  • Digital preservation of computer-based test instruments
  • Test security and test delivery on existing hardware for computer-based testing in institutional contexts


  • Requirement analysis and transfer planning for NEPS assessments with embedded computer-based testing in individual and group assessment 
  • Support of domain experts and item authors while they transfer computer-based items with the authoring tool CBA ItemBuilder (development of item templates, counseling, advanced trainings)
  • Prototypical programming of innovative and new item formats as well as computer-based assessments
  • Co-ordination of requirements for the development of the authoring tool CBA ItemBuilder for the use in NEPS
  • Development of NEPS TBT modules for computer-based testing and computer-based interviews (self-respond) in individual testing or notebook-based group testing with TBA Tools
  • 2nd level support for assessment institutions during the realisation of studies with computer-based tests
  • Load testing of online-delivery, development of testing plans for computer-based tests
  • Programming of specific instruments and prototypes as diagnostic modules for computer-based assessment in NEPS

Further information

Selected talks and publications

Finished project phase 2009-2013


To the website of NEPS at LIfBI

last modified Feb 14, 2020