Completed project phase 2009-2013

In 2009-2013, two sub-projects for NEPS were implemented at DIPF.

In the project phase 2009 until 2013, preparatory to the work package Technology Based Testing (TBT), DIPF was responsible for the following tasks:

NEPS AP 13 B

  • The software development for a data warehouse was located at TBA; the data warehouse ensures a data access as fast as possible while considering privacy data protection.
  • The development of a data warehouse was supposed to guarantee a central data stock for the entire NEPS study and to provide appropriate tools for filtering as well as report production.
  • Data Warehouse: Three proceeding processes of parallel software developed during the project duration: (1) implementation, optimisation and development of data banks, (2) implementation, optimisation and further development of ETL and reporting tools and (3) implementation, optimisation and further development of a web portal.
  • With the Data Warehouse the data from the four waves of assessment as well as the tools for filtering and report production should be accessible for the whole scientific community subsequently.

NEPS  AP 13 C

  • For the preparation of the electronic test assessment empirical assessments had been conveyed to identify possible differences between paper-based and computer-based testing (quantification of mode effects) and to investigate computer-based testing results (cross mode linking).
  • Mode effect studies (equivalence studies combined with linking studies of NEPS) have been conducted to prepare a test execution on a technological basis. The mode effect studies aimed at testing the equivalence of paper-based assessments (PBA) and computer-based assessment (CBA) by means of different criteria.  The organisation and execution of mode effect studies was carried out with pillar 1 (Competence development in the life course).

Selected Publications

  • Kroehne, U., & Martens, T. (2011). Computer-based competence tests in the national educational panel study: The challenge of mode effects. Zeitschrift Für Erziehungswissenschaft14(S2), 169– doi: 10.1007/s11618-011-0185-4
  • Rölke, H. (2012). The ItemBuilder: A Graphical Authoring System for Complex Item Development. In T. Bastiaens & G. Marks (Hrsg.), Proceedings of E-Learn: World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education 1 (S. 344-353). Chesapeake, VA: AACE.