Software benchmarking in digital preservation

Thursday 11 February 16:00 CET

Posted on: 26 January 2016

Share

opf-site-logoAs the digital preservation community is increasingly deploying tools into productive environments, the need to systematically evaluate and share evidence about the quality of these tools has become a pressing need. At the Benchmarking Forum at IPRES 2015, researchers, community organizations and practitioners discussed opportunities and challenges in adopting software benchmarking as a systematic tool for evaluating digital preservation tools. Outcomes include an initial set of benchmark specifications for targeted scenarios elaborated jointly during the workshop, and a set of concrete collaborative actions to take place in 2016.

pfo_benchmarkdpThis webinar will widen the conversation to include those who were unable to attend IPRES, provide a summary of key concepts, but most importantly, provide an opportunity to join efforts with BenchmarkDP, OPF and the PREFORMA Project to establish an initial set of high-interest scenarios for benchmarking and identify opportunities for the community for future collaboration.

After establishing a common ground in software benchmarking several participants will present specific benchmark scenarios and report on the achievements since the IPRES workshop. Presentations include the following:

  • Christoph Becker, Kresimir Duretec, Artur Kulmukhametov, Andreas Rauber will provide concise summaries of key concepts of benchmarking and example scenarios resulting from recent work in the BenchmarkDP project;
  • Bengt Neiss will provide a use case of the Preforma project to illustrate how benchmarking is applied in a format validation scenario; and
  • Carl Wilson, Technical Lead of the OPF, will talk about the OPF’s testing platform.

The webinar will conclude with an interactive session to continue and broaden the discussion initiated at the Benchmarking Forum at IPRES 2015.

The following recent publications provide a background to this webinar

  1. Duretec K, Kulmukhametov A, Rauber A, Becker C. Benchmarks for Digital Preservation tools. In: Proceedings of the 12th International Conference on Digital Preservation (IPRES), Chapel Hill, NC, USA, 2015. available from: http://ifs.tuwien.ac.at/~duretec/publications/benchmarks_for_digital_preservation.pdf
  2. Becker C, Duretec K, Kulmukhametov A, Rauber A. The Benchmarking Forum at IPRES 2015. DLib Magazine Volume 22, Issue ½, 2016. Available from: http://www.dlib.org/dlib/january16/becker/01becker.html

 

Registration

Register at: https://opfwebinar-software-benchmarking-in-dp.eventbrite.co.uk

We will use Google Hangouts for this webinar. After registering, we will send the Hangout link to participants. It will also be recorded.

 

Visit the PREFORMA Blog

Visit the PREFORMA Website

Leave a Reply

Related Articles

Cooperation between PREFORMA and BenchmarkDP
A new agreement has been signed between PREFORMA and BenchmarkDP to explore how the methodologies and approaches of BenchmarkDP could be useful in PREFORMA in establishing an objective frame of reference for the evaluation of the conformance checkers, and how the practical challenges in PREFORMA can inform the work in BenchmarkDP. The cooperation kicked-off during a workshop organised by BenchmarkDP in the framework of IPRES 2015.
Learn more about the conformance checkers
The PREFORMA project is running a webinar series throughout September to present the three conformance checkers that are being developed for electronic documents, still images and audiovisual files. The webinars will: introduce the PREFORMA project, update participants on the current status of the conformance checkers, demonstrate the software, outline future plans, and give examples of how the community can contribute, or provide feedback.
Pre Commercial Procurement for the long-term Preservation of Digital Cultural Heritage
Results of the webinar organised by the Open Preservation Foundation to present the possibilities offered by the Pre-Commercial Procurement, a competition-like method designed to steer the development of innovative solutions towards concrete public sector needs, and by PREFORMA, a PCP project co-funded by the European Commission to work on the long-term preservation of digital data
PREFORMA @ IPRES 2016
PREFORMA's proposals for a workshop ("Quality standards for preserving digital cultural heritage") and a talk ("Status of CELLAR: Update from an IETF Working Group for Matroska and FFV1") have been both accepted at IPRES 2016, the longest standing digital preservation conference in the world, bringing together key theorists, researchers and practitioners to explore the latest trends, innovations, policies and practices in digital preservation.