EDOS Metrics and Evaluation

EDOS Metrics and Evaluation

Metrics portal

EDOS metrics portal have been set up for Mandriva, Caixa Magica, and OpenOffice at the following URLs:

• http://mandriva.edos-project.org
• http://caixamagica.edos-project.org
• http://ooo.edos-project.org

Indicators

The indicator list is available from the indicators' page.

Deliverables

All the deliverables are available from this page.

Description of work

For the measurement to be fair, we must be sure that we address distributions of the same 'nature'. So we will need to take into account the parameters defining the actual complexity of the distribution as defined by the number of packages, the number of different hardware platforms, the speed of refreshment of the packages and so on. The goal is to show a cost improvement for the same complexity of distribution. For distribution customization, similarly parameters must characterize the degree of customization. In this case, simple experiments can be performed. In the case of the new version of a distribution doing experiments for the sake of measurement would be cost ineffective.

For the improvement of the mirroring mechanism, metrics will also be devised to measure the impact of the current system on the development. We will set a priori goals of efficiency improvement, and we will demonstrate in the end through a set of experiments and measurement campaigns that we have reached this goal. We will devise tests and experiments too, which will involve distribution companies and other users who need this kind of tools. We will also involve the Community in this process, to completely validate our approach.