Two important questions on experimental dependa-bility evaluation remain largely unanswered: 1) how to analyze the usually large amount of raw data produced in dependability evaluation experiments and 2) how to compare results from different experiments or results from similar experiments across different systems. These problems are also common to other dependability evaluation techniques such as the ones based on simulation, or even to the analysis of field data on computer faults. We propose the use of data warehousing technologies to store raw results from different experiments/setups in a common multidimensional structure where raw data can be analyzed and shared world wide by means of web-enabled OLAP (On-Line Analytical Processing) tools. This paper describes how to use the proposed approach in a concrete example of dependability evaluation experiment.
Keywords
Dependability Evaluation Analysis
Subject
Dependability Evaluation Analysis
Related Project
DBench - Dependability Benchmarking
Conference
International Conference on Dependable Systems and Networks, DSN-DCC 2003, June 2003
Cited by
Year 2013 : 2 citations
Truong Minh Thai, Frédéric Amblard, Benoit Gaudou, "Combination Framework of BI solution & Multi-agent platform (CFBM) for multi-agent based simulations", 13e Conférence Francophone sur l'Extraction et la Gestion de Connaissances, EGC'2013, Toulouse, France, January 29, 2013.
A. Bondavalli, F. Brancati, A. Flammini, S. Rinaldi, "Master Failure Detection Protocol in Internal Synchronization Environment", IEEE Transactions on Instrumentation and Measurement, vol.PP, no.99, January 2013.
Year 2011 : 4 citations
1. A. Bondavalli, F. Brancati, F., A. Flammini, S. Rinaldi, S., "A Reliable and Self-Aware Clock for reference time failure detection in internal synchronization environment", 2011 IEEE International Workshop on Measurements and Networking (M&N), Anacapri, Italy, October 2011.
2. A. Bovenzi, S. Russo, F. Brancati, A. Bondavalli, "Towards identifying OS-level anomalies to detect application software failures", 2011 IEEE International Workshop on Measurements and Networking (M&N), Anacapri, Italy, October 2011.
3. Antonio Bovenzi, Francesco Brancati, Stefano Russo, Andrea Bondavalli, "A Statistical Anomaly-Based Algorithm for On-line Fault Detection in Complex Software Critical Systems", 30th International Conference on Computer Safety, Reliability, and Security, SAFECOMP 2011, Naples, Italy, September 2011.
Dimara Kusuma Hakim, "Development of License Report Application with Online Analytical Processing", Jurnal Informatika, JUITA, Vol. 1 N0. 3, 2011.
Year 2010 : 5 citations
1. Andrea Bondavalli, Andrea Ceccarelli, Paolo Lollini, “Architecting and validating dependable systems: experiences and visions”, Architecting dependable systems VII, (Antonio Casimiro, Rogério de Lemos, and Cristina Gacek Eds.), Springer-Verlag, 2010.
2. F. Brancati, A. Bondavalli, "Practical Aspects in Analyzing and Sharing the Results of Experimental Evaluation", 29th IEEE Symposium on Reliable Distributed Systems, SRDS 2010, New Delhi, india, October 31 - November 03, 2010
3. Piotr Gawkowski, Monika A. Kuczy?ska, Agnieszka Komorowska, "Fault Effects Analysis and Reporting System for Dependability Evaluation", Seventh International Conference on Rough Sets and Current Trends in Computing, RSCTC 2010, Warsaw, Poland, June 2010.
4. P. Sendín-Raña, E. Rodríguez-Fernández, F. J. González-Castaño, E. Costa-Montenegro, P. S. Rodríguez-Hernãndez, J. M. Pousada-Carballo, J. C. Burguillo-Rial, “Web-oriented business intelligence solution based on Associative Query Logic”, Software: Practice and Experience, Vol. 40, No 9, pg. 779-796, 2010.
5. A. Bondavalli, A. Ceccarelli, L. Falai, M. Vadursi, “A new approach and a related tool for dependability measurements on distributed systems”, IEEE Transactions on Instrumentation and Measurements 2010, 2010.
Year 2009 : 5 citations
Andrea Ceccarelli, Andrea Bondavalli, Danilo Iovino, "Trustworthy Evaluation of a Safe Driver Machine Interface through Software-Implemented Fault Injection", 15th IEEE Pacific Rim International Symposium on Dependable Computing, PRDC'09, Shanghai, China, November 2009.
János Oláh, István Majzik, "A Model Based Framework for Specifying and Executing Fault Injection Experiments", 2009 Fourth International Conference on Dependability of Computer Systems, 2009.
Pablo Sendín-Raña, Francisco J. González-Castaño, Enrique Pérez-Barros, Pedro S. Rodríguez-Hernández, Felipe Gil-Castiñeira, José M. Pousada-Carballo, “Improving the performance and functionality of Mondrian open-source OLAP systems”, Software: Practice and Experience, Vol. 39 N. 3, pg. 279-298, John Wiley & Sons, Ltd, 2009.
Li Xiao-gen, Wang Zong-minl, Huang Zhi-quan, "Visualization of large scene watershed model in real-time and interactive manner based on cache technique", Application Research of Computers, Vol. 26 No. 4, April 2009.
Yuan Zheng-wu, Zhao Rui-jing, Zhu Zhi-hui, “Reserach of indoor positioning method based on ray-tracing”, Application Reserach of Computers, Vol. 26 No. 4, April 2009.
Year 2008 : 6 citations
Andrea Ceccarelli, Danilo Iovino, Andrea Bondavalli, “A Fault Injection Tool for Trustworthy, Comparative Measurements and Analysis”, SRDS 2008 Workshop on Sharing Field Data and Experiment Measurements on Resilience of Distributed Computing Systems (jointly organized with the 27th International Symposium on Reliable Distributed Systems, IEEE SRDS 2008), Naples, Italy, October 5, 2008.
Lorenzo Falai, Andrea Bondavalli, “RODS: General Framework for Rigorous Observation of Distributed Systems”, DSN 2008 Workshop on Resilience Assessment and Dependability Benchmarking, DSN-RADB08 (jointly organized with the IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2008), Anchorage, Alaska, USA, June 25, 2008.
Paolo Lollini et al., "Application of the evaluation framework to the complete scenario", Formal Deliverable Project: Highly dependable ip-based networks and services Project (HIDENETS Project: IST-FP6-STREP- 26979), 2008.
WANG Xiao hong, WANG Guo ren, YU Yong qian, HONG Yang, "Study of closed loop decision support system based on telecommunication field", Application Research of Computers, Vol. 25 No. 4, April 2008.
CHU Yu-zhi, SUN Li-feng, ZHONG Yu-zhuo, XIE Jian, "IPv6 supporting multi-view video on demand system?, Application Research of Computers, Vol. 25 Nº 4, April 2008.
CAO Li-juan, XIE Qiang, DING Qiu-lin, "Research of Web-OLAP system based on distributed data cache technology", Computer Applications Journal, Vol.28 No.2, February 2008.
Year 2007 : 5 citations
1. Paolo Lollini et al., "D4.2.1. Application of the evaluation framework to the complete scenario", deliverable of the project: Highly dependable ip-based networks and services Project (HIDENETS Project: IST-FP6-STREP- 26979), December 2007.
2. Gergely Pintér, “Model Based Program Synthesis and Runtime Error Detection for Dependable Embedded Systems”, PhD Thesis, Department of Measurement and Information Systems, Budapest University of Technology and Economics, Budapest, Hungary, 2007.
3. Xie Qiang, Yu Ya-li, Ding Qiu-ling, “Web-OLAP System Based on Object Pool and Data Caching”, Journal of Applied Sciences, China, pages 161-165, Vol.25, No.2, 2007.
4. Paolo Lollini et al., "D4.1.2. Evaluation methodologies, techniques and tools", deliverable of the project: Highly dependable ip-based networks and services Project (HIDENETS Project: IST-FP6-STREP- 26979), December 2007.
5. Lorenzo Falai, “Observing, Monitoring and Evaluating Distributed Systems”, PhD Thesis, Department of Systems and Informatics, University of Florence, Italy, December 2007.
Year 2006 : 3 citations
1. Wei-Pin Chang, Yi-Ching Lin, Der-Ming Liou, "Experiences from Implementation of the Hospital Executive Information System in Taipei City Hospital", Taipei City Medical Journal, Vol.3 No. 12, December 2006.
2. Paolo Lollini et al., "D4.1.1. Identification and development of evaluation methodologies, techniques and tools", deliverable of the project: Highly dependable ip-based networks and services Project (HIDENETS Project: IST-FP6-STREP- 26979), December de 2006.
3. Z. Micskei, I. Majzik, and F. Tam, “Robustness testing techniques for high availability middleware solutions”, International Workshop on Engineering of Fault Tolerant Systems, EFTS2006, Luxemburg, Luxemburg, June 12-13, 2006.
Year 2005 : 1 citations
1. Ricardo Gimenes, “Avaliação da Confiabilidade da Informação Utilizada em Sistemas de Informação e em Sistemas Críticos”, MSc Thesis, University of São Paulo, São Paulo, Brasil, 2005.
Year 2003 : 1 citations
1. Hsiao-Wen Wu, “Establishment of Data Warehouse in Hospital Executive Information Systems? A Case Study of the Self-management in a Regional Hospital”, MSc Thesis, Computer Science and Information Management, Providence University, Taiwan, 2003.
