CISUC

Xception: A technique for the evaluation of dependability in modern Computers

Authors

Abstract

An important step in the development of dependable systems is the validation of their fault tolerance properties. Fault injection has been widely used for this purpose, however with the rapid increase in processor complexity, traditional techniques are also increasingly more difficult to apply. This paper presents a new software implemented fault injection and monitoring environment, called Xception, which is targeted for the modern and complex processors. Xception uses the advanced debugging and performance monitoring features existing in most of the modern processors to inject quite realistic faults by software, and to monitor the activation of the faults and their impact on the target system behavior in detail. Faults are injected with minimum interference with the target application. The target application is not modified, no software traps are inserted, and it is not necessary to execute the target application in special trace mode (the application is executed at full speed). Xception provides a comprehensive set of fault triggers, including spatial and temporal fault triggers, and triggers related to the manipulation of data in memory. Faults injected by Xception can affect any process running on the target system (including the kernel), and it is possible to inject faults in applications for which the source code is not available. Experimental results are presented to demonstrate the accuracy and potential of Xception in the evaluation of the dependability properties of the complex computer systems available nowadays.

Subject

Fault Injection

Journal

IEEE Transactions on Software Engineering, Vol. 24, #2, pp. 125-136, February 1998

Cited by

Year 2009 : 2 citations

 Mithun Puthige Acharya, "Mining API Specifications from Source Code for Improving Software Reliability?, PhD Thesis North Carolina State University, EUA, 2009

 Thomas Naughton, Wesley Bland, Geoffroy Vallee, Christian Engelmann, Stephen L. Scott , "Fault injection framework for system resilience evaluation: fake faults for finding future failures?, High Performance Distributed Computing, Proceedings of the 2009 workshop on Resiliency in high performance, Garching, Germany, 2009

Year 2008 : 9 citations

 Olivier Faurax, "ÿvaluation par simulation de la sécurité des circuits face aux attaques par faute?, Tese de doutoramento, l"Université de la Méditerranée, 2008

 Pierre Vanhauwaert, "Analyse de Surete par Injection de Fautes Dans un Environnement de Prototypage a Base de FPGA?, PhD thesis, Institut Polytechnique de Grenoble, 2008

 Alexander Gordeyev, Vyacheslav Kharchenko, Anton Andrashov, Boris Konorev, Vladimir Sklyar, and Artem Boyarchuk, "Case-based software reliability assessmentby fault injection unified procedures?, SEESE '08: ACM Proceedings of the 2008 international workshop on Software Engineering in east and south Europe, Leipzig, Germany, 2008

 A. Da Silva J. F. Martínez L. López A. B. García V. Hernández, "XML schema based faultset definition to improve faults injection tools interoperability?, Third International Conference on Dependability of Computer Systems DepCoS-RELCOMEX 2008

 Lakshmi N. Bairavasundaram, Meenali Rungta, Nitin Agrawal, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau, Michael M. Swift, "Analyzing the Effects of Disk-Pointer Corruption?, Proceedings of the IEEE/IFIP International Conference on Dependable Systems and Networks (DSN'08), Anchorage, AK, USA, June 2008

 Michael Le, Andrew Gallagher, Yuval Tamir, "Challenges and Opportunities with Fault Injection in Virtualized Systems?, First International Wor kshop on Virtualization Performance: Analysis, Characterization, and Tools, Austin, Texas, April 2008

 Andreas Johansson, "Robustness Evaluation of Operating Systems?, PhD thesis, Darmstadt University, 2008.

 Gabriella Carrozza, "Software Faults Diagnosis in Complex, OTS-Based, Critical Systems?, PhD Thesis, "FEDERICO II? University of Naples, Naples, Italy, November, 2008.

 Ang Jin, Jianhui Jiang, Jiawei Hu, Jungang Lou, "A PIN-Based Dynamic Software Fault Injection System", The 9th International Conference for Young Computer Scientists, ICYCS 2008, pp.2160-2167, 18-21 November, 2008.

Year 2007 : 14 citations

 S. Potyra, V. Sieh, M. Dal Cin, "Evaluating fault-tolerant system designs using FAUmachine?, ACM Proceedings of the 2007 workshop on Engineering Fault Tolerant Systems, Dubrovnik, Croatia, 2007.

 WU Lei, LI Xin-ke, WANG Hong, "Research on the Reliability Testing of Web Services Based on Fault Injection Technology?, Journal of Chinese Computer Systems, Vo1 28, No1, 2007.

 Marta Portela García, "Técnicas de inyección de fallos basadas en FPGAs para la evaluación de la tolerancia a fallos de tipo SEU en circuitos digitales?, tese de doutoramento, Universidad Carlos III de Madrid, 2007

 David de Andrés Martínez, "Speeding-Up Model-Based Fault Injection of Deep-Submicron Cmos Fault Models Through Dynamic and Partially Reconfigurable FPGAS?, PhD Thesis, University of Valencia, 2007

 Antonio da Silva, José-F Martínez, Lourdes López, Luís Redondo, "Exhaustif®: a fault injection tool for distributed heterogeneous embedded systems?, Proceedings of the 2007 Euro American conference on Telematics and Information Systems, ACM, Faro, Portugal, 2007

 LI Ai-guo, HONG Bing-rong, WAN Si, "SAVIE: An environment for identifying vulnerabilities in software?, Journal of Communication and Computer, ISSN1548-7709, Volume 4, No.5 (Serial No.30), USA, May 2007

 Cyrille Artho, Armin Biere, and Shinichi Honiden, "Exhaustive Testing of Exception Handlers with Enforcer?, Lecture Notes in Computer Science, Springer Berlin / Heidelberg, Volume 4709/2007, book Formal Methods for Components and Objects, 2007.

 Daniel Larsson and Reiner Hähnle, "Symbolic Fault Injection?, VERIFY'07, colocated with Conference on Automated Deduction (CADE), Bremen, Germany, 2007.

 E. Touloupis, J. A. Flint, V. A. Chouliaras, and D. Ward, "Study of the Effects of SEU-Induced Faults on a Pipeline Protected Microprocessor?, IEEE Transactions on Computers, Vol. 56, issue 12, December 2007.

 M. Portela-Garcia, C. Lopez-Ongil, M. Garcia-Valderas "A Rapid Fault Injection Approach for Measuring SEU Sensitivity in Complex Processors?, 13th IEEE International On-Line Testing Symposium (IOLTS 2007), 2007.

 Israel Koren and C. Mani Krishna. Fault-tolerant Systems. Morgan Kaufmann, 2007.

 S. K. Kim, J. Choi, D. Lee, S. H. Noh, S. L. Min, "Virtual framework for testing the reliability of system software on embedded systems?, Proceedings of the 2007 ACM symposium on Applied computing, Seoul, Korea, 2007.

 A. Benso, A. Bosio, S. D. Carlo, R. Mariani, "A Functional Verification based Fault Injection Environment?, International Symposium on Defect and Fault-Tolerance in VLSI Systems, Rome, Italy, Setembro 2007.

 M. Alsaeed, N. A. Speirs, "A Wide Area Network Emulator for CORBA Applications?, 10th IEEE International Symposium on Object and Component-Oriented Real-Time Distributed Computing (ISORC'07), pp. 359-364, May 7-9, 2007.

Year 2006 : 16 citations

 Roshan G. Ragel, "Architectural Support for Security and Reliability in Embedded Processors?, PhD thesis, The University of New South Wales, Austrália, 2006

 Mohammod Shamim Hossain, "Web Service Based Software Implemented Fault Injection?, Information Technology Journal, 138-143, 2006

 Donald Shawa, Dhamin Al-Khalilib, "Automatic generation of defect injectable VHDL fault models for ASIC standard cell libraries?, Integration, the VLSI Journal, Volume 39, Issue 4, July 2006, Pages 382-406

 B. Nicolescu, N. Ignat, Y. Savaria, G. Nicolescu, "Analysis of Real-Time Systems Sensitivity to Transient Faults Using MicroC Kernel?, IEEE Transactions on Nuclear Science, VOL. 53, NO. 4, AUGUST, 2006

 G. Lukawski, K. Sapiecha, "Software Functional Fault Injector for SDDS?, GI-Edition Lectures Notes on Informatics, ARCS"06 Workshop proceedings, 2006

 U. Wappler, C. Fetzer, G. Dresden, "Hardware fault injection using dynamic binary instrumentation: FITgrind?, Sixth European Dependable Computing Conference (EDCC-6), vol. vol. Proceedings Supplemental Volume, October 2006, pp. 37"38.

 Joost Visser, J.N. Oliveira, L.S. Barbosa, J.F. Ferreira, and A. Mendes, Camila Revival: VDM meets Haskell. In Fitzgerald, J. S., Larsen, P. G., Plat, N. (eds.), Towards Next Generation Tools for VDM: Contributions to the First International Overture Workshop, Newcastle, July 2005, Technical Report CS-TR969, School of Computing Science, Newcastle University, June 2006

 Christian Kobhio Bassek, Samuel Pierre and Alejandro Quintero, "Redundancy Schemes for High Availability Computer Clusters?, Journal of Computer Science 2 (1): 33-47, ISSN 1549-3636, 2006.

 M. Sonza Reorda, L. Sterpone, M. Violante, M. Portela-Garcia, C. Lopez-Ongil, L. Entrena, "Fault Injection-based Reliability Evaluation of SoPCs," ets, pp. 75-82, Eleventh IEEE European Test Symposium (ETS'06), 2006.

 V. Wong and M.Horowitz. Soft Error Resilience of Probabilistic Inference Applications. The Second Workshop on System Effects of Logic Soft Errors (SELSE), April 2006.

 J. Sosnowski, P. Gawkowski, P. Zygulski, A. Tymoczko, "Enhancing Fault Injection Testbench," depcos-relcomex, pp. 76-83, International Conference on Dependability of Computer Systems (DEPCOS-RELCOMEX'06), 2006.

 Daniel Larsson, "Formal Specification and Verification of Safety-Critical Software?, Thesis for the degree of Licentiate of Philosophy, Department of Computer Science and Engineering, Chalmers University of Technology and Goteborg University, SE-412 96 G¨oteborg, Sweden, October 2006.

 Nuno Neves, Joao Antunes, Miguel Correia, Paulo Verissimo, Rui Neves, "Using Attack Injection to Discover New Vulnerabilities," dsn, pp. 457-466, International Conference on Dependable Systems and Networks (DSN'06), 2006.

 CK Bassek, S Pierre, A Quintero, "Redundancy Schemes for High Availability Computer Clusters?, Journal of Computer Science Science 2 (1): 33-47, ISSN 1549-3636, 2006.

 Jun Jie, Huang Qing-Cheng, Hong Bingmrong, Li Yuan, "Test Fault Sensitivity of a Digital Processor by a Pure Software Approach?, Journal of Astronautics Vo1. 27 No1, January 2006.

 Cheng-Chun Tu, "Modeling Component Failures in Embedded Systems?, Master's Thesis, International Master´s Program in Dependable Computer Systems, Chalmers University of Technology, Department of Computer Science and Engineering, Goteborg, Sweden, 2006.

Year 2005 : 13 citations

 H. Schlingloff, S. Vulinovic, "Model based dependability evaluation for automotive control functions?, In SimSafe05, Modeling and simulation for public safety, P. Fritzson (ed.), Linköping, May 2005.

 Alexandersson, Ruben; ÿhman, Peter: A technique for fault tolerance assessment of COTS. International Conference on Computer Safety, Reliability and Security (SAFECOMP), 2005.

 P. Gawkowski, J. Sosnowski, "Analysing system susceptibility to faults with simulation tools?, XXI Autumn Meeting of Polish Information Processing Society, ISBN 83-922646-0-6, pp. 87-94, PIPS, 2005

 N. Looker, M. Munro, J. Xu, "A Comparison of Network Level Fault Injection with Code Insertion?, 29th Annual International Computer Software and Applications Conference, (COMPSAC), 2005.

 Pete Broadwell Emil Ong, "A Comparison of Static Analysis and Fault Injection Techniques for Developing Robust System Services?, University of Berkely, Tech. Report. http://www.cs.berkeley.edu/~emilong/research/saswifi.pdf, 2005.

 Q. Xie and A. M. Memon, "Rapid crash testing for continuously evolving GUI-based software applications?, In Proceedings of The International Conference on Software Maintenance, (ICSM'05), 2005.

 Martin Hiller, Arshad Jhumkas, and Neeraj Suri, "Tracking the Propagation of Data Errors in Software?, Dependable Computing Systems. Edited by Hassan B. Diab and Albert Y. Zomaya, ISBN 0-471-67422-2 John Wiley & Sons, Inc., 2005.

 Denise Eng, Dimitri Mostinski, and Martin Talbot, "Feasibility and Practical Considerations of Database Self-Managing Technologies?, CS848 Final Project, University of Waterloo, Waterloo, ON, Canada, 2005 (http://www.cs.uwaterloo.ca/~m2talbot/project/CS848-FINAL%20PROJECT.pdf).

 Joost Visser, J.N. Oliveira, L.S. Barbosa, J.F. Ferreira, and A. Mendes, "Camila Revival: VDM meets Haskell?, In Nico Plat and Peter Gorm Larsen, editors, Overture Workshop (co-located with FM'05), University of Newcastle upon Tyne, UK, July, 2005.

 R. Moraes, E. Martins, N. Mendes, "Fault injection approach based on dependence analysis?, Computer Software and Applications Conference, 2005. COMPSAC 2005. 29th Annual International, 26-28 July 2005

 Hassan Salmani, Seyed Ghassem Miremadi, "Contribution of Controller Area Network Controllers to Masquerade Failures?, in Proc. Of 11th IEEE International Symposium Pacific Rim Dependable Computing, PRDC2005, Changsha, Hunan, China, December 2005.

 Cristian Constantinescu, Intel Corporation, "Dependability Benchmarking Using Environmental Test Tools?, Proceedings of IEEE Reliability and Maintainability Symposium, RAMS 2005.

 Juan Pardo, Juan Carlos Ruiz, Jose-Carlos Campelo and Pedro Gil, "A Non-Intrusive SWIFI Technique for RTOS Robustness Testing", in 5th European Dependable Computing Conference, Budapest (Hungary) April 2005.

Year 2004 : 11 citations

 Nik Looker, Malcolm Munro and Jie Xu, "Simulating Errors in Web Services?, International Journal of Simulation: Systems, Sciences and Technology, Vol. 5 No. 5. 29, 2004.

 Ana " Elena Rugina, "Etalonnage de la sûreté de fonctionnement de systèmes d"exploitation?, Stage de Recherche, Institut National Polytechnique de Toulouse, Ecole Nationale Supérieure d"Electrotechnique, d"Electronique, d"Informatique, d"Hydraulique Et des Télécommunications, 2004.

 Siewiorek, D.P., Chillarege, R., and, Kalbarcyk. (2004) "Reflections on Industry Trends and Experimental research in Dependability?, IEEE Transactions on Dependable and Secure Computing, Volume 1, Number 2, pp. 109 " 127. IEEE Computer Society, 2004.

 N. Looker, M. Munro and J. Xu, "Testing Web Services", the 16th IFIP International Conference on Testing of Communicating Systems, Oxford, 2004

 H. R. Zarandi, S. G. Miremadi, S. Hessabi, A. Ejlali, "A Mixed-Mode Simulation-based Environment to Test and Dependability Assessment of HDL Models?, in the Proceedings of International Conference on Embedded Systems and Applications (ESA 2004), USA, June 2004.

 Fetzer C, Felber P, Hogstedt K "Automatic detection and masking of nonatomic exception handling" IEEE TRANSACTIONS ON SOFTWARE ENGINEERING 30 (8): 547-560 AUG 2004.

 Rajabzadeh, A.; Miremadi, S.G.; Mohandespour, M.; "Experimental evaluation of master/checker architecture using power supply-and software-based fault injection" On-Line Testing Symposium, 2004. IOLTS 2004. Proceedings. 10th IEEE International , 12-14 July 2004, Pages:239 - 244.

 W Gu, Z Kalbarczyk, RK Iyer "Error Sensitivity of the Linux Kernel Executing on PowerPC G4 and Pentium 4 Processors" Dependable Systems and Networks, 2004 International Conference on , 28 June-1 July 2004.

 Albinet, A.; Arlat, J.; Fabre, J.-C.; "Characterization of the impact of faulty drivers on the robustness of the Linux kernel" Dependable Systems and Networks, 2004 International Conference on , 28 June-1 July 2004, Pages:867 - 876.

 Bertrand Bastien "A Technique for Performing Fault Injection in System Level Simulations for Dependability Assessment" MSc Thesis, Univ. of Virginia, USA; January 2004.

 D. Gil, J. Garcia, and P. Gil, "Analysis of the influence of processor hidden registers on the accuracy of fault injection techniques? Ninth IEEE International High-Level Design Validation and Test Workshop. 10-12 Nov. 2004.

Year 2003 : 18 citations

 1. Peter Folkesson, Joakim Aidemark, snd Jonny Vinter, "Assessment and Application of Scan-Chain Implemented Fault Injection?, Technical Report 03-21, (27 pages) Chalmers University of Technology, Department of Computer Engineering, Göteborg, Sweden, 2003.

 2. Gawkowski P, Sosnowski J "Dependability evaluation with fault injection experiments" IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS E86D (12): 2642-2649 DEC 2003

 3. Zarandi, H.R.; Miremadi, S.G.; Ejlali, A.; "Fault injection into verilog models for dependability evaluation of digital systems" Parallel and Distributed Computing, 2003. Proceedings. Second International Symposium on , 13-14 Oct. 2003, Pages:281 - 287.

 4. Pedro Yuste, Juan Carlos Ruiz, Lenin Lemus, Pedro Gil "Non-intrusive Software-Implemented Fault Injection in Embedded Systems" Proc. First Latin-American Symposium on Dependable Computing, LADC 2003, 2003, October 2003, So Paulo, Brazil: Springer Verlag, Lecture Notes in Computer Science, LNCS 2847: p. 23-38, ISBN 3-540-20224-2.

 5. Rajesh Venkatasubramanian; Hayes, J.P.; Murray, B.T.; "Low-cost on-line fault detection using control flow assertions" On-Line Testing Symposium, 2003. IOLTS 2003. 9th IEEE , 7-9 July 2003, Pages:137 - 143.

 6. Ahyoung Sung, Byoungju Choi, "Interaction Testing in an Embedded System using Hardware Fault Injection and Program Mutation," Formal Approaches to Testing of Software(FATES'03) of the 18th IEEE ASE(Automated Software Engineering)'2003, Quebec Canada, 2003.10.

 7. Jean Arlat, Yves Crouzet, Johan Karlsson, Peter Folkesson, Emmerich Fuchs, Günther Leber "Comparison of Physical and Software-Implemented Fault Injection Techniques" IEEE Transactions on Computers, Vol 52, No. 9, September 2003, pp. 1115-1133.

 8. Ehret, Jürgen "Validation of Safety-Critical Distributed Real-Time Systems" PhD Thesis, Fakultät für Elektrotechnik und Informationstechnik , Technische Universität München , 2003.

 9. P. Yuste, D. Andrés, L. Lemus, J. Serrano, and P. Gil, "INERTE: Integrated NExus-based real-time fault injection tool for embedded systems", EEE/IFIP International Conference on Dependable Systems and Networks, International Performance and Dependability Symposium, DSN-IPDS 2003, San Francisco, CA, USA, June 22-25, 2003.

 10. P. Yuste, L. Lemus, J. Serrano, and P. Gil, "A methodology for software implemented fault injection using Nexus", Supplemental volume of the IEEE/IFIP International Conference on Dependable Systems and Networks, Dependable Computing and Communications, DSN-DCC 2003, San Francisco, CA, USA, pp. B-12-B-13, June 22-25, 2003.

 11. A. Ejlali, S. G. Miremadi, H. Zarandi, G. Asadi, "A hybrid fault injection approach based on simulation and emulation co-operation", EEE/IFIP International Conference on Dependable Systems and Networks, International Performance and Dependability Symposium, DSN-IPDS 2003, San Francisco, CA, USA, pp. 479-488, June 22-25, 2003.

 12. Weining Gu, Z. Kalbarczyk, R. Iyer, Z. Yang, "Characterization of linux kernel behavior under errors", IEEE/IFIP International Conference on Dependable Systems and Networks, International Performance and Dependability Symposium, DSN-IPDS 2003, San Francisco, CA, USA, pp. 459-468, June 22-25, 2003.

 13. Cristof Fetzer, K. Hogstedt, and P. Felber, "Automatic detection and masking of non-atomic exceptions handling", IEEE/IFIP International Conference on Dependable Systems and Networks, Dependable Computing and Communications, DSN-DCC 2003, San Francisco, CA, USA, pp. 445-454, June 22-25, 2003.

 14. T. Jarboui, "Surete de Fonctionnement de Systemes Informatiques " ÿtalonage et Representativite des Fautes?, tese de doutoramento de Tahar Jarboui, LAAS-CNRS, Toulouse, França., Maio de 2003, LAAS-CNRS, Toulouse, França.

 15. Andreas Steininger, Babak Rahbaran, Thomas Handl, "Built-In Fault Injectors - The logical Continuation of BIST?" Proc. of First Workshop on Intelligent Solutions in Embedded Systems (WISES), 2003. pp. 187-196. Reserach Report 56/2003, Real-Time Systems Research Group at the Vienna University of Technology.

 16. Constantinescu C., "Experimental evaluation of error-detection mechanisms", IEEE Transactions on Reliability, 52 (1): pp. 53-57, March 2003.

 17. Raviteja Varanasi, "Software Faults and Fault Injection Models?, Project of the coursework for CSC53, Advanced Software Engineering, Lousiana Tech University, USA, 2003

 18. Markus Jochim, "Automatische Erzeugung und Bewertung virtueller Duplexsysteme zur Erkennung von Betriebsfehlern in Mikroprozessoren?, Doktor der Naturwissenschaften, Fachbereich 6 des Standorts Essen der Universit¨at Duisburg-Essen am 27.03.2003

Year 2002 : 21 citations

 1. P. Gawkowski and J. Sosnowski, "Using Software Implemented Fault Inserter in Dependability Analysis", Pacific Rim International Symposium on Dependable Computing, PRDC2002, pp. 81-88,Tsukuba, Japão, 16 a 18 de Dezembro de 2002.

 2. Astrit Ademaj "A Methodology for Dependability Evaluation of the Time-Triggered Architecture Using Software Fault Injection", Proc. of EDCC-4, Toulouse, October 2002, p. 172-190, LNCS 2002

 3. Rezgui S., Swift G. M., Velazco R., Farmanesh F. F., "Validation of an SEU simulation technique for a complex processor: PowerPC7400", IEEE Transactions on Nuclear Science, 49 (6): 3156-3162, Part 1, Dec. 2002.

 4. Cardarilli, G.C.; Kaddour, F.; Leandri, A.; Ottavi, M.; Pontarelli, S.; Velazco, R.; "Bit flip injection in processor-based architectures: a case study" On-Line Testing Workshop, 2002. Proceedings of the Eighth IEEE International , 8-10 July 2002, Pages:117 - 127.

 5. Broadwell, P., N. Sastry, J. Traupman. "FIG: A Prototype Tool for Online Verification of Recovery Mechanisms" Proc. Workshop on Self-Healing, Adaptive and Self-MANaged Systems (SHAMAN), New York, NY, June 2002.

 6. Ademaj, A.; Grillinger, P.; Herout, P.; Hlavicka, J.; "Fault tolerance evaluation using two software based fault injection methods" On-Line Testing Workshop, 2002. Proceedings of the Eighth IEEE International , 8-10 July 2002, Pages:21 - 25.

 7. Alberto Arazo, "Surete de Fonctionnement de Systemes Logiciels Critiques : Validation Experimentale d"un Systeme de Contrôle-Comande du Commerceâ?, tese de doutoramento, LAAS-CNRS, Toulouse, França, Julho de 2002.

 8. E Marsden, JC Fabre, J Arlat "Dependability of CORBA Systems: Service Characterization by Fault Injection" Symposium on reliable distributed systems, Osaka, Japan, 2002

 9. Rezgui S., Velazco R., Ecoffet R., "New methodology for simulation of soft errors in digital processors", Journal of Spacecraft and Rockets, 39 (4): pp. 495-500, July-Aug., 2002.

 10. John DeVale and Philip Koopman, "Robust Software - No More Excuses", EEE/IFIP International Conference on Dependable Systems and Networks, DSN-2002, Bethesda, Maryland, USA, pp. 69-78, June 145-153, 2002 (best paper award).

 11. M. Rodriguez, A. Albinet, and J. Arlat, "MAFALDA-RT, a tool for dependability assessment of real-time systems", EEE/IFIP International Conference on Dependable Systems and Networks, DSN-2002, Bethesda, Maryland, USA, pp. 267-272, June 23-26, 2002.

 12. M. Jochim, "Detecting processor hardware faults by means of automatically generated virtual duplex systems", EEE/IFIP International Conference on Dependable Systems and Networks, DSN-2002, Bethesda, Maryland, USA, pp. 399-407, June 23-26, 2002.

 13. E. Martins, C. Rubira, and N. Leme, "Jaca: a reflective fault injection tool based on patterns", EEE/IFIP International Conference on Dependable Systems and Networks, DSN-2002, Bethesda, Maryland, USA, pp. 483-487, June 23-26, 2002.

 14. E. Marsden, J-C. Fabre, and J. Arlat, "Characterization approaches for CORBA systems by fault injection", supplemental volume of the IEEE/IFIP International Conference on Dependable Systems and Networks, DSN-2002, Bethesda, Maryland, USA, pp. G16-G25, June 23-26, 2002.

 15. Jun Xu, Zbigniew Kalbarczyk and Ravishankar K. Iyer. "HiPerFI: A High-Performance Fault Injector". In Proc. of IEEE Intl' Conf. on Dependable Systems and Networks (Fast Abstract), Washington DC, June, 2002.

 16. R. Velazco, S. Rezgui, R. Eccofet, "Predicting Error Rate for Microprocessor-Based Digital Architectures Through CEU Injection", ISSN 1292-862 TIMA Lab. Research Reports, TIMA-RR-02-02-6-FR, 2002.

 17. Broadwell, P., N. Sastry and J. Traupman., "FIG: A Prototype Tool for Online Verification of Recovery Mechanisms.", Workshop on Self-Healing, Adaptive and self-MANaged Systems (SHAMAN), New York, NY, June 2002.

 18. Arlat J, Fabre JC, Rodriguez M, et al. "Dependability of COTS microkernel-based systems" IEEE Trans Computers 51 (2): 138-163 FEB 2002

 19. Yangyang Yu, Barry W. Johnson, "A Perspective on the State of Research on Fault Injection Techniques", Center for Safety Critical Systems Departments of Electrical and Computer Engineer and Computer Science The University of Virginia Technical Report UVA-CSCS-FIT-001 Prepared for U.S. Nuclear Regulatory Commission, May 2002.

 20. Hiller M., Jhumka A., Suri N. "PROPANE: An Environment for Examining the Propagation of Errors in Software" International Symposium on Software Testing and Analysis (ISSTA), ACM Press Software Engineering Notes, Vol. 27, No.4, pp. 81-85, 2002

 21. A. Ademaj, P. Grillinger, P. Herout, and J. Hlavicka. "Fault tolerance evaluation using two software based fault injection methodsâ?, In Proceedings of IEEE International On-Line Testing Workshop IOLTW, Isle of Benedor, France, 2002. ISBN 0-7695-1641-6.

Year 2001 : 11 citations

 1. John DeVale; "High Performance Robust Computer Systems" PhD Thesis, Carnegie Mellon University, October 2001.

 2. Piotr Gawkowski and Janusz Sosnowski "Experimental Evaluation of Fault Handling Mechanisms" SAFECOMP 2001, Budapest, Hungary, September 26-28, 2001.

 3. Sosnowski, J.; "Analyzing BIST robustness" Defect and Fault Tolerance in VLSI Systems, 2001. Proceedings. 2001 IEEE International Symposium on , 24-26 Oct. 2001, Pages:104 - 109

 4. Eric Marsden, Jean-Charles Fabre, "Failure analysis of an ORB in presence of faults", deliverable of the project IST-1999-11585, Dependable Systems of Systems - DSoS, October 2001.

 5. Gawkowski, P.; Sosnowski, J. "Analyzing fault effects in fault insertion experiments" On-Line Testing Workshop, 2001. Proceedings. Seventh International , 9-11 July 2001, Pages:21 - 24

 6. John DeVale, Philip Koopman "Performance Evaluation of Exception Handling in I/O Libraries" Proceedings of the 2001 International Conference on Dependable Systems and Networks, 1-4 July 2001, Göteborg, Sweden, IEEE Computer Society, ISBN 0-7695-1101-5, pp. 518-524.

 7. Joakim Aidemark, Jonny Vinter, Peter Folkesson, Johan Karlsson"GOOFI: Generic Object-Oriented Fault In jection Tool" Proceedings of the 2001 International Conference on Dependable Systems and Networks, 1-4 July 2001, Göteborg, Sweden, IEEE Computer Society, ISBN 0-7695-1101-5, pp. 83-88.

 8. Raphael R. Some, Won S. Kim, Garen Khanoyan, Leslie Callum, Anil Agrawal, and John J. Beahan "A Software-Implemented Fault Injection Methodology for Design and Validation of System Fault Tolerance" Proceedings of the 2001 International Conference on Dependable Systems and Networks, 1-4 July 2001, Göteborg, Sweden, IEEE Computer Society, ISBN 0-7695-1101-5, pp. 501-506.

 9. Pascal Chevochot, Isabelle Puaut "Experimental evaluation of the fail-silent behavior of a distributed real-time run-time support built from COTS components" Proceedings of the 2001 International Conference on Dependable Systems and Networks, 1-4 July 2001, Göteborg, Sweden, IEEE Computer Society, ISBN 0-7695-1101-5, pp. 304-313.

 10. Wee Teck Ng and Peter M. Chen "The Design and Verification of the Rio File Cache" IEEE Transactions on Computers, VOL. 50, NO. 4, APRIL 2001.

 11. Maitrayi Sabaratnam, "Improving Dependability in Database Management Systems?, tese de doutoramento de Maitrayi Sabaratnam, Novembro de 2001, Universidade de Trondheim, Trondheim, Noruega.

Year 2000 : 10 citations

 1. Almeida C, Arazo A, Crouzet Y, Kanoun K "Dependability of computer control systems in power plants - Analytical and experimental evaluation" COMPUTER SAFETY, RELIABILITY AND SECURITY, PROCEEDINGS, LECTURE NOTES IN COMPUTER SCIENCE, 1943: 165-175 2000.

 2. Cristian Constantinescu, "Teraflops supercomputer: Architecture and validation of the fault tolerance mechanisms?, IEEE Transactions On Computers, vol. 49, no. 9, Setembro 2000, pp. 886-894, ISSN 0018-9340.

 3. Velazco R, Rezgui S, Ecoffet R "Predicting error rate for microprocessor-based digital architectures through CEU (Code Emulating Upsets) injection" IEEE T NUCL SCI 47 (6): 2405-2411 Part 3 DEC 2000

 4. D Lambright "Experiences in Measuring the Reliability of a Cache-Based Storage System" First Workshop on Industrial Experiences with Systems Software, October 22, 2000, San Diego, California, USA, Usenix.

 5. S Rezgui, R Velazco, R Ecoffet, S Rodriguez "A New Methodology for the Simulation of Soft Errors in Digital Processors: a Case Study" 3rd annual Military and Aerospace Applications of Programmable Devices and Technologies International Conference, Laurel, Maryland, USA, September 26-28, 2000

 6. P. Chevochot and I. Puaut. Experimental evaluation of the fail-silent behavior of a distributed real-time run-time support built from COTS components. Technical Report 1370, IRISA, Oct. 2000

 7. Luis Claudio Rodrigues Gonçalves, Taisy Silva Weber " Injeção de Falhas via Depuradores" In: WSL2000, I Workshop de Software Livre (part of I FISL " Fórum Internacional de Software Livre), Porto Alegre, RS, Brasil, 04 e 05 de maio de 2000, SBC.

 8. Pascal Chevochot, Isabelle Puaut, Gilbert Cabillic, Antoine Colin, David Decotigny, Michel Banatre "HADES: A distributed System for Dependable Hard Real-Time Applications Built from COTS Components", IRISA, RENNES, FRANCE, Tech Rep 1357, 2000, ISSN 1166-8687.

 9. DT Stott "Automated Fault-Inject Based Dependability Analysis of Distributed Computer Systems" Report for the Preliminary PhD Exam, 2000, Center for Reliable and High-Performance Computing, Coordinated Science Laboratory, University of Illinois at Urbana-Champaign

 10. Luis Gonçalves e Taisy Weber, "FIDe Injeção de Falhas via Depuração?, 1o. Fórum Internacional Software Livre, 2000 (http://www.inf.ufrgs.br/pos/SemanaAcademica/Semana2000/LuisGoncalves/)

Year 1999 : 13 citations

 Reza Sedaghat, "Fault Emulation: Reconfigurable Hardware-Based Fault Simulation Using Logic Emulation Systems with Optimized Mapping?, PhD thesis, University of Hannover, December 1999

 Constantinescu, C.; "Using physical and simulated fault injection to evaluate error detection mechanisms" Pacific Rim International Symposium on Dependable Computing, Proceedings. 1999 , 16-17 Dec. 1999, Pages:186 - 192, IEEE Computer Society.

 Wee Teck Ng e Peter Chen, "The Systematic Improvement of Fault Tolerance in the Rio File Cache?, Proceedings of the 29th Annual International Symposium on Fault-Tolerant Computing Symposium, FTCS-29, 15 a 18 de Junho de 1999, Madison, Wisconsin, EUA, IEEE Computer Society Press, pp 76-83, ISBN 0-7695-0213-X;

 Jean Arlat, Jérome Boué, Yves Crouzet "Validation-Based Development of Dependable Systems" IEEE MICRO, Vol. 19, No. 4; JULY-AUGUST 1999, pp. 66-79

 D. Powell, J. Arlat, L. Beus-Dukic, A. Bondavalli, P. Coppola, A. Fantechi, E. Jenn, C. Rabéjac, A. Wellings "GUARDS: A Generic Upgradable Architecture for Real-Time Dependable Systems" IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, Vol. 10, No. 6; JUNE 1999, pp. 580-599.

 Frédéric Salles, M. Rodríguez, Jean-Charles Fabre e Jean Arlat, "MetaKernels anf Fault Containment Wrappers?, Proceedings of the 29th Annual International Symposium on Fault-Tolerant Computing Symposium, FTCS-29, 15 a 18 de Junho de 1999, Madison, Wisconsin, EUA, IEEE Computer Society Press, pp 22-29, ISBN 0-7695-0213-X;

 Sosnowski, J.; Gawkowski, P. "Tracing fault effects in system environment" EUROMICRO Conference, 1999. Proceedings. 25th , Volume: 1 , 8-10 Sept. 1999, Pages:481 - 486 vol.1.

 J. Sosnowski, T. Bech "Evaluating FPU tests with fault inserter" Third European Dependable Computing Conference, EDCC3, Praga, República Checa, Setembro de 1999, Fast abstract.

 Manuel Rodríguez, F. Salles, Jean- Charles Fabre e Jean Arlat, "MAFALDA: Microkernel Assessment by Fault Injection and Design Aid?, Third European Dependable Computing Conference, EDCC3, Praga, República Checa, Setembro de 1999, Lecture Notes in Computer Science 1667, Spriger-Verlag, pp.143-160, 1999.

 Cristian Constantinescu, "Assesssing Error Detection Coverage by Simulated Fault Injection?, Third European Dependable Computing Conference, Praga, República Checa, Setembro de 1999, Lecture Notes in Computer Science 1667, Spriger-Verlag, pp. 161-170, 1999.

 Fabre, J.-C.; "On the use of COTS microkernels for dependable systems" Autonomous Decentralized Systems, 1999. Integration of Heterogeneous Systems. Proceedings. The Fourth International Symposium on , 21-23 March 1999, Pages:132 - 139.

 Fabre, J.-C.; Salles, F.; Moreno, M.R.; Arlat, J. "Assessment of COTS microkernels by fault injection" Dependable Computing for Critical Applications 7, 1999 , 6-8 Jan. 1999, Pages:25 - 44

 Wee Teck Ng, "Design and Implementation of Reliable Main Memory?, tese de doutoramento, University of Michigan, USA, 1999.

Year 1998 : 1 citations

 1. John Bates, " The State of the Art in Distributed and Dependable Computing?, A CaberNet-Sponsored Report (CaberNet " Esprit Network of Excellence in distributed computing systems architectures, 21035), Outubro de 1998;