Web-services are supported by a complex software infrastructure that must provide a robust service to the client applications. This paper presents a practical approach for the evaluation of the robustness of web-services infrastructures. A set of robustness tests (i.e., invalid web-services call parameters) is applied during web-services execution in order to reveal possible robustness problems in the web-services code and in the application server infrastructure. The approach is illustrated using two different implementations of the web-services specified by the TPC-App performance benchmark running on top of the JBoss application server. The proposed approach is generic and can be used to evaluate the robustness of web-services implementation (relevant for programmers) and application server infrastructures (relevant for administrators and system integrators).
Subject
Web services robustness
Conference
Dependable Computing and Communications Symposium (DCCS), June 2007
Cited by
Year 2013 : 3 citations
Sébastien Salva and Antoine Rollet, “A pragmatic approach for testing stateless and stateful Web Service Robustness,” Studia Informatica Universalis 10, no. 2: 139–179, 2013.
Stefan Winter, Michael Tretter, Benjamin Sattler, and Neeraj Suri, “simFI: From Single to Simultaneous Software Fault Injections,” The 43rd Annual IEEE/IFIP International Conference on Dependable Systems and Networks, Budapest, Hungary: IEEE Computer Society, 24 June 2013.
Zibin Zheng and Michael R Lyu, “QoS-Aware Fault Tolerance for Web Services,” QoS Management of Web Services, 97–118. Advanced Topics in Science and Technology in China, Springer, 2013.
Year 2012 : 6 citations
1. Issam Rabhi, “Testabilité des services Web”, PhD Thesis, École Doctorale Sciences pour l’Ingénieur de Clermont-Ferrand. Université Blaise Pascal – Clermont II, 5 October 2012.
2. Ali Shahrokni, Robert Feldt, “A Systematic Review of Software Robustness”, Information and Software Technology (Elsevier), ISSN 0950-5849, June 2012.
3. Issam Rabhi and Patrice Laurençot, “Robustesse des Services Web Composés”, Conférence en IngénieriE du Logiciel (CIEL), Rennes, France, 18 June 2012.
4. Marcelo Invert Palma Salas and Eliane Martins, “Metodologia de Testes de Robustez por Injeção de Falhas para WS-Security”, Technical Report. Anais do VII Workshop de Teses, Dissertações e Trabalhos de Iniciação Científica em Andamento do IC-UNICAMP IC-12-19. Alex Grilo, Ariadne Carvalho, Daniel Cugler, Everton Silva, Gustavo Alkmim, Ivelize Rocha, Leonardo Tampelini, et al. (Eds.), Instituto de Computação, Universidade Estadual de Campinas, June 2012.
5. Yuhui Chen, Anatoliy Gorbenko, Vyacheslav Kharchenko, Alexander Romanovsky, “Measuring and Dealing with the Uncertainty of SOA Solutions,” Performance and Dependability in Service Computing: Concepts, Techniques and Research Directions, ed. Valeria Cardellini, Emiliano Casalichio, Kalinka Castelo Branco, Júlio Cezar Estrella, and Francisco José Monaco, IGI Global, ISBN: 1609607945, 2012.
6. Anatoliy Gorbenko, Vyacheslav Kharchenko, Seyran Mamutov, Olga Tarasyuk, Alexander Romanovsky, “Exploring Uncertainty of Delays as a Factor in End-to-End Cloud Response Time”, 9th European Dependable Computing Conference (EDCC 2012), Sibiu, Romenia, May 2012.
Year 2011 : 5 citations
1. Fahad A. Arshad, Saurabh Bagchi, “Dangers and Joys of Stock Trading on the Web: Failure Characterization of a Three-Tier Web Service,” IEEE 30th International Symposium on Reliable Distributed Systems, SRDS 2011, Madrid, Spain, October 2011.
2. Khaled Farj, “Fault Injection Testing Method of Software Implemented Fault Tolerance Mechanisms of Web Service Systems”, PhD Thesis, Newcastle University, Newcastle upon Tyne, UK, September 2011.
3. Rich Pietravalle and Dan Lanz, “Resiliency Research Snapshot”, Technical Report. 11-3023, MITRE Corporation, June 2011.
4. Zibin Zheng, “QoS Management of Web Services”, PhD Thesis, The Chinese University of Hong Kong, Hing Kong, January 2011.
Yuhui Chen, Anatoliy Gorbenko, Vyacheslav Kharchenko, and Alexander Romanovsky, “Measuring and Dealing with the Uncertainty of SOA Solutions,” Performance and Dependability in Service Computing: Concepts, Techniques and Research Directions, ed. Valeria Cardellini, Emiliano Casalichio, Kalinka Castelo Branco, Júlio Cezar Estrella, and Francisco José Monaco, 265-294, IGI Global, ISBN: 1609607945, July 2011.
Year 2010 : 7 citations
1. Yongbo Wang, Fuyuki Ishikawa, and Shinichi Honiden, “Business Semantics Centric Reliability Testing for Web Services in BPEL”, 6th World Congress on Services, SERVICES ’10, Washington, DC, USA, 2010.
2. Zibin Zheng, M.R. Lyu, “Optimal Fault Tolerance Strategy Selection for Web Services,” International Journal of Web Service Research (JWSR), Vol. 7, no. 4, pp. 21-40, 2010.
3. Anatoliy Gorbenko, “Instability Analysis of Delays Contributing to Web Service Response Time”, Radioelectronic and computer systems, National Aerospace University, Ukraine. Vol. 6, no. 47, 2010.
4. Manoj Lall, Lucas Venter, and John van der Poll, “Evaluating the second generation Web services specifications for satisfying non-functional requirements,” World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education, Orlando, Florida, USA, ISBN: 1-880094-83-5, October 2010.
5. Sébastien Salva, Issam Rabhi, “Stateful web service robustness”, Fifth International Conference on Internet and Web Applications and Services, Barcelona, Spain, May 2010.
6. Sébastien Salva, Issam Rabhi, “Robustesse des Services Web Persistants,” 8ème Conférence Internationale de MOdélisation et SIMulation (MOSIM 2010), Hammamet, Tunisia: IEEE Computer Society, May 2010.
7. Anatoliy Gorbenko, Vyacheslav Kharchenko, Seyran Mamutov, Olga Tarasyuk, Yuhui Chen, and Alexander Romanovsky, “Real Distribution of Response Time Instability in Service-Oriented Architecture”, 29th IEEE Symposium on Reliable Distributed Systems, pp. 92-99, New Delhi, India, November 2010.
Year 2009 : 8 citations
1. Gorbenko, A., Kharchenko, V., Mamutov, S., Tarasyuk, O., Chen, Y., Romanovsky, “A Real Distribution of Response Time Instability in Service-Oriented Architecture”, CS-TR-1182, Technical Report Series, School of Computing Science, University of Newcastle Upon Tyne, UK, December 2009.
2. Zibin Zheng, Michael R. Lyu, “An Adaptive QoS-Aware Fault Tolerance Strategy for Web Services”, Springer Journal of Empirical Software Engineering (EMSE), December 2009.
3. Seung Hak Kuk, Hyeon Soo Kim, "Robustness testing framework for Web services composition", IEEE Asia-Pacific Services Computing Conference (APSCC 2009), Singapore, December 2009.
4. Marcelo Palma Salas, Eliane Martins, “Metodologia de Testes de Robustez para Segurança em Serviços WEB”, proceedings of the 5o Workshop de Teses de Doutorado em Andamento do IC-UNICAMP, IC-09-026 – Technical Report, Mariana Piquet Dias, Cecília Mary F. Rubira, Rodolfo Jardim de Azevedo, Carla G. N. Macario, Joana E. G. Malaverr, Jefersson Alex dos Santos, Luiz Fernando Bittencourt, Ricardo Caceffo, Roberto Pereira, Vânia Paula de A. Neris (Eds.), September de 2009.
5. Zibin Zheng, Michael R. Lyu, “A QoS-Aware Fault Tolerant Middleware for Dependable Service Composition”, The 39th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2009, Lisbon, Portugal, June 29-July 2, 2009.
6. Zibin Zheng, Michael R. Lyu, “A Runtime Dependability Evaluation Framework for Fault Tolerant Web Services”, Workshop on Proactive Failure Avoidance, Recovery and Maintenance, PFARM (jointly organized with The 39th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2009), Lisbon, Portugal, June 29, 2009.
7. Sébastien Salva, Issam Rabhi, “Automatic web service robustness testing from WSDL descriptions”, 12th European Workshop on Dependable Computing, EWDC 2009, Toulouse, France, May 14-15, 2009.
8. Y. Chen, A. Gorbenko, V. Kharchenko, S. Mamutov, A. Romanovsky, O. Tarasyuk, “Benchmarking Dependability of a System Biology Application”, 14th IEEE International Conference on Engineering of Complex Computer Systems, Potsdam, Germany, June 2009.
Year 2008 : 6 citations
1. A. Gorbenko, A. Romanovsky, V. Kharchenko, A. Mikhaylichenko, “Experimenting with exception propagation mechanisms in service-oriented architecture”, 4th international Workshop on Exception Handling, WEH’08, Atlanta, Georgia, USA, November 14, 2008.
2. Z. Zheng, M.R. Lyu, “A QoS-Aware Middleware for Fault Tolerant Web services”, IEEE International Symposium on Software Reliability Engineering (ISSRE'08), Seattle, USA, November 11-14, 2008.
3. A. Gorbenko, V. Kharchenko, O. Tarasyuk, Y. Chen, A. Romanovsky, “The Threat of Uncertainty in Service-Oriented Architecture”, 2008 RISE/EFTS Joint International Workshop on Software Engineering for Resilient Systems, Newcastle upon Tyne, United Kingdom, November 2008.
4. Zibin Zheng, Michael R. Lyu, “A Distributed Replication Strategy Evaluation and Selection Framework for Fault Tolerant Web Services”, IEEE International Conference on Web Services (ICWS'08), Beijing, China, September 23-26, 2008.
5. Chen Yuhui, “WS-Mediator for Improving Dependability of Service Composition”, PhD Thesis, CS-TR: 1116 Technical Report Series, School of Computing Science, University of Newcastle Upon Tyne, UK, August 2008.
6. Z. Zheng, M.R. Lyu, "WS-DREAM: A Distributed Reliability Assessment Mechanism for Web Services", 38th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN 2008, Anchorage, Alaska, USA, June 24-27, 2008.
