Distributed Data Collection through Remote Probing in Windows Environments

Authors

Patricio Domingues
Paulo Marques
Luís Silva

Abstract

Distributed Data Collector (DDC) is a framework to ease and automate repetitive executions of console applications (probes) over a set of LAN networked Windows personal computers. The framework allows for the remote execution of probes, providing support for collecting the execution output of probes (standard output and standard error). Additionally, right after a probe execution, the output can be parsed and processed by user defined code (post collecting code) that can act accordingly to user's needs. The framework can be useful to perform repetitive large-scale monitoring and administrative tasks over machines with transient availability, that is, machines that present no guarantees of being available at a given time.
A major strength of DDC lies in the fact that it does not require installation of software in remote nodes, avoiding administrative burdens that remote daemons and alike normally provoke.
Besides presenting the data collection framework, the paper discusses the results of a 30-day monitoring experiment conducted with DDC. The experiment collected resource usage metrics over 169 Windows machines from classroom laboratories of an academic institution.

Keywords

Windows, Data collecting, Monitoring, Remote execution

Conference

PDP'05, February 2005

PDF File

Cited by

Year 2013 : 1 citations

Tie, Zhixin, ”Mobile-C Based Agent System for Detecting Improper Computer Usage at Computer Laboratories”, Journal of Software, 8(9), pp. 2262-2271, 2013.

Year 2011 : 2 citations

[PDF] http://www.csi.ucd.ie/Staff/jmurphy/publications/1721.pdf
Jesus Omana Iglesias, James Thorburn, Trevor Parsons, John Murphy, and Patrick O’Sullivan, "Scoring System Utilization Through Business Profiles", IEEE CloudCom 2011, 2011.

[PDF] http://www.cse.wustl.edu/~schmidt/PDF/RTCSA-2011.pdf
James Hill and Douglas C. Schmidt Experiences with Service-Oriented Middleware for Dynamic Instrumentation of Enterprise Distributed Real-time and Embedded Systems, Proceedings of the 1st International Symposium on Secure Virtual Infrastructures (DOA-SVI'11), October 17-19, 2011, Crete, Greece.

Year 2009 : 2 citations

[PDF] http://doi.ieeecomputersociety.org/10.1109/ESIAT.2009.123
C. Fang, Y. Zhao, Z. Wang, “Research and Design of a Service Management System for Deadline Render Farm”, International Conference on Environmental Science and Information Application Technology, Wuhan, China, pp. 542-454, 2009.

[PDF] http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=5198525
Jinwei Wang, Huazhi Sun, Jianping Fan, "DUMS: A Dynamical Updatable Monitoring System for Desktop PCs Used for Distributed Computing", pp 309-310, Third IEEE International Symposium on, Theoretical Aspects of Software Engineering, 2009 (TASE 2009). DOI:10.1109/TASE.2009.44

Year 2005 : 1 citations

[PDF] http://www-vs.informatik.uni-ulm.de/DE/intra/bib/2005/PDCS/466-153.pdf
Jinwei Wang, Yuzhong Sun, Jianping Fan, "Analysis on Resource Utilization Patterns of Office Computer", Proceedings of the 17th IASTED International Conference Parallel and Distributed Computing and Systems, pp 626-631, 2005.