Experimental Evaluation of Ubiquitous Mobile Systems

Overview & Synopsis

In the ubiquitous computing area, evaluation of solutions remains an open problem. In most cases, proposed algorithms are evaluated and validated using wireless network simulators such as NS-2 [NS2], Glomosim [GLO] or JiST/SWANS [BHvR05]. Since simulators use a model of physical components, such as network cards and location systems, this raises concerns as to the representativity of the assumptions that underlie the simulation [CSS02]. Little work concerning the evaluation of algorithms in a realistic environment is available. Of course, this is due to practical reasons: how can one realistically set up a platform allowing the execution of algorithms dealing with mobility and ubiquity? In this work, we focus on the development of a realistic platform, at the laboratory scale, to evaluate and validate fault-tolerance algorithms (e.g., group membership protocols, replication protocols) targeting systems comprising a large number of mobile devices equipped with various sensors and actuators. Our goal is to have an experimentation platform allowing for reproducible experiments (including movements) that will complement validation through simulation. Our platform must account for issues related to changes of scale so as to emulate as many various systems as possible.