One of the most promising fields for Ambient Intelligence is the implementation of intelligent emergency plans. Because the use of drills and living labs cannot reproduce social behaviours, such as panic attacks, that strongly affect these plans, the use of agent-based social simulation provides an approach to evaluate these plans more thoroughly. (1) The hypothesis presented in this paper is that there has been little interest in describing the key modules that these simulators must include, such as formally represented knowledge and a realistic simulated sensor model, and especially in providing researchers with tools to reuse, extend, and interconnect modules from different works. This lack of interest hinders researchers from achieving a holistic framework for evaluating emergency plans and forces them to reconsider and to implement the same components from scratch over and over. In addition to supporting this hypothesis by considering over 150 simulators, this paper (2) defines the main modules identified and proposes the use of semantic web technologies as a cornerstone for the aforementioned holistic framework, (3) provides a basic methodology to achieve the framework, (4) identifies the main challenges, and (5) presents an open and free software tool to hint at the potential of such a holistic view of emergency plan evaluation in indoor environments.