3rd International Workshop on Designing Empirical Studies: Assessing the
Effectiveness of Agile Methods (IWDES 2009)
Co-located with XP 2009 (http://www.xp2009.org/)
May 29th, 2009 - Sardinia, Italy
Call for Papers
Submissions of papers are solicited for the "3rd International Workshop
on Designing Empirical Studies: Assessing the Effectiveness of Agile
Methods (IWDES 2009)", to be held in Sardinia (Italy) on May 29th, 2009
(co-located with XP 2009).
AIMS AND OBJECTIVES
The goal of this workshop is to foster collaborations among researchers
interested in conducting empirical research to assess the effectiveness
of Agile Methods. The workshop is intended as a meeting forum where
researchers will discuss and plan together joint empirical studies. As
previously mentioned, the design of such studies is tricky, and there
are many obstacles to replication.
A similar workshop has been organized at the International Conference on
Program Comprehension (ICPC) in 2006 and in 2007. In such cases, the
focus was on designing empirical studies for program comprehension. In
this edition, we have decided to focus on designing empirical studies
for assessing the effectiveness of Agile Methods.
In the previous editions, a number of open research issues have been
identified. We hope to establish collaborations to reach a critical mass
for the replication of a selected set of studies. Often, a single
research group conducts a user study whose result suggests a trend but
lacks statistical significance because the group cannot assemble a
sufficiently large subject pool. If multiple research groups run
independent studies using the same material, a meta-analysis may be able
to combine these studies to yield a statistically significant result. By
planning these independent studies and then performing a meta-analysis,
we could learn much about how to deal with this general problem. To
facilitate replication, one important issue to be discussed in the
workshop is how to package and share materials and results to facilitate
replication and make sure to learn from mistakes occurred in the first
replications, e.g., improving the experiment design or material whenever
This workshop will include participants of various backgrounds,
including academics, students, and practitioners. A potential attendee
* a proposer of some empirical study, looking for collaborators to help
in the planning and execution of the study and in the dissemination of
* someone who wishes to get involved or otherwise collaborate in one of
the proposed studies.
* someone looking to gain insights into the issues related to the
planning and execution of empirical studies, report personal experience,
and/or provide feedback and stimulate the discussion.
ORGANIZATION OF THE WORKSHOP
The workshop will last a full day and will be organized as follows
14:00 - 14:15: Introduction by the organizers
14:15 - 15:00: Invited talk (Prof. Giancarlo Succi, Free University of
15:00 - 15:30 Presentation of empirical study proposals
15:30 - 16:00: Coffee break
16:00 - 17:00: Working session: groups will work on the design of joint
17:00 - 17:30: Discussion report/presentation of empirical study designs
After the workshop, we will investigate the possibility of asking for a
special issue of an international journal to publish results of the most
interesting empirical studies planned during the workshop and then
carried out by groups of researchers.
May 10th, 2009: Deadline for the submission of the empirical study
May 12th, 2009: Acceptance notification
May 29th, 2009: Workshop
Participants are expected to submit an empirical study proposal (2
pages) to the workshop organizers ([log in to unmask],
[log in to unmask], and [log in to unmask]).
To contribute to SEWORLD, send your submission to
<[log in to unmask]>.
http://www.cs.colorado.edu/serl/seworld provides more
information on SEWORLD as well as a complete archive of
messages posted to the list.
To subscribe to SEWORLD, send the following (as the body of
a message) to <[log in to unmask]>:
subscribe seworld <desired e-mail address>
To unsubscribe from SEWORLD, send the following (as the body
of a message) to <[log in to unmask]>:
unsubscribe seworld <registered e-mail address>