For this week's theme, Design Research, we read the following papers: Finding design qualities in a tangible programming space - Fernaeus & Tholander & Differentiated Driving Range - Lundström. This is my discussion based on the reading.
What is the 'empirical data' in these two papers?
The term 'empirical' in general refers to information or knowledge that is based on experience. Further, in the context of science, 'empirical data' means knowledge that is gained through observation and experimentation. Two types of research methods are used to gather empirical data, and those methods are of course either qualitative or quantitative.
In the paper written by Fernaeus and Tholander the empirical data was gathered through a qualitative method. The researchers based the experimental part of the study on interaction between children and chosen design prototypes, meaning that the data was gathered through observing how children in staged activities were using the tangible prototypes. Observations were also made with the help of interaction analysis based on the recorded video material about the interaction in the tangible programming space created by the researchers.
As for Lundström’s paper, the researchers first conducted a pre-study based on analysis of discourse
in online forums, and also interviews. This was necessary in order to conduct the actual empirical part of the study, because the experiment methods arouse from the findings of the pre-study. So, an iterative and explorative design process was then carried out and the process resulted a prototype that was then tested while driving an electric car. The empirical data was about driving range, and it was quantitative.
One could conclude that both of these research papers exploited a design method that includes the process of first conceptualizing of the idea, then sketching the initial design and building a prototype, testing it, analyzing and finally ending up with the an improved version based on the learnings from the testing situations. Above I may have mostly described the process through which the empirical data was gathered and not so much the data itself, but for me the process seems more essential here than the results.
Can practical design work in itself be considered a 'knowledge contribution'?
In my opinion, yes. From what I have understood from these papers, practical design work is specifically a process which always results as increased level of knowledge. In order to do practical design work one has to examine the subject and prepare the conditions for empirical study, which in itself is already very broadening. For example, in the name of preparing proper conditions for his study, Lundström conducted a pre-study, which was very enlightening and resulted as knowledge contribution for the experiments.
Are there any differences in design intentions within a research project, compared to design in general?
Design intentions usually have similar characteristics regardless of the context, so it's a bit tricky task to determine the exact differences. Of course in a research project the aim is very carefully considered and already the research questions narrow down the subject about which the researchers want to gain knowledge, whereas 'design' in general can be whatever from product development to graphic design or brand design.
Is research in tech domains such as these ever replicable? How may we account for aspects such as time/historical setting, skills of the designers, available tools, etc?
After putting some serious thought to this, I strongly believe that these kind of researches are replicable. For me it seems that if they weren't, they weren't considered as reliable scientific knowledge either. One of the biggest requirements for scientific studies is that the same results are possible to be obtained by another researcher – it can not be depended on the person conducting the study or otherwise the research set-up has some serious deficiencies. Time and historical setting of course has its input in the level of knowledge at the time, but I don't see any of these factors (skills, tools) being a problem. In order to repeat the study the other researchers would have to create as creating similar circumstances as possible, and if they succeed doing that (are able to critically evaluate the conditions) the results could be considered reliable. If they differ, there's always room for doubt as well, but I think that after mentioning it on the paper, it can be left for the readers own consideration.
Mostly the difference is about the process, a very carefully and well-designed process of the experiment. In design driven research the process is maybe even more important than the result, since the result is worthless without a properly designed process?