Logo

General Online Research 2011

March 14-16, 2011, Heinrich-Heine University of Düsseldorf

DGOF Logo

Conference Agenda

Overview and details of the sessions of this conference. Please select a date or room to show only sessions at that day or location. Please select a single session for detailed view (with abstracts and downloads if available).

 
Session Overview
Session

WS3: Online Experiments

Time: Monday, 14/Mar/2011: 2:30pm - 5:00pm
Session Chair: Dr. Ulf-Dietrich Reips

Session Abstract

Title

Online Experiments

Duration

2.5 hours

Regular workshop fee

80 Euros

Who should participate?

Researchers and employees of companies who would like to conduct online experiments. The workshop is useful for both newcomers and experienced experimenters. It will contain information about the newest developments.

Content area

International

Language

English. Individual coaching during practice parts will also be available in German.

Topics that will be covered

This workshop will provide you with an up-to-date overview of basic, techniques, methods, tricks, and tools for online experimentation. Using a practical example, you will learn how to conduct online experiments that provide results within hours. For this purpose, the workshop includes a hands-on demonstration of interactive systems for designing Web experiments online, e.g. WEXTOR. You will learn about ways of dealing with issues in experimental design, security, recruitment, sampling, self-selection, multiple submissions, question design, dropout, error estimation, distributed experimentation, data handling, data quality, log file analysis, and new options available in HTML5. Among other "tricks", you will know the warm-up technique, sub-sampling procedures, multiple site entry, ways to check for motivational confounding and when and why the high hurdle technique may work or not.You will learn how to make use of Web services like the free "::web experiment list::", and of analysis tools for subsequent data analysis, such as Scientific LogAnalyzer.

Goals

Learn or review basic knowledge about Internet-based experimenting; learn a number of useful techniques and tricks; learn to avoid pitfalls that may make your experiment useless; create an experiment during the workshop; get to know several tools and how to use them.

Necessary prior knowledge of participants

None

Literature that participants need to read prior to participation

Reips, U.-D. (2002). Standards for Internet-based experimenting.Experimental Psychology, 49, 243-256. [PDF, 124kb: http://personalwebpages.deusto.es/reips/pubs/papers/ExPsyReipsReprint.pdf]

Recommended additional literature

* Joinson, A. N., McKenna, K., Postmes, T., & Reips, U.-D. (Eds.)(2007). The Oxford Handbook of Internet Psychology. Oxford University Press. Reips, U.-D. (2002). Internet-based psychological experimenting: Five dos and five don'ts. Social Science Computer Review, 20 (3), 241-249.

* Reips, U.-D. (2007). The methodology of Internet-based experiments. In A. Joinson, K. McKenna, T. Postmes, & U.-D. Reips (Eds.), The Oxford Handbook of Internet Psychology (pp. 373-390). Oxford University Press. Reips, U.-D., & Bosnjak, M. (Eds.)(2001). Dimensions of Internet Science. Lengerich: Pabst. (http://iscience.deusto.es/archive/reips/dis/).

Tools to try out

* iScience Server: http://iscience.eu

* web experiment list: http://wexlist.net

* WEXTOR: http://wextor.eu

* Scientific LogAnalyzer: http://sclog.eu

About the instructor

Prof. Dr. Ulf-Dietrich Reips (http://iscience.deusto.es/) is an IKERBASQUE research professor at University of Deusto in Bilbao, Spain. He is working on Internet-based research methodologies, in particular Internet-based experimenting, the psychology of the Internet, and cognitive science. In 1994 he founded the Web Experimental Psychology Lab, the first laboratory for conducting real experiments on the World Wide Web, and provides many Web services for researchers via his iScience Server at http://iscience.eu He is one of the founders and long-time board member of DGOF and was the main local organizer of GOR'05. He was elected the first non-US American president-elect of the Society for Computers in Psychology and is founding editor of the International Journal of Internet Science (http://ijis.net, with Uwe Matzat). He has given similar workshops in several European countries as well as in the US (e.g. for the National Science Foundation) and is frequently requested as a consultant. Many of his publications (in English, German, and Spanish, see http://personalwebpages.deusto.es/reips/pubs/publications.html) are widely cited in the field.

Maximum number of participants

30


Presentations

Online Experiments

Ulf-Dietrich Reips1,2

1University of Deusto, Spain; 2IKERBASQUE, Basque Foundation for Science, Spain

Title

Online Experiments

Duration

2.5 hours

Regular workshop fee

80 Euros

Who should participate?

Researchers and employees of companies who would like to conduct online experiments. The workshop is useful for both newcomers and experienced experimenters. It will contain information about the newest developments.

Content area

International

Language

English. Individual coaching during practice parts will also be available in German.

Topics that will be covered

This workshop will provide you with an up-to-date overview of basic, techniques, methods, tricks, and tools for online experimentation. Using a practical example, you will learn how to conduct online experiments that provide results within hours. For this purpose, the workshop includes a hands-on demonstration of interactive systems for designing Web experiments online, e.g. WEXTOR. You will learn about ways of dealing with issues in experimental design, security, recruitment, sampling, self-selection, multiple submissions, question design, dropout, error estimation, distributed experimentation, data handling, data quality, log file analysis, and new options available in HTML5. Among other "tricks", you will know the warm-up technique, sub-sampling procedures, multiple site entry, ways to check for motivational confounding and when and why the high hurdle technique may work or not.You will learn how to make use of Web services like the free "::web experiment list::", and of analysis tools for subsequent data analysis, such as Scientific LogAnalyzer.

Goals

Learn or review basic knowledge about Internet-based experimenting; learn a number of useful techniques and tricks; learn to avoid pitfalls that may make your experiment useless; create an experiment during the workshop; get to know several tools and how to use them.

Necessary prior knowledge of participants

None

Literature that participants need to read prior to participation

Reips, U.-D. (2002). Standards for Internet-based experimenting.Experimental Psychology, 49, 243-256. [PDF, 124kb: http://personalwebpages.deusto.es/reips/pubs/papers/ExPsyReipsReprint.pdf]

Recommended additional literature

  • Joinson, A. N., McKenna, K., Postmes, T., & Reips, U.-D. (Eds.)(2007). The Oxford Handbook of Internet Psychology. Oxford University Press. Reips, U.-D. (2002). Internet-based psychological experimenting: Five dos and five don'ts. Social Science Computer Review, 20 (3), 241-249.
  • Reips, U.-D. (2007). The methodology of Internet-based experiments. In A. Joinson, K. McKenna, T. Postmes, & U.-D. Reips (Eds.), The Oxford Handbook of Internet Psychology (pp. 373-390). Oxford University Press. Reips, U.-D., & Bosnjak, M. (Eds.)(2001). Dimensions of Internet Science. Lengerich: Pabst. (http://iscience.deusto.es/archive/reips/dis/).

Tools to try out:

  • iScience Server: http://iscience.eu
  • web experiment list: http://wexlist.net
  • WEXTOR: http://wextor.eu
  • Scientific LogAnalyzer: http://sclog.eu

About the instructor

Prof. Dr. Ulf-Dietrich Reips (http://iscience.deusto.es/) is an IKERBASQUE research professor at University of Deusto in Bilbao, Spain. He is working on Internet-based research methodologies, in particular Internet-based experimenting, the psychology of the Internet, and cognitive science. In 1994 he founded the Web Experimental Psychology Lab, the first laboratory for conducting real experiments on the World Wide Web, and provides many Web services for researchers via his iScience Server at http://iscience.eu He is one of the founders and long-time board member of DGOF and was the main local organizer of GOR'05. He was elected the first non-US American president-elect of the Society for Computers in Psychology and is founding editor of the International Journal of Internet Science (http://ijis.net, with Uwe Matzat). He has given similar workshops in several European countries as well as in the US (e.g. for the National Science Foundation) and is frequently requested as a consultant. Many of his publications (in English, German, and Spanish, see http://personalwebpages.deusto.es/reips/pubs/publications.html) are widely cited in the field.

Maximum number of participants

30


 
Imprint · Contact Address:
Conference: GOR 2011
Conference Software - ConfTool Pro 2.6.17
© 2001 - 2010 by H. Weinreich, Hamburg, Germany