English   Danish

2022/2023  KAN-CPSYO1802U  Experimental methods

English Title
Experimental methods

Course information
Language English
Course ECTS 7.5 ECTS
Type Mandatory
Level Full Degree Master
Duration One Semester
Start time of the course Autumn
Timetable Course schedule will be posted at calendar.cbs.dk
Study board
Study Board for BSc/MSc in Business Administration and Psychology, MSc
Course coordinator
  • Georgios Halkias - Department of Marketing (Marketing)
Main academic disciplines
  • Methodology and philosophy of science
  • Statistics and quantitative methods
Teaching methods
  • Blended learning
Last updated on 30-06-2022

Relevant links
Learning objectives
The overall learning objective of the course is to equip students with the knowledge and skills necessary to identify, design, and implement rigorous experiments to investigate causal hypotheses. Thus, central to the course is the idea of causal reasoning as well as the ability to (a) transform vague research questions into specific cause-and-effect relationships and (b) devise an appropriate methodological architecture to conduct experimental studies that test these relationships in a valid and reliable way.

On completion of this course, students will be able to:
  • Describe the logic of causality and critically evaluate causal claims made in academic and popular media.
  • Apply alternative experimental designs to test causal research hypotheses.
  • Utilize different techniques and operationalizations of experimental procedures and elements.
  • Recognize the relative strengths and weaknesses of different methodological approaches.
  • Assess the external and internal validity of experimental studies.
  • Discern questionable research practices and evaluate the interpretation, generalizability and reproducibility of experimental results.
  • Explain the role of statistical testing in experimental studies and describe how basic statistical concepts apply to empirical experimental research.
Examination
Eksperimentel metode:
Exam ECTS 7,5
Examination form Home assignment - written product
Individual or group exam Individual exam
Size of written product Max. 10 pages
(assignments may reasonably be shorter but - with all relevant material considered- should not exceed the maximum page length)
Assignment type Written assignment
Duration Written product to be submitted on specified date and time.
Grading scale 7-point grading scale
Examiner(s) One internal examiner
Exam period Winter
Make-up exam/re-exam
Same examination form as the ordinary exam
Description of the exam procedure

Students have to identify a novel research idea/phenomenon within a subject area that is relevant to “business and psychology” (e.g., marketing, consumer behavior, advertising, behavioral economics, creativity, innovation, organizational psychology, etc.), formulate key causal hypotheses, and propose, present, and justify the complete methodological architecture of an experimental study designed to address these hypotheses.

 

The assignment should start with the motivation behind the overall research idea, along with a justification of the main research hypotheses, and then focus on developing a detailed methodological plan for an experiment (or more) that can test the hypotheses in a valid and reliable way. The latter should address all aspects necessary to conduct the experiment (e.g., design, participants, stimuli and experimental material, pretests, manipulations, instructions, dependent measures, procedure, and so on) and should also consider real-life practicalities and the feasibility of implementation (e.g., resources and other constraints). All decisions regarding the methodological approaches adopted need to be justified and properly backed-up. The proposed study should be pre-registered and the pre-registration plan should be part of the assignment.

 

The assignment should conclude with a critical reflection on the specifications of the proposed experimental methodology, identifying strengths, weaknesses, and potential threats in establishing internal and external validity.

 

Students are highly encouraged to read several relevant articles for inspiration. However, the assignment should deal with an idea/methodology that has not been employed in existing published research. If similarities exist (which to a reasonable extent may be expected), it should be clear how the approach followed in the assignment differs by drawing on objective criteria.

 

Overall assessment is based on identifying a meaningful causal claim and providing a sound, robust and, feasible methodological plan, which relies on justified and well thought experimental design options and which critically reflects on the methodological and analytical consequences of these options.
Course content, structure and pedagogical approach

The topics covered throughout the course include, among others, different scientific paradigms, causal reasoning and cause-and-effect relationships, elements of experimentation and alternative designs, validity and reliability, core principles of statistically analyzing experimental data, as well as questionable research practices, ethics, and caveats associated with experimental studies.

 

The course places emphasis on critically understanding the mechanics of research design and methods, so the lectures do not have a strict normative nature.

 

1. Introduction to the content and structure of the course

 

2. Philosophy of Science and Research Paradigms

 

3. Causal Inference and Experimental Research

 

4. Fundamental Elements of Experimentation

 

5. Experimental Designs

 

6. Validity and Reliability | Interactive Class

 

7. Applied Research: Behind the scenes | Interactive Class

 

8. Research and Statistical Inference

 

9. Analyzing Experimental Data I

 

10. Analyzing Experimental Data II

 

11. Research Ethics: Replicability, Reproducibility, and Questionable Research Practices (QRPs)

 

12. Things you need to know (and never forget) about Experimental Research

Description of the teaching methods
The course follows a blended learning approach, combining online and face-to-face sessions. Lectures involve in-class discussions, workshops, and guest talks, while they utilize multiple hands-on examples of published research and cases to illustrate the ideas and concepts involved therein in a direct, applied way.
Feedback during the teaching period
In all sessions students are highly encouraged to actively participate, ask questions, and raise issues relevant to the course. Among other things, such interaction offers the possibility to make relevant adjustments throughout the semester making sure that the learning objectives are delivered effectively.

In addition, throughout the semester we will hold interactive session (in-class or online), dedicated to problem-solving, further clarifications, and additional feedback with regard to the course’s content and assignment. In these sessions, students can voluntarily present their ideas and receive feedback both from the professor and their peers. Overall, such interactive activities provide additional time and space for inquiries and allow students to reflect on the course’s material from different angles.
Student workload
Teaching 36 hours
Preparation 153 hours
Examination 65 hours
Expected literature

The course draws on recent (as well as classic) papers and online resources aiming to incorporate the best and most up-to-date practices in the field of experimental methods. As such, the study material is primarily guided by the lecture slides and lecture notes (if available) as well as a selection of articles and online resources that will be provided to the students. The content of the course is also nicely covered by the following books:

 

Shadish, William R., Cook, Thomas D. & Campbell, Donald T. (2002). Experimental and Quasi-Experimental Designs for Generalized Causal Inference. New York: Houghton Mifflin.

 

Shaughnessy, John J., Zechmeister, Eugene B. & Jeanne S. Zechmeister. (2012) Research methods in psychology (9th ed.), McGraw-Hill.

 

Price, Paul C., Jhangiani, Rajiv S. & Chant A. Chiang. (2015). Research Methods in Psychology, 2nd Canadian Edition [licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0 License].
Last updated on 30-06-2022