Indian Institute of Technology Bombay

Experimental Research And Impact Evaluation: Theory, Demonstration & Real Time Application In The Age Of AI: Batch 2

Indian Institute of Technology Bombay

School of Management

About Programme

The course – “Experimental Research and Impact Evaluation: Theory, Demonstration & Real Time Application in the age of AI” has quietly become essential, and not optional. Because: 1) Businesses, Firms, Governments and Organizations no longer ask “Did things improve?”; they ask “Did this intervention cause the improvement—and was it worth the cost?”. Experimental and quasi-experimental methods such as, Randomized Controlled Trials (RCTs), Difference-in-Differences, Regression Discontinuity, Instrumental Variables etc. are now the gold standard for answering causal questions. 2) Without this training, learners - Confuse correlation with causation; Make costly policy or product decisions; Misinterpret AI-generated insights. In the age of AI - AI can: Clean data; Run regressions; Suggest models; Generate insights in seconds; But AI cannot automatically: Define counterfactuals; Detect selection bias; Design valid experiments; Ensure ethical inference. Impact evaluation is the “steering wheel” of any causal research including AI-driven. 3) “Real-time” decisions can’t wait for post-mortem studies. 4) Field reality ≠ textbook assumptions. 5) It imparts skills, not narrow tools. 6) Ethics and accountability matter more in the AI era. Finally, “This course equips learners and practitioners through theory, demonstration and replication to design, evaluate, and improve real-world interventions using rigorous causal methods—while responsibly leveraging AI for faster, smarter, and more ethical decision-making.”

Programme Content

The course will broadly be divided into the following modules: Module 1): Introduction to Experimental Research and Causal Thinking Introduction to experimental research and impact evaluation; formulation of research and policy questions in terms of causal effects, clearly distinguishing correlation from causation. Module 2): Bias & Validity (Identify, diagnose, and mitigate selection bias, confounding, spillovers, and threats to internal and external validity) - Hawthorne effect; demand characteristics; demand effect; external validity; internal validity; biases history, selection, maturation, mortality, instrument etc. Module 3): Experimental Designs (Design and justify experimental and quasi-experimental evaluations (RCTs, DiD, RDD, IV) appropriate to real-world constraints) - True designs and quasi designs Pre test post test control; post test control; combinations and factorial designs; regression discontinuity and more. Module 4): AI-Augmented Evaluation - Use of AI and data tools responsibly to supportnot replacecausal reasoning, including model selection, diagnostics, and interpretation. Module 5): Real-Time Demonstration and Evaluation Real time demonstration will be given by replicating one true experimental study (design) (RCT) and one quasi experimental study (design) (using difference in difference); The following papers will mostly be replicated*: Sukhtankar, Sandip. 2017. "Replications in Development Economics." American Economic Review, 107 (5): 3236. Biswas, S., & Das, U. (2022). Adding fuel to human capital: Exploring the educational effects of cooking fuel choice from rural India. Energy Economics, 105, 105744. (*The participants need to have STATA and their own desktop/laptop to work parallelly during demonstration/replication). Participants will acquire experimental research skills through two real cases. Module 6): Ethics in Experimental Research - Apply ethical principles in experimentation, including consent, debriefing, potential harm, rights, transparency, and accountability etc.

Programme Benefits

HANDS ON FACILITY:
Real-Time Demonstration and Evaluation – Real time demonstration will be given by replicating one true experimental study (design) (RCT) and one quasi experimental study (design) (using difference in difference); the following papers will mostly be replicated*: Sukhtankar, Sandip. 2017. "Replications in Development Economics." American Economic Review, 107 (5): 32–36. Biswas, S., & Das, U. (2022). Adding fuel to human capital: Exploring the educational effects of cooking fuel choice from rural India. Energy Economics, 105, 105744. (*The participants need to have STATA and their own desktop/laptop to work parallelly during demonstration/replication).

Testimonials

"undefined"

Anonymous

Other programs in this subject area you might find useful

Same topic, Similar duration - Broader exploration across all institutes

Contact us for the further details

Speak with an Advisor

  1. Pedagogy (case method, experiential learning, coaching, simulations)
  2. Target Audience
  3. Programme Objective

Prashansa Uttam

Programme Advisor

+91 9403890085contact@echomind.oneMon – Fri, 9am – 5pm IST

Indian Institute of Technology Bombay

Executive Education Office

NA
NA
NA
https://www.iitb.ac.in
Mumbai, India

Tell us about your program enquiry

Fill out the form below and our team will get back to you within 24 hours.

Experimental Research And Impact Evaluation: Theory, Demonstration & Real Time Application In The Age Of AI: Batch 2 | IIT Bombay