>
Schedule

Date

Topics

Readings (from Lilja); See also Recommended Readings

Slides

1/22

Introduction; Metrics

Ch 1, 2 (Lilja);

Ch 1, 2, 3 (Jain)

Lec 1

1/29 Summarizing Measured Data Ch 3 (Lilja); Ch 12 (Jain) Lec 2
2/5
Computing Confidence Intervals for Sample Data
Ch 4 (Lilja); Ch 13 (Jain)
Lec 3
2/12
Measuring Performance
Ch 6 (Lilja); Ch 9 (Bryant & O'Halloran)
Lec 4
2/19
Simulation
Ch 10 (Lilja); Ch 24-29 (Jain)
Lec 5
2/26
Hypothesis Testing
Ch 13 (Jain);
Lec 6
2/26
Comparing Alternatives using Sample Data
Ch 5 (Lilja); Ch 13 (Jain)
Lec 7
3/5
Simple Regression Models
Ch 8 (Lilja); Ch 14 (Jain)
Lec 8
3/26
Analysis of Variation (ANOVA)
Ch 6 (Lilja); Ch 20 (Jain)
Lec 9
3/26, 4/2, 4/9
Design of Experiments
Ch 9 (Lilja); Ch 16-19 (Jain)
Lec 10, Lec 11
4/9
Workload Characterization
Ch 6, 27 (Jain)
Lec 12
4/16, 4/23
Queueing Analysis
Ch 30-33 (Jain), Ch 11 (Lilja)
Lec 13
4/23
Guest Lecture: Experimental techniques in Software Engineering: Prof. Jeff Offutt

PDF
4/30
Guest Lecture: Experimental techniques in AI and Machine Learning: Prof. Sean Luke

PDF