Statistics and data analysis2017/18
The course aims at introducing the fundamentals of descriptive statistics, probability and parametric inferential statistics.
Expected results
Students will be able to carry out basic explorative analyses and inferences on datasets, they will know the main probability distributions and will be able to understand statistical analyses conducted by others; moreover, they will know simple methods for the problem of binary classification, and will be able to evaluate their performances. The students will also acquire the fundamental competences for studying more sophisticated techniques for data analysis and data modeling.
News
-
Correction of written tests of Statistics and data analysis
At 10:30 of Thursday, 04/10 in aula 305 there will be a public correction of the written tests of 20/09.
-
Results of the Statistics and data analysis written test of September, 20th 2018 and oral test calendar
Students enrolled in the Statistics and data analysis test of 20/9 should receive within tomorrow an e-mail message showing their result. The oral tests will take place in aula G27 in via Golgi on 27/9 at 9:30 and on 28/9 at 14:30). The date of correction of the written test will be communicated later on.
-
Place and time of the Statistics and data analysis written test of September 20th, 2018
The Statistics and data analysis written test of 20/9 will take place in via Celoria in aula 307 (Zanaboni) and aula 309 (Malchiodi), starting from 14:30.
Earlier news (20)
-
Schedule change for the Statistics and data analysis exam session of September
The Statistics and data analysis written test of September session is resheduled from 14/09 to 20/09.
-
Correction of written tests of Statistics and data analysis
At 10:30 of Monday, 23/07 in the sala lauree of Via Comelico there will be a public correction of the written tests of 2/7.
-
Results of the Statistics and data analysis written test of July, 2nd 2018 and oral test calendar
Students enrolled in the Statistics and data analysis test of 2/7 should receive within tomorrow an e-mail message showing their result. The oral tests will take place in via Comelico on 12/7 (aula 5, 9:30), 13/7 (aula 6, 9:30 and 14:30), 16/7 (aula 6, 14:30), and 17/7 (aula 4, 9:30).
-
Place and time of the Statistics and data analysis written test of July 2nd, 2018
The Statistics and data analysis written test of 2/7 will take place in via Comelico 39 in aula tau, starting from 14:30.
-
Correction of written tests of Statistics and data analysis
At 10:30 of Thursday, 28/06 in the sala riunioni on the first floor of Via Comelico there will be a public correction of the written tests of 13/6.
-
Results of the Statistics and data analysis written test of June, 13th 2018 and oral test calendar
Students enrolled in the Statistics and data analysis test of 13/6 should receive within tomorrow an e-mail message showing their result. The oral tests will take place on 25/6 (students F1X) and on 27/6 (other students) in aula 6 in via Comelico at 10:30.
-
Place and time of the Statistics and data analysis written test of June 13th, 2018
The Statistics and data analysis written test of 13/6 will take place in via Comelico 39 in aula sigma, starting from 9:30.
-
Office hours canceled
Starting wednesday 03/14, regular office hour are canceled; students can arrange an appointment via e-mail.
-
Vision of written tests of Statistics and data analysis
At 9:30 of Monday, 26/02 in the sala riunioni on the second floor of Via Comelico it will be possible to view the written tests of 7/2.
-
Results of the Statistics and data analysis written test of February, 7th 2018 and oral test calendar
Students enrolled in the Statistics and data analysis test of 7/2 should receive within tomorrow an e-mail message showing their result. The oral tests will take place on 23/2 in aula 6 in via Comelico at 9:30.
-
Place and time of the Statistics and data analysis written test of February 7th, 2018
The Statistics and data analysis written test of 7/2 will take place in via Celoria 20 in aula 307, starting from 9:30.
-
Vision of written tests of Statistics and data analysis
At 9:30 of Tuesday, 06/02 in the sala riunioni on the second floor of Via Comelico it will be possible to view the written tests of 24/1.
-
Results of the Statistics and data analysis written test of January, 24th 2018 and oral test calendar
Students enrolled in the Statistics and data analysis test of 24/1 should receive within tomorrow an e-mail message showing their result. The oral tests will take place in via Comelico on 31/1 (9:30-18:30), 1/2 (15:30-18:30), 2/2 (9:30-12:30), and 5/2 (9:30-12:30)
-
Place and time of the Statistics and data analysis written test of January 24th, 2018
The Statistics and data analysis written test of 24/1 will take place in via Comelico 39 in aula Sigma, starting from 9:30.
-
Schedule change for the Statistics and data analysis course
The last class of Statistics and data analysis is moved from Dec 18th to Jan 8th.
-
Lab lectures for the Statistics and data analysis course
Additional lectures of the laboratory of Statistics and data analysis will start from Friday, october 20th.
-
Programming language for the Statistics and data analysis course
Computer science students who are not enrolled in the second year will have the choice between R and python as language to be used during the written test. Among those students, who has already followed a R laboratory or have already studied R, it is advisable to stay on R; instead, students not yet haviing studied any language for data analysis are advised to start directly with python. For the students of the other degrees, the R language remains the only option.
-
Use of the interactive lecture notes
The lecture notes are available also in interactive form.
-
Laboratory of the statistics and data analysis class
The starting date of lab lectures will be communicated later on.
-
Office hours of Jan 9th canceled
The office hour of Jan 9th are canceled; students can arrange an appointment via e-mail.
Course schedule
Lectures will take place at the educational sector of Città studi, according to the following provisional schedule:
| Day | Hour | Place |
|---|---|---|
| Monday | 10:30 - 12:30 | V3 |
| Tuesday | 9:30 - 12:30 | V3 |
Any change to the schedule will be announced in class and published in paragraph News of this page. There will be additional, non-compulsory, lab lectures each Friday, starting mid-october. The starting date will be communicated later on.
Office hours
By appointment, room 5015 of the Computer Science Department.
It is possible contact the teacher by e-mail, taking care to read in advance the guide prepared by Prof. Sebastiano Vigna and clearly specifying in the message the course name and the academic year. In particular, students are encouraged to always use their academic address (i.e. based on the domain studenti.unimi.it) signing with name and student ID number and recalling that the response time may vary depending on the teacher commitments.
Course material
The parts on descriptive statistics are taken from the first three chapters of the textbook Ross, Introductory statistics, Academic press, 2010, ISBN 9780123743886 (marked by PS in the lectures calendar).
The remaining part course is mainly based on the following textbook: Ross, S., Introduction to Probability and Statistics for Engineers and Scientists, Academic press, 2014, ISBN 978-0-12-394811-3 (marked by RPS in the lectures calendar).
Some lecture notes for topics not covered by the textbooks are available.
Syllabus
The course explains the topics listed in the lecture calendar.
Lectures calendar
| Lecture | Date | Topic | Material |
|---|---|---|---|
| L01 | 26/09/2017 | Introduction to python. | |
| L02 | 02/10/2017 | Introduction to statistics. Centrality indices. |
|
| L03 | 03/10/2017 | Sample variance. Pandas. | |
| L04 | 09/10/2017 | Scatter plots and sample correlation coefficient. |
|
| L05 | 10/10/2017 | Pareto charts; joined and marginal frequences; quantiles, box plots and QQ plots. | |
| L06 | 16/10/2017 | Heterogeneity indices. Decision trees. Concentration indices. | |
| L07 | 17/10/2017 | ROC curves. Data transformations. Analysis of variance. | |
| L08 | 23/10/2017 | Combinatorics. Bases of set theory. |
|
| L09 | 24/10/2017 | Probability: axioms and elementary theorems. Equiprobable spaces. Conditional probability. |
|
| L10 | 30/10/2017 | Law of total probability and Bayes' theorem. |
|
| L11 | 31/10/2017 | Naive Bayes classifiers. Independence of events. | |
| L12 | 06/11/2017 | Discrete random variables. |
|
| L13 | 07/11/2017 | Expected value. Variance. |
|
| L14 | 13/11/2017 | Multivariate random variables. Independence of random variables. |
|
| L15 | 14/11/2017 | Covariance and correlation between random variables. Continuous random variables. Markov inequality. |
|
| L16 | 20/11/2017 | Bernoulli and binomial distributions. |
|
| L17 | 21/11/2017 | Discrete uniform and geometric distributions. | |
| L18 | 27/11/2017 | Poisson distribution. |
|
| L19 | 28/11/2017 | Hypergeometric, continuous uniform and exponential distributions. |
|
| L20 | 04/12/2017 | Gaussian distribution. | |
| L21 | 05/12/2017 | Random sample and point estimation. Sample mean. Central limit theorem. |
|
| L22 | 11/12/2017 | Unbiased estimator. Mean squared error and consistent estimator. |
|
| L23 | 12/12/2017 | Application of the central limit theorem: sample variance and computation of sample size. Poisson process. |
|
| L24 | 08/01/2018 | Exercises |
Exam modalities
Exam sessions
| Session | Date |
|---|---|
| January | 24/01/2018 |
| February | 07/02/2018 |
| June | 13/06/2018 |
| July | 02/07/2018 |
| September | 14/09/2018 20/09/2018 |
| January | 16/01/2019 |
