Statistics and data analytics2018/19
The course aims at introducing the fundamentals of descriptive statistics, probability and parametric inferential statistics.
Expected results
Students will be able to carry out basic explorative analyses and inferences on datasets, they will know the main probability distributions and will be able to understand statistical analyses conducted by others; moreover, they will know simple methods for the problem of binary classification, and will be able to evaluate their performances. The students will also acquire the fundamental competences for studying more sophisticated techniques for data analysis and data modeling.
News
-
Place and time of the Statistics and data analysis written test of February 7th, 2020
The Statistics and data analytics written test of 7/2 will take place in the classrooms at the first floor of the Computer science department, starting from 9:30. Participants may bring a book and a notebook with them for consultation.
-
Results of the Statistics and data analysis written test of February, 7th 2020, oral test calendar, and public correction
Students enrolled in the Statistics and data analysis test of 7/2 should receive an e-mail message showing their result. The oral tests will take place in the "laboratorio magistrale 5° piano" room of the Computer science Department, according to the following schedule organized by last name initial: Wednesday 12/2 at 15:30 (A-C); Thursday 13/2 at 9:30 (D-F); Friday 14/2 at 14:30 (G-Z). The public correction will take place on Thursday 20/2 at 9:30 in the "laboratorio magistrale 5° piano" room of the Computer science Department. Students with further questions are invited to show up during office hours.
-
Public correction of the Statistics and data analysis written test of Januery, 20th 2020
The public correction of the written test of Statistics and data analysis of 20/1/20 will take place at 10:00 on 4/2 in Lab. Laurea Magistrale 3rd floor. Students with further questions will be able to view their own test.
-
Results of the Statistics and data analysis written test of January, 20th 2020 and oral test calendar
Students enrolled in the Statistics and data analytics test of 20/1 should receive an e-mail message showing their result. The oral tests will take place in the computer science department, according to the following schedule organized by last name initial: 28/1 9:30 sala riunioni 4° piano (A to CA), 29/1 14:30 lab. magistrale 5° piano (CE to F), 30/1 9:30 lab. magistrale 5° piano (G to M), 31/1 9:30 lab. magistrale 5° piano (N to Z).
-
Place and time of the Statistics and data analysis written test of January 20th, 2020
The Statistics and data analytics written test of 20/1 will take place in the classrooms at the first floor of the Computer science department, starting from 13:30. Participants may bring a book and a notebook with them for consultation.
-
Postponement of the written test of Statistics and data analytics of January 2020
The Statistics and data analytics weritten test of January is postponed to Monday 20/1/2020. Time and place will be communicated in proximity of the tests.
-
Public correction of the Statistics and data analysis written test of September, 16th 2019
The public correction of the written test of 16/9/19 will take place at 11:00 on 27/9 in Lab. Laurea Magistrale 5 piano. Students with further questions will be able to view their own test.
-
Results of the Statistics and data analysis written test of September, 16th 2019 and oral test calendar
Students enrolled in the Statistics and data analytics test of 16/9 should receive an e-mail message showing their result. The oral tests will take place in the lab. Laurea magistrale at the 5th floor of the computer science department, according to the following schedule organized by last name initial: from A to C, 24/9 at 9:30; from D to Z, 26/9 at 14:30.
-
Place and time of the Statistics and data analysis written test of September 16th, 2019
The Statistics and data analytics written test of 16/9 will take place in the classrooms at the first floor of the Computer science department, starting from 8:30. Participants may bring a book and a notebook with them for consultation.
-
Public correction of the Statistics and data analysis written test of July, 3rd 2019
The public correction of the written test of 3/7/19 will take place at 10:30 on 18/7 in Lab. Laurea Magistrale 3 piano. Students with further questions will be able to view their own test.
-
Results of the Statistics and data analysis written test of July, 3rd 2019 and oral test calendar
Students enrolled in the Statistics and data analytics test of 3/7 should receive an e-mail message showing their result. The oral tests will take place in the lab. Laurea magistrale at the 5th floor of the computer science department, according to the following schedule organized by last name initial: from A to M, 15/7 at 9:30; from Q to Z, 16/7 at 9:30; from N to P, 17/7 at 9:30.
-
Place and time of the Statistics and data analysis written test of July 3rd, 2019
The Statistics and data analytics written test of 3/7 will take place in the classrooms at the first floor of the Computer science department, starting from 9:00. Participants may bring a book and a notebook with them for consultation.
-
Public correction of the Statistics and data analysis written test of June, 10th 2019
The public correction of the written test of 10/6/19 will take place at 10:00 on 27/6 in Lab. Laurea Magistrale 5 piano. Students with further questions will be able to view their own test.
-
Results of the Statistics and data analysis written test of June, 10th 2019 and oral test calendar
Students enrolled in the Statistics and data analytics test of 10/6 should receive an e-mail message showing their result. The oral tests will take place in the computer science department, according to the following schedule organized by last name initial (not necessarily contiguous): from A to G, 17/6 at 14:00 (meeting room on the 5th floor); M and S, 18/6 at 14:00 (lab. Laurea magistrale 5th floor); P, 21/6 at 14:30 (lab. Laurea magistrale on the 5th floor).
-
Place and time of the Statistics and data analysis written test of June 10th, 2019
The Statistics and data analytics written test of 10/6 will take place in the classrooms at the first floor of the Computer science department, starting from 8:30. Participants may bring a book and a notebook with them for consultation.
-
Postponement of the written test of Statistics and data analytics of July 2019
The Statistics and data analytics weritten test of July is postponed to Wednesday 3/7/2019. Time and place will be communicated in proximity of the tests.
-
Public correction of the Statistics and data analysis written test of February, 12th 2019
The public correction of the written test of 12/2/19 will take place at 10:00 on 5/3 in Lab. Laurea Magistrale 5 piano. Students with further questions will be able to view their own test.
-
Results of the Statistics and data analysis written test of February, 12th 2019 and oral test calendar
Students enrolled in the Statistics and data analytics test of 12/2 should receive an e-mail message showing their result. The oral tests will take place in the Lab. Laurea Magistrale on the 5th floor of the computer science department, according to the following schedule organized by last name initial (not necessarily contiguous): A and D 19/2 at 8:30; B and F 19/2 at 13:30; C and G 20/2 at 8:30; P and R 20/2 at 13:30; L, M, and N 21/2 at 8:30; S, T, and V 21/2 at 13:30.
-
Place and time of the Statistics and data analysis written test of February 12th, 2019
The Statistics and data analytics written test of 12/2 will take place in the classrooms at the first floor of the Computer science department, starting from 8:30. Participants may bring a book and a notebook with them for consultation.
-
Office hours change
Starting Monday 28/01, office hour will be handled via e-mail.
-
Results of the Statistics and data analysis written test of January, 16th 2019, oral test calendar and public correction
Students enrolled in the Statistics and data analytics test of 16/1 should receive an e-mail message showing their result. The oral tests will take place in via Celoria 18, in the Lab. Laurea Magistrale 5 piano at 9:30 on 25/1, 29/1, 30/1, 31/1, and 1/2 and in the Lab. Laurea Magistrale 3 piano at 9:30 on 28/1 as follows. Degree F1X+F49: A/L 25/1, M/Z 28/1. Degree F3X+F9X: A/C 28/1, D/I 29/1, L/M 30/1, N/P 31/1, Q/Z 1/2. The public correction will take place at 10:00 on 4/2 in Lab. Laurea Magistrale 5 piano.
-
Place and time of the Statistics and data analysis written test of January 16th, 2019
The Statistics and data analytics written test of 16/1 will take place in the classroom Gamma of the Computer science department, starting from 8:30.
-
Office hours on December 18th
The office hours of December, 18th are canceled.
-
Classroom change for the Statistics and data analytics course
The Statistics and data analytics lecture of 17/12 will take place in aula Beta.
-
Suspension of lectures and office hours on November 6th and 7th
The classes of November, 6th and 7th are canceled, as well as the office hours of November 6th.
-
Suspension of the Statistics and data analytics lab
The Statistics and data analytics lab of November, 2nd is canceled.
-
Lab lectures for the Statistics and data analytics course
Additional lectures of the laboratory of Statistics and data analysis will start from Friday, october 26th between 10:30 and 13:30 in classroom Gamma in via Celoria 18.
-
Classroom change for the Statistics and data analytics classes
Starting from 22/10, Monday classes will take place in aula Magna of the Department of Computer science. The timetable is unchanged.
-
Office hours for the fall semester
Office hours for the fall semester will be on Tuesday from 16:30 in the teacher's office, starting from 09/10.
-
Use of the interactive lecture notes for the Statistics and data analytics class
The lecture notes are available also in interactive form.
-
Laboratory of the statistics and data analytics class
The starting date of lab lectures will be communicated later on.
Course schedule
Lectures will take place at the educational sector of Città studi, according to the following provisional schedule:
| Day | Hour | Place |
|---|---|---|
| Monday | 10:30 - 12:30 | G21 Aula Magna del Dipartimento di Informatica |
| Tuesday | 9:30 - 12:30 | 301 |
Any change to the schedule will be announced in class and published in paragraph News of this page. There will be additional, non-compulsory, lab lectures each Friday, starting mid-october. The starting date will be communicated later on.
Office hours
By appointment, room 5015 of the Computer Science Department.
It is possible contact the teacher by e-mail, taking care to read in advance the guide prepared by Prof. Sebastiano Vigna and clearly specifying in the message the course name and the academic year. In particular, students are encouraged to always use their academic address (i.e. based on the domain studenti.unimi.it) signing with name and student ID number and recalling that the response time may vary depending on the teacher commitments.
Course material
The parts on descriptive statistics are taken from the first three chapters of the textbook Ross, Introductory statistics, Academic press, 2010, ISBN 9780123743886 (marked by PS in the lectures calendar).
The remaining part course is mainly based on the following textbook: Ross, S., Introduction to Probability and Statistics for Engineers and Scientists, Academic press, 2014, ISBN 978-0-12-394811-3 (marked by RPS in the lectures calendar).
Some lecture notes for topics not covered by the textbooks are available through a github repository, as well as in a form directly executable in a Web browser.
Syllabus
The course explains the topics listed in the lecture calendar.
Lectures calendar
| Lecture | Date | Topic | Material |
|---|---|---|---|
| L01 | 02/10/2018 | Introduction to python. | |
| L02 | 08/10/2018 | Introduction to statistics. Centrality indices. |
|
| L03 | 09/10/2018 | Sample variance. Pandas. | |
| L04 | 15/10/2018 | Scatter plots and sample correlation coefficient. |
|
| L05 | 16/10/2018 | Pareto charts; joined and marginal frequences; quantiles, box plots and QQ plots. | |
| L06 | 22/10/2018 | Heterogeneity indices. Decision trees. Concentration indices. | |
| L07 | 23/10/2018 | ROC curves. Data transformations. Analysis of variance. | |
| L08 | 29/10/2018 | Combinatorics. Bases of set theory. |
|
| L09 | 30/10/2018 | Probability: axioms and elementary theorems. Equiprobable spaces. Conditional probability. |
|
| L10 | 05/11/2018 | Law of total probability and Bayes' theorem. |
|
| L11 | 12/11/2018 | Naive Bayes classifiers. Independence of events. | |
| L12 | 13/11/2018 | Discrete random variables. Expected value. |
|
| L13 | 19/11/2018 | Variance. Multivariate random variables. Independence of random variables. |
|
| L14 | 20/11/2018 | Multivariate random variables. Covariance and correlation between random variables. Continuous random variables. |
|
| L15 | 26/11/2018 | Continuous random variables. Markov and Tchebyshev inequalities. Bernoulli distirbutions. |
|
| L16 | 27/11/2018 | Binomial, discrete uniform, and geometric distributions. |
|
| L17 | 03/12/2018 | Geometric and Poisson distributions. |
|
| L18 | 04/12/2018 | Hypergeometric, continuous uniform and exponential distributions. |
|
| L19 | 10/12/2018 | Exponential and Gaussian distribution. |
|
| L20 | 11/12/2018 | Gaussian distribution and central limit theorem. |
|
| L21 | 17/12/2018 | Random sample and point estimation. Sample mean. Unbiased estimators. |
|
| L22 | 18/12/2018 | Mean squared error and consistent estimators. Sample variance and computation of sample size. |
|
| L23 | 07/01/2019 | Computation of sample size. Poisson process. |
|
| L24 | 08/01/2019 | Exercises. |
Exam modalities
Exam sessions
| Session | Date |
|---|---|
| January | 16/01/2019 |
| February | 12/02/2019 |
| June | 10/06/2019 |
| July | 03/07/2019 |
| September | 16/09/2019 |
| January | 16/01/2020 |