View source for Data Analysis for Smart Agriculture

__FORCETOC__

The following are last-minute news you should be aware of ;-)
 * 16/09/2024: The course starts today!

<!--  * 18/10/2023: Teams have been finalized, you can find them in the [https://docs.google.com/spreadsheets/d/17jdIeMhLs-hiuVCFBbwjaOl3vVRmk_UvqhjPAkycbGI/edit?usp=sharing document to book project clinics] 
 * 15/09/2023: The course starts today!!!
* 23/11/2022: Uploaded slides on Data Valorization
 * 15/11/2022: Update to the calendar (2 classes) and link to the [https://docs.google.com/spreadsheets/d/1q49bB99ayjBVYVc0pBsWgIZpZAxX_D-EIiMOpUVQcQ4/edit?usp=sharing project clinic booking] 
 * 03/11/2022: Last set of slides (clustering) have been published 
 * 19/10/2022: Groups have been sent to students + added a second date for project evaluation
 * 11/10/2022: Change in the time of 14/10/2022 lecture!!
 * 09/10/2022: New slides published and links to datasets
 * 30/09/2022: Detailed final calendar published ... minor changes are expected 
 * 22/09/2022: on Friday 23/09/2022 there will be no lecture
 * 12/09/2022: the course starts today!!!
-->

==Course Aim & Organization==


===Teachers===

The course is composed of a blending of lectures and labs by the course teachers and a teaching assistant.

* [http://www.deib.polimi.it/ita/personale/dettagli/267262 Matteo Matteucci]: the teacher from DEIB 
* [https://www.som.polimi.it/professor/filippo-maria-renga/ Filippo Renga]: the teacher from DIG
* [https://www.deib.polimi.it/ita/personale/dettagli/1199418 Mirko Usuelli]: the teaching assistant

===Course Program===


===Detailed course schedule===

Lecture are:
 * On Monday, in room 25.1.5, starts at 16:30 ends at 18:00
 * On Friday, in room 7.1.2, starts at 14:30 ends at 16:00

A detailed schedule follows:

{| border="1" align="center" style="text-align:center;"
|-
|Date || Day || Time || Room || Teacher || Topic
|-
|16/09/2024 || Monday || 16:30-18:00 || 25.1.5 || ALL || [https://politecnicomilano.webex.com/politecnicomilano/ldr.php?RCID=fb4d321bc2e233c3f022d35881f903bf Course Intro]
|-
|20/09/2024 || Friday || 14:30-16:00 || 7.1.2 || Filippo Renga || [https://politecnicomilano.webex.com/politecnicomilano/ldr.php?RCID=d43307bf17ad62febc945f1a2f775edd Principle of Data Strategy]
|-
|23/09/2024 || Monday || 16:30-18:00 || 25.1.5 || Filippo Renga|| [https://politecnicomilano.webex.com/politecnicomilano/ldr.php?RCID=9ed007711a59991ab4ae5819f879cf8b Data Valorization]
|-
|27/09/2024 || Friday || 14:30-16:00 || 7.1.2 || Filippo Renga|| Introduction to projects and project groups
|-
|30/09/2024 || Monday || --- || --- || Students|| Use case search ...
|-
|04/10/2024 || Friday || 14:30-16:00 || 7.1.2 || Mirko Usuelli|| [https://politecnicomilano.webex.com/webappng/sites/politecnicomilano/recording/047e8acd0f5243b1bff38995bb782ec2/playback Intro to python]
|-
|07/10/2024 || Monday || 16:30-18:00 || 25.1.5 || Mirko Usuelli|| [Intro to Panda and Data Cleaning]
|-
|11/10/2024 || Friday || 14:30-16:00 || 7.1.2 || Mirko Usuelli|| Data Clinic and Project Clinic
|-
|14/10/2024 || Monday || --- || --- || Students|| Use case search ...
|-
|18/10/2024 || Friday || --- || --- || Students|| Use case search ...
|-
|21/10/2024 || Monday || 16:30-18:00 || 25.1.5 || Matteo Matteucci|| Flipped Class on Regression and Data Sources
|-
|25/10/2024 || Friday || 14:30-16:00 || 7.1.2 || Mirko Usuelli|| [Regression with Scikit]
|-
|28/10/2024 || Monday || 16:30-18:00 || 25.1.5 || Matteo Matteucci + Filippo Renga|| Project presentations
|-
|01/11/2024 || Friday || --- || --- || Students|| Use case search ...
|-
|04/11/2024 || Monday || 16:30-18:00 || 25.1.5 || Matteo Matteucci|| Flipped Class on Classification
|-
|08/11/2024 || Friday || 14:30-16:00 || 7.1.2 || Filippo Renga|| SAL on Data Sources
|-
|11/11/2024 || Monday || --- || --- || Students|| Use case search ...
|-
|15/11/2024 || Friday || 14:30-16:00 || 7.1.2 || Mirko Usuelli|| [Classification with Scikit]
|-
|18/11/2024 || Monday || 16:30-18:00 || 25.1.5 || Matteo Matteucci|| Flipped Class on Clustering
|-
|22/11/2024 || Friday || 14:30-16:00 || 7.1.2 || Mirko Usuelli || [Classification with Clustering]
|-
|25/11/2024 || Monday || 16:30-18:00 || 25.1.5 || Matteo Matteucci + Filippo Renga || Project clinic
|-
|29/11/2024 || Friday || 14:30-16:00 || 7.1.2 || Matteo Matteucci || SAL on Processing
|-
|02/12/2024 || Monday || 16:30-18:00 || 25.1.5 || Matteo Matteucci || Project clinic
|-
|06/12/2024 || Friday || 14:30-16:00 || 7.1.2 || Filippo Renga + Mirko Usuelli ||  Project clinic
|-
|09/12/2024 || Monday || 16:30-18:00 || 25.1.5 || Matteo Matteucci || Project clinic
|-
|13/12/2024 || Friday || 14:30-16:00 || 7.1.2 || Filippo Renga + Mirko Usuelli || SAL on Data Value
|-
|16/12/2024 || Monday || 16:30-18:00 || 25.1.5 || Matteo Matteucci || Project clinic
|-
|20/12/2024 || Friday || 14:30-16:00 || 7.1.2 || Matteo Matteucci + Filippo Renga + Mirko Usuelli || Exam
|-
|}


<!--
{| border="1" align="center" style="text-align:center;"
|-
|Date || Day || Time || Room || Teacher || Topic
|-
|15/09/2023 || Friday || 14:30-16:00 || 7.1.2 || ALL || [https://politecnicomilano.webex.com/politecnicomilano/ldr.php?RCID=cbb9ae05c466fa1579c850c51b4863fd Course Intro]
|-
|18/09/2023 || Monday || 16:30-18:00 || 25.1.1 || Filippo Renga || [https://politecnicomilano.webex.com/politecnicomilano/ldr.php?RCID=a5f7a23f9698e91c2a734e63eb8f676f Principle of Data Strategy]
|-
|22/09/2023 || Friday || 14:30-16:00 || 7.1.2 || Filippo Renga || [https://politecnicomilano.webex.com/politecnicomilano/ldr.php?RCID=79fc42fa1072dadd3a882dbab7187bdc Smart Agrifood Scenario]
|-
|25/09/2023 || Monday || 16:30-18:00 || 25.1.1 || Filippo Renga || [https://politecnicomilano.webex.com/politecnicomilano/ldr.php?RCID=9ed007711a59991ab4ae5819f879cf8b Lab of Data Strategy]
|-
|29/09/2023 || Friday || 14:30-16:00 || 7.1.2 || ALL || [Preliminary Project Brainstorming]
|-
|02/10/2023 || Monday || 16:30-18:00 || 25.1.1 || Matteo Matteucci|| [https://politecnicomilano.webex.com/politecnicomilano/ldr.php?RCID=26bb6b514ecbcda4cccc2559479270bc Intro to Data Analysis (last year recording)]
|-
|06/10/2023 || Friday || 14:30-16:00 || 7.1.2 || Riccardo Bertoglio|| [Python and NumPy]
|-
|09/10/2023 || Monday || 16:30-18:00 || 25.1.1 || Riccardo Bertoglio|| [Pandas]
|-
|13/10/2023 || Friday || 14:30-16:00 || 7.1.2 || Matteo Matteucci|| [https://politecnicomilano.webex.com/politecnicomilano/ldr.php?RCID=a1d2fc80ae2e7513eafe6e7b4af36f77 ML Intro and Linear Regression]
|-
|16/10/2023 || Monday || 16:30-18:00 || 25.1.1 || Matteo Matteucci|| [https://politecnicomilano.webex.com/politecnicomilano/ldr.php?RCID=b2cc12a4ef5349e36cfc1f9e97364dd7 Regression]
|-
|20/10/2023 || Friday || 14:30-16:00 || 7.1.2 || Riccardo Bertoglio|| [Lab on Regression]
|-
|23/10/2023 || Monday || 16:30-18:00 || 25.1.1 || Matteo Matteucci|| [https://politecnicomilano.webex.com/politecnicomilano/ldr.php?RCID=f09c394c5e4eee60a2633da5e4d6676c Classification]
|-
|27/10/2023 || Friday || 14:30-16:00 || 7.1.2 || Riccardo Bertoglio|| [Lab on Classification]
|-
|30/10/2023 || Monday || 16:30-18:00 || 25.1.1 || Filippo Renga|| [Data Valorization]
|-
|03/11/2023 || Friday || 14:30-16:00 || 7.1.2 || -- || -- No Lecture --
|-
|06/11/2023 || Monday || 16:30-18:00 || 25.1.1 || -- || -- No Lecture --
|-
|10/11/2023 || Friday || 14:30-16:00 || 7.1.2 || ALL || [Project Brainstorming]
|-
|13/11/2023 || Monday || 16:30-18:00 || 25.1.1 || Matteo Matteucci || [https://politecnicomilano.webex.com/politecnicomilano/ldr.php?RCID=5aefeb325b76a7673f4339d107527c70 Clustering]
|-
|17/11/2023 || Friday || 14:30-16:00 || 7.1.2 || Riccardo Bertoglio || [Lab on Clustering]
|-
|20/11/2023 || Monday || 16:30-18:00 || 25.1.1 || Matteo Matteucci || [Project Clinic]
|-
|24/11/2023 || Friday || 14:30-16:00 || 7.1.2 || Filippo Renga || [Project Clinic]
|-
|27/11/2023 || Monday || 16:30-18:00 || 25.1.1 || Filippo Renga || [Project Clinic]
|-
|01/12/2023 || Friday || 14:30-16:00 || 7.1.2 || Matteo Matteucci || [Project Clinic]
|-
|04/12/2023 || Monday || 16:30-18:00 || 25.1.1 || Matteo Matteucci || [Project Clinic]
|-
|08/12/2023 || Friday || 14:30-16:00 || 7.1.2 || -- || -- No Lecture --
|-
|11/12/2023 || Monday || 16:30-18:00 || 25.1.1 || Riccardo Bertoglio || [Project Clinic]
|-
|15/12/2023 || Friday || 14:30-16:00 || 7.1.2 || Matteo Matteucci + Filippo Renga || [Project Checkpoint]
|-
|18/12/2023 || Monday || 16:30-18:00 || 25.1.1 || ALL || [Project Evaluation]
|-
|22/12/2023 || Friday || 14:30-16:00 || 7.1.2 || ALL || [(Optional) Project Evaluation]
|-
|}

{| border="1" align="center" style="text-align:center;"
|-
|Date || Day || Time || Room || Teacher || Topic
|-
|12/09/2022 || Monday || 17:30-19:00 || 25.1.1 || Matteo Matteucci || [https://politecnicomilano.webex.com/politecnicomilano/ldr.php?RCID=2a07ce102d915e520f7db9cc87fe4979 Course Intro]
|-
|16/09/2022 || Friday || 14:30-16:00 || 25.1.4 || Filippo Renga || [https://politecnicomilano.webex.com/recordingservice/sites/politecnicomilano/recording/playback/790937d917ea103bbbfc0050568128aa Smart Agrifood Scenario]
|-
|19/09/2022 || Monday || 16:30-18:00 || 25.1.1 || Filippo Renga || [https://politecnicomilano.webex.com/recordingservice/sites/politecnicomilano/recording/74b17de71a55103badbf00505681283b/playback Principles of Data Strategy]
|-
|23/09/2022 || Friday || 14:30-16:00 || -- || -- || -- No Lecture --
|-
|26/09/2022 || Monday || 16:30-18:00 || 25.1.1 || Filippo Renga || Lab on Data Strategy
|-
|30/09/2022 || Friday || 14:30-16:00 || 25.1.4 || Matteo Matteucci || [https://politecnicomilano.webex.com/politecnicomilano/ldr.php?RCID=26bb6b514ecbcda4cccc2559479270bc Intro to data analysis]
|-
|03/10/2022 || Monday || 16:30-18:00 || 25.1.1 || Riccardo Bertoglio || Python and NumPy
|-
|07/10/2022 || Friday || 14:30-16:00 || 25.1.4 || Riccardo Bertoglio || Pandas
|-
|10/10/2022 || Monday || 16:30-18:00 || 25.1.1 || Matteo Matteucci || [https://politecnicomilano.webex.com/politecnicomilano/ldr.php?RCID=029292c2f3dd4700ac112f80d4f9cc56 Data sources and regression intro]
|-
|14/10/2022 || Friday || 13:30-15:00 || 25.1.4 || Matteo Matteucci || [https://politecnicomilano.webex.com/politecnicomilano/ldr.php?RCID=9eecaf7ca015491bf4afeeebf656d57a Regression]
|-
|17/10/2022 || Monday || 16:30-18:00 || 25.1.1 || Riccardo Bertoglio || Regression lab
|-
|21/10/2022 || Friday || 14:30-16:00 || 25.1.4 || Filippo Renga || [https://politecnicomilano.webex.com/politecnicomilano/ldr.php?RCID=8345ac725f15c67e05d8ef09d4adda20 Data Valorization]
|-
|24/10/2022 || Monday || 16:30-18:00 || 25.1.1 || Matteo Matteucci || [https://politecnicomilano.webex.com/politecnicomilano/ldr.php?RCID=f0f3a91391aa6a195894ca9db741dccd Classification]
|-
|28/10/2022 || Friday || 14:30-16:00 || 25.1.4 || Riccardo Bertoglio || Classification lab
|-
|31/10/2022 || Monday || 16:30-18:00 || 25.1.1 || -- Holidays -- || -- Holidays --
|-
|04/11/2022 || Friday || 14:30-16:00 || 25.1.4 || Matteo Matteucci || [https://politecnicomilano.webex.com/politecnicomilano/ldr.php?RCID=b888b383b300cb3956a54fee042df359 Clustering]
|-
|07/11/2022 || Monday || 16:30-18:00 || 25.1.1 || -- No lecture -- || -- No lecture --
|-
|11/11/2022 || Friday || 14:30-16:00 || 25.1.4 || Riccardo Bertoglio|| Clustering Lab
|-
|14/11/2022 || Monday || 16:30-18:00 || 25.1.1 || Matteo Matteucci + Filippo Renga + Riccardo Bertoglio|| Project brainstorming
|-
|18/11/2022 || Friday || 14:30-16:00 || 25.1.4 || Matteo Matteucci || Project clinic
|-
|21/11/2022 || Monday || 16:30-18:00 || 25.1.1 || Filippo Renga || Project Clinic
|-
|25/11/2022 || Friday || 14:30-16:00 || 25.1.4 || Filippo Renga || Project clinic
|-
|28/11/2022 || Monday || 16:30-18:00 || 25.1.1 || Matteo Matteucci || Project clinic
|-
|02/12/2022 || Friday || 14:30-16:00 || 25.1.4 || Riccardo Bertoglio || Project clinic
|-
|05/12/2022 || Monday || 16:30-18:00 || Sala Seminari N. Schiavoni DEIB (building 20) || Riccardo Bertoglio || Project clinic
|-
|09/12/2022 || Friday || 14:30-16:00 || 25.1.4 || -- Holidays -- || -- Holidays --
|-
|12/12/2022 || Monday || 16:30-18:00 || 25.1.1 || Matteo Matteucci + Filippo Renga || Project Check
|-
|16/12/2022 || Friday || 14:30-16:00 || Sala Seminari N. Schiavoni DEIB (building 20) || Matteo Matteucci + Riccardo Bertoglio || Project clinic
|-
|19/12/2022 || Monday || 16:30-18:00 || 25.1.1 || Matteo Matteucci + Filippo Renga || Project evaluation
|-
|23/12/2022 || Friday || 14:30-16:00 || 25.1.4 || Matteo Matteucci + Filippo Renga || Project evaluation
|-
|11/01/2023 || Wednesday || 15:00-18:00 || 25.1.4 || Matteo Matteucci + Filippo Renga || Project evaluation
|}
-->

===Course Evaluation and Project Clinics===

The course is intended to be a hands-on practical project course, students are expected to face a project "in group".

During project clinics meeting students have the opportunity to work together on the projects and/or to talk with the teachers discussing advancements and follow-ups.

<!--
In this [https://docs.google.com/spreadsheets/d/1q49bB99ayjBVYVc0pBsWgIZpZAxX_D-EIiMOpUVQcQ4/edit?usp=sharing document you can book] a slot to talk with a professor. Please consider we will have 25-30 minutes slots, we expect on average 3 to 4 teams per day. 
-->

In this [https://docs.google.com/spreadsheets/d/17jdIeMhLs-hiuVCFBbwjaOl3vVRmk_UvqhjPAkycbGI/edit?usp=sharing document you can book] a slot to talk with a professor. Please consider we will have 25-30 minutes slots, we expect on average 3 to 4 teams per day. 

You can always write to us directly (keep all teachers cced) in case you need and express meeting and there are no slots available.

===Course Slides===

Here the slides used during classes 
* [[Media:DASA_2024_2025_Course_Intro.pdf |[2024/2025] Course Intro]] by Matteo Matteucci and Filippo Renga
* [[Media:DASA_2024_2025_Data_Strategy.pdf |[2024/2025] Principles of Data Strategy]] by Filippo Renga
* [[Media:DASA_2024_2025_Data_Valorization.pdf |[2024/2025] Data valorization]] by Filippo Renga 
* [[Media:DASA_2024_2025_Projects.pdf |[2024/2025] Introduction to projects]] and [[Media:DASA_2024_2025_Groups.pdf |groups]] by Filippo Renga 

Last year material for flipped classes!!! 
<!-- * [[Media:DASA_2023_2024_SmartAgriFood.pdf |[2023/2024] Smart Agrifood Scenario]] by Filippo Renga -->
<!-- * [[Media:DASA_2023_2024_Projects.pdf |[2023/2024] Introduction to projects]] by Filippo Renga -->
* [[Media:DASA_2023_2024_Data_Analysis.pdf |[2023/2024] Intro to Data Analysis]] by Matteo Matteucci
* [[Media:DASA_2023_2024_Regression.pdf |[2023/2024] Intro to Regression]] by Matteo Matteucci
* [[Media:DASA_2022_2023_Classification.pdf |[2022/2023] Intro to Classification]] by Matteo Matteucci
* [[Media:DASA_2022_2023_Clustering.pdf |[2022/2023] Intro to Clustering]] by Matteo Matteucci
<!--* [[Media:DASA_2022_2023_Data_Valorization.pdf |[2022/2023] Data Valorization]] by Filippo Renga-->

You can find here the [https://polimi365-my.sharepoint.com/:f:/g/personal/10104160_polimi_it/EtBdrLCOiXtAgNeKY8ITy1EBwGD2biBGyYyCEdmqVV--Nw?e=ipQVhH Material for practicals!]

<!-- 
https://politecnicomilano.webex.com/recordingservice/sites/politecnicomilano/recording/f727748222e9103bb3fe005056815a1e/playback?from_login=true
https://politecnicomilano.webex.com/recordingservice/sites/politecnicomilano/recording/56324a504bf2103cb6afba6a9e22d3c3/playback
https://politecnicomilano.webex.com/recordingservice/sites/politecnicomilano/recording/d95903004e5e103cbff08649325104d1/playback
https://politecnicomilano.webex.com/recordingservice/sites/politecnicomilano/recording/55a063f753df103cbe77bada9b8da9ca/playback
https://politecnicomilano.webex.com/recordingservice/sites/politecnicomilano/recording/cae5cd076468103c92ef1a396010afd2/playback
-->

===Some data sources===

The following are some links to data sources which might become handy when working on the projects
* [https://datasetsearch.research.google.com/ Google dataset search]
* [https://ourworldindata.org/ Our World in Data]
* [https://www.kaggle.com/datasets?tags=12001-Agriculture Kaggle Agriculture Dataset]
* [https://data.world/datasets/agriculture Agriculture topic on Data.World]
* [https://ec.europa.eu/eurostat/web/agriculture/data/database Eurostat data about agriculture]
* [https://www.usda.gov/content/usda-open-data-catalog US Department of Agriculture Open Data Catalog]
* [https://data.gov.ie/dataset?tags=agriculture Datasets about agriculture on Data.Gov.Ie]
* [https://www.fao.org/faolex/opendata/en/ FAOULEX Dataset]
* [https://sedac.ciesin.columbia.edu/theme/agriculture/data/sets/browse Sedac Datasets on Agriculture and Food Security]
* [https://zdataset.com/category/free-dataset/?gclid=Cj0KCQjw4omaBhDqARIsADXULuULHMZSZRA9mLQ-nH7RICo1s7O_NL7iOfxBFdTN7RJwjqTAY601_lkaAuqxEALw_wcB Zenodo Datasets]