Machine Learning

Crèdits
6
Tipus
  • BDMA: Obligatòria
  • MIRI: Obligatòria d'especialitat (Ciència de les Dades)
Requisits
Aquesta assignatura no té requisits, però té capacitats prèvies
Departament
CS
The aim of machine learning is the development of theories, techniques and algorithms to allow a computer system to modify its behavior in a given environment through inductive inference. The goal is to infer practical solutions to difficult problems --for which a direct approach is not feasible-- based on observed data about a phenomenon or process. Machine learning is a meeting point of different disciplines: statistics, optimization and algorithmics, among others.

The course is divided into conceptual parts, corresponding to several kinds of fundamental tasks: supervised learning (classification and regression), unsupervised learning (clustering, density estimation) and semi-supervised learning (reinforcement). Specific modelling techniques studied include artificial neural networks and support vector machines. An additional goal is getting acquainted with R, a powerful computing environment based on free software.

Professors

Responsable

  • Marta Arias Vicente ( )

Altres

  • Raquel Leandra Pérez Arnal ( )

Hores setmanals

Teoria
2
Problemes
0
Laboratori
2
Aprenentatge dirigit
0.15
Aprenentatge autònom
6.9

Competències

Generic Technical Competences

Generic

  • CG1 - Capability to apply the scientific method to study and analyse of phenomena and systems in any area of Computer Science, and in the conception, design and implementation of innovative and original solutions.
  • CG3 - Capacity for mathematical modeling, calculation and experimental designing in technology and companies engineering centers, particularly in research and innovation in all areas of Computer Science.
  • CG5 - Capability to apply innovative solutions and make progress in the knowledge to exploit the new paradigms of computing, particularly in distributed environments.

Transversal Competences

Reasoning

  • CTR6 - Capacity for critical, logical and mathematical reasoning. Capability to solve problems in their area of study. Capacity for abstraction: the capability to create and use models that reflect real situations. Capability to design and implement simple experiments, and analyze and interpret their results. Capacity for analysis, synthesis and evaluation.

Basic

  • CB6 - Ability to apply the acquired knowledge and capacity for solving problems in new or unknown environments within broader (or multidisciplinary) contexts related to their area of study.

Technical Competences of each Specialization

Specific

  • CEC1 - Ability to apply scientific methodologies in the study and analysis of phenomena and systems in any field of Information Technology as well as in the conception, design and implementation of innovative and original computing solutions.
  • CEC2 - Capacity for mathematical modelling, calculation and experimental design in engineering technology centres and business, particularly in research and innovation in all areas of Computer Science.

Objectius

  1. Formulate the problem of (machine) learning from data, and know the different machine learning tasks, goals and tools.
    Competències relacionades: CG3, CEC1,
  2. Organize the workflow for solving a machine learning problem, analyzing the possible options and choosing the most appropriate to the problem at hand
    Competències relacionades: CB6, CEC1, CEC2, CTR6, CG5,
  3. Ability to decide, defend and criticize a solution to a machine learning problem, arguing the strengths and weaknesses of the approach. Additionally, ability to compare, judge and interpret a set of results after making a hypothesis about a machine learning problem
    Competències relacionades: CG1, CEC1, CEC2, CTR6,
  4. Understand and know how to apply least squares techniques for solving supervised learning problems
    Competències relacionades: CG3, CEC2, CTR6,
  5. Understand and know how to apply techniques for single and multilayer neural networks for solving supervised learning problems
    Competències relacionades: CG3, CB6, CEC2, CTR6,
  6. Understand and know how to apply support vector machines for solving supervised learning problems
    Competències relacionades: CG3, CB6, CEC2, CTR6, CG5,
  7. Understand and formulate different theoretical tools for the analysis, study and description of machine learning systems
    Competències relacionades: CG3, CTR6, CG5,
  8. Understand and know how to apply the basic techniques for solving unsupervised learning problems
    Competències relacionades: CG3, CB6,
  9. Understand and know how to apply basic techniques for solving reinforcement learning problems
    Competències relacionades: CG3, CB6, CTR6,

Continguts

  1. Introduction to Machine Learning
    General information and basic concepts. Overview to the problems tackled by machine learning techniques. Supervised learning (classification and regression), unsupervised learning (clustering and density estimation) and semi-supervised learning (reinforcement and transductive). Examples.
  2. Supervised machine learning theory
    The supervised Machine Learning problem setup. Classification and regression problems. Bias-variance tradeoff. Regularization. Overfitting and underfitting. Generalization bounds. Complexity of a model: Vapnik-Chervonenkis dimension and Rademacher complexity. Model selection and feature selection.
  3. Linear methods for regression
    Error functions for regression. Least squares: analytical and iterative methods. Regularized least squares. The Delta rule. Examples.
  4. Linear methods for classification
    Error functions for classification. The perceptron algorithm. Novikoff's theorem. Separations with maximum margin. Generative learning algorithms and Gaussian discriminant analysis. Naive Bayes. Logistic regression. Multinomial regression.
  5. Artificial neural networks
    Artificial neural networks: multilayer perceptron and radial basis functions network. Application to classification and to regression problems.
  6. Kernel functions and support vector machines
    Definition and properties of Kernel functions. Support vector machines for classification and regression problems.
  7. Unsupervised machine learning
    Unsupervised machine learning techniques. Clustering algorithms: EM algorithm and k-means algorithm. Kernel Density Estimation.
  8. Reinforcement learning and control
    Description of reinforcement learning. Markov decision processes and Bellman equations. Values and Temporal Difference methods. Q-learning and the Sarsa algorithm.
  9. Survey of advanced topics
    Bagging and boosting. Notes on deep learning, transductive learning and other hot topics. Challenging applications.

Activitats

Activitat Acte avaluatiu


Development of topic 1 of the course


Objectius: 1
Continguts:
Teoria
2h
Problemes
0h
Laboratori
2h
Aprenentatge dirigit
0h
Aprenentatge autònom
4h

Development of topic 2 of the course


Objectius: 2
Continguts:
Teoria
4h
Problemes
0h
Laboratori
4h
Aprenentatge dirigit
0h
Aprenentatge autònom
8h

Development of topic 3 of the course


Objectius: 3
Continguts:
Teoria
4h
Problemes
0h
Laboratori
4h
Aprenentatge dirigit
0h
Aprenentatge autònom
8h

Development of topic 4 of the course


Objectius: 4
Continguts:
Teoria
4h
Problemes
0h
Laboratori
4h
Aprenentatge dirigit
0h
Aprenentatge autònom
8h

Development of topic 5 of the course


Objectius: 5
Continguts:
Teoria
4h
Problemes
0h
Laboratori
4h
Aprenentatge dirigit
0h
Aprenentatge autònom
8h

Development of item 6 of the course


Objectius: 6
Continguts:
Teoria
4h
Problemes
0h
Laboratori
4h
Aprenentatge dirigit
0h
Aprenentatge autònom
8h

Development of topic 7 of the course


Objectius: 7
Continguts:
Teoria
2h
Problemes
0h
Laboratori
2h
Aprenentatge dirigit
0h
Aprenentatge autònom
4h

Development of topic 8 of the course


Objectius: 8 9
Continguts:
Teoria
2h
Problemes
0h
Laboratori
2h
Aprenentatge dirigit
0h
Aprenentatge autònom
4h

Development of item 9 of the course


Objectius: 9
Continguts:
Teoria
2h
Problemes
0h
Laboratori
0h
Aprenentatge dirigit
0h
Aprenentatge autònom
0h

Comprehensive (theoretical and practical) final quiz

This is a final quiz aimed at assessing the degree of acquisition of basic concepts and practical tools by the students
Objectius: 1 2 3 4 5 6 7 8
Setmana: 14
Tipus: examen de laboratori
Teoria
0h
Problemes
0h
Laboratori
2h
Aprenentatge dirigit
0h
Aprenentatge autònom
10h

Delivery of the practical work


Objectius: 1 2 3 4 5 6 7 8
Setmana: 15
Tipus: entrega
Teoria
0h
Problemes
0h
Laboratori
0h
Aprenentatge dirigit
2h
Aprenentatge autònom
25h

Metodologia docent

The topics exposed in the lectures are very well motivated (why is this important?) and motivating (why is this relevant nowadays?) and supplemented with many real examples. These lectures will introduce all the knowledge, techniques, concepts and results necessary to achieve a solid understanding of the fundamental concepts and techniques. The laboratory lectures will make the students develop their own solutions to practical problems in the discipline.

There is a practical work, which that collects and integrates the knowledge and skills of the course; the students will be offered to pick a real problem among a predefined list; exceptionally, some students will bring their own problem. In addition there is a written test of basic knowledge (both theoretical and applied); the course is oriented towards training the students to pass the test with relative ease.

Mètode d'avaluació

The course is graded as follows:

NPract = Score for the practical work
NExam = Score of the test exam
NREAS = Score of the generic skill (REASONING)

NFINAL = 35% NExam + 50% NPract + 15% NREAS

Bibliografia

Bàsica:

Complementaria:

Web links

Capacitats prèvies

Elementary notions of probability and statistics.
Elementary linear algebra and real analysis
Good programming skills in a high-level language

Addenda

Continguts

NO HI HA CANVIS RESPECTE LA INFORMACIÓ PUBLICADA A LA GUIA DOCENT. NO CHANGE WRT PREVIOUSLY PUBLISHED INFORMATION.

Metodologia docent

Les classes de teoria es faran no presencialment mitjançant la publicació de vídeos i sessions de vidoconferència gravades. Theory lectures will be carried out through recorded material, written notes, and real-time meet sessions.

Mètode d'avaluació

NO HI HA CANVIS RESPECTE LA INFORMACIÓ PUBLICADA A LA GUIA DOCENT. NO CHANGE WRT PREVIOUSLY PUBLISHED INFORMATION.

Pla de contingència

Passaríem a fer les sessions de laboratori de forma remota, amb sessions de videoconferència per aclarir dubtes. If on lockdown, we would carry out remotely via live meets and recorded sessions.