Machine Learning II

• Teachers
• Weekly hours
• Competences
• Objectives
• Contents
• Activities
• Teaching methodology
• Evaluation methodology
• Bibliography
• Previous capacities

Teachers

Person in charge

• Ferran Marques Acosta ( )

Others

• Carlos Hernández Pérez ( )
• Jaume Alexandre Solé Gómez ( )
• Javier Ruiz Hidalgo ( )
• Laia Albors Zumel ( )

Weekly hours

Competences

Technical Competences

Technical competencies

• CE1 - Skillfully use mathematical concepts and methods that underlie the problems of science and data engineering.
• CE2 - To be able to program solutions to engineering problems: Design efficient algorithmic solutions to a given computational problem, implement them in the form of a robust, structured and maintainable program, and check the validity of the solution.
• CE3 - Analyze complex phenomena through probability and statistics, and propose models of these types in specific situations. Formulate and solve mathematical optimization problems.
• CE4 - Use current computer systems, including high performance systems, for the process of large volumes of data from the knowledge of its structure, operation and particularities.
• CE5 - Design and apply techniques of signal processing, choosing between different technological tools, including those of Artificial vision, speech recognition and multimedia data processing.
• CE6 - Build or use systems of processing and comprehension of written language, integrating it into other systems driven by the data. Design systems for searching textual or hypertextual information and analysis of social networks.
• CE8 - Ability to choose and employ techniques of statistical modeling and data analysis, evaluating the quality of the models, validating and interpreting them.
• CE9 - Ability to choose and employ a variety of automatic learning techniques and build systems that use them for decision making, even autonomously.

Transversal Competences

Transversals

• CT3 - Efficient oral and written communication. Communicate in an oral and written way with other people about the results of learning, thinking and decision making; Participate in debates on topics of the specialty itself.
• CT5 - Solvent use of information resources. Manage the acquisition, structuring, analysis and visualization of data and information in the field of specialty and critically evaluate the results of such management.
• CT6 [Avaluable] - Autonomous Learning. Detect deficiencies in one's own knowledge and overcome them through critical reflection and the choice of the best action to extend this knowledge.
• CT7 - Third language. Know a third language, preferably English, with an adequate oral and written level and in line with the needs of graduates.

Generic Technical Competences

Generic

• CG1 - To design computer systems that integrate data of provenances and very diverse forms, create with them mathematical models, reason on these models and act accordingly, learning from experience.
• CG2 - Choose and apply the most appropriate methods and techniques to a problem defined by data that represents a challenge for its volume, speed, variety or heterogeneity, including computer, mathematical, statistical and signal processing methods.
• CG3 - Work in multidisciplinary teams and projects related to the processing and exploitation of complex data, interacting fluently with engineers and professionals from other disciplines.
• CG4 - Identify opportunities for innovative data-driven applications in evolving technological environments.
• CG5 - To be able to draw on fundamental knowledge and sound work methodologies acquired during the studies to adapt to the new technological scenarios of the future.

Objectives

1. Organize the flow of solution of a machine learning problem, analyzing the possible options and elegint the mismatches to the problem
   Related competences: CE8, CT6, CG2,
2. Decide, defend and criticise a solution for a machine learning problem, arguing the strong and weak points of appropriation.
   Related competences: CE1, CE2, CE3, CE4, CE5, CE6, CE8, CE9, CT6, CG1, CG2,
3. Know and know how to apply advanced techniques to solve non-supervised learning problems, especially clustering.
   Related competences: CE1, CE2, CE4, CT5, CG1, CG2,
4. Know and apply advanced techniques of learning methods based on deep learning, for the resolution of learning problems, both supervised and unsupervised.
   Related competences: CE1, CE2, CE3, CE4, CE8, CT5, CT7, CG1, CG2, CG5,
5. To know and to know how to apply the various network architectures for solving complex problems with techniques of deep learning.
   Related competences: CE1, CE2, CE3, CE4, CE5, CE6, CE8, CT5, CG1, CG2, CG4, CG5,
6. Know how to identify problems involving signal processing, such as data in the form of audio, image or video, or a combination of you, and solve them with advanced computer learning techniques.
   Related competences: CE1, CE2, CE3, CE4, CE5, CE8, CE9, CT5, CT7, CG1, CG2, CG3, CG4,
7. Know how to identify problems involving human or non-human speech processing, such as data in the form of audio or text, or a combination thereof, and solve them with advanced computational learning techniques
   Related competences: CE1, CE2, CE3, CE4, CE6, CT3, CT7, CG1, CG2, CG3, CG4, CG5,

Contents

1. Basic Elements in Neural Networks
   - Backpropagation
   - Perceptron and MLP .
   - Losses.
   - Optimizers.
   - Convolution
   - Pool and CNNs
   - Deconvolution and Skip
2. Practical Aspects in Neuronal Networks
   - Interpretability
   - Methodology
   - Dropout and Regularization
   - Transfer Learning and Domain Adaptation
3. Architectures
   - RNN, LSTM, GRU.
   - Attention and Transformers.
   - Generative GAN
   - GNN and AutoEncoders.

Activities

Activity Evaluation act

Teaching methodology

Evaluation methodology

Bibliography

Basic:

• Pattern recognition and machine learning - Bishop, C.M, Springer, 2006. ISBN: 0387310738
  https://discovery.upc.edu/discovery/fulldisplay?docid=alma991003157379706711&context=L&vid=34CSUC_UPC:VU1&lang=ca
• Deep learning - Goodfellow, I.; Bengio, Y.; Courville, A, The MIT Press, 2016. ISBN: 9780262035613
  https://discovery.upc.edu/discovery/fulldisplay?docid=alma991004107709706711&context=L&vid=34CSUC_UPC:VU1&lang=ca

Complementary:

• Machine Learning 2 - Giró-i-Nieto, Xavier; Marqués, Ferrán; Ruíz, Javier, Notes de classe , .
  

Previous capacities