Ofertas de proyectos

A list of issues hard to compute would include:

1. The computation of the partition function is NP-hard, involving an  exponential sum of terms
2. The exact computation of the derivative of the log-likelihood is  also NP-hard, since it contains the derivative of the partition function

Therefore, in practice we have to approximate both the computation of
the probabilities and several components of the learning process
itself. These drawbacks have prevented RBMs to show their real
potential as truly probabilistic models.

Currently, we are working on trying to improve several of the unsolved
issues related to RBMs:

1. - Mechanisms to control the learning process: www.lsi.upc.edu/~eromero/Publications/Downloads/2018-tnnls-stopcritRBM.pdf
2. Better approximations of the derivative of the log-likelihood: http://www.lsi.upc.edu/~eromero/Publications/Downloads/2019-nn-weightedCD.pdf
3. Efficient approximation of the partition function (work in progress)

These works have opened new lines of research, some of which can be
the topic of a Master's Thesis. The scope and degree of depth of the
work can be adapted to the estimated times to complete the Thesis. For
further details, contact Enrique Romero (eromero@cs.upc.edu).

A more detailed description of the project can be found in

https://www.cs.upc.edu/~eromero/Downloads/Retina-TFM-Project-01.pdf

The project is proposed in collaboration with Javier Zarranz Ventura
(Institut Clínic d'Oftalmologia, ICOF, Hospital Clínic de Barcelona, and
Institut d'Investigacions Biomèdiques August Pi I Sunyer, IDIBAPS),
which would provide a large annotated database to develop the project. For further information, please contact Alfredo Vellido (avellido@cs.
upc.edu) or Enrique Romero (eromero@cs.upc.edu).

Functional near-infrared spectroscopy (fNIRS) is a non-invasive neuroimaging technique that measures changes in oxygenated (HbO2) and deoxygenated hemoglobin (HbR) in the cerebral cortex. Due to its portability and low cost, fNIRS has been used in Brain-Computer Interface (BCI) applications, characterizing hemodynamic responses to varying stimuli, and investigating auditory and visual-spatial attention during Complex Scene Analysis (CSA). In this project, we want to design and implement an fNIRS study with a goal of studying the impact of neural and BCI outcomes to improving the training of LAI models' attention mechanism (e.g., Transformer attention) during reading comprehension tasks (e.g., the participants will be judging the quality of generated text). We want to demonstrate experimentally that augmenting a model with fNIRS data carries neural activity features complementing the information captured by the model and demonstrate that it improves the models' performance. To this end, we will have to collect data from participants and test how different Transformer models benefit from different types of fNIRS attention masks.

The candidate will:

• Carry out controlled studies and collect data from a number of participants.
• Try different approaches to incorporating fNIRS signal in the training process of DL/LLM models and compare against baselines/experiments (these should be replicated).
• Carry out ablation studies, personalisation techniques, error analyses, etc.
• Contribute to authoring a scientific article

Els detalls es donaran a l'alumne personalment

Immobilitzar objectes, ja sigui agafant-los amb una mà robòtica amb dits o utilitzant qualsevol dispositiu de fixació, és un camp de recerca força actiu en robòtica i automatització. L'objectiu és restringir el possible moviment de l'objecte malgrat la possible existència de pertorbacions externes que actuen sobre ell (per descomptat, fins a una magnitud determinada).

En termes generals, els objectes es poden classificar en dos tipus: rígids i deformables. El treball a realitzar en aquest projecte tracta el cas particular de objectes deformables composts per un conjunt d'enllaços rígids units entre si per qualsevol tipus d'articulació que ha de ser immobilitzat en la seva configuració actual.

Les Regions de Contacte Independents (ICRs) són regions de la superfície de l'objecte tal que un contacte amb un dit en qualsevol punt de cadascuna d'elles garanteix una prensió que  immobilitza l'objecte independentment de la posició exacta del contacte.

L'objectiu específic d'aquest projecte és implementar un paquet de programari que permeti el càlcul d'ICRs donat el model i la configuració de l'objecte articulat a immobilitzar.

Alguns supòsits i condicions específiques:

• Es presumeix que els objectes estan descrits per un núvol de punts, i es coneix la direcció normal a la superfície de l'objecte en cada punt. El núvol de punts pot generar-se a partir d'un model d'objecte (per exemple, CAD) o d'una càmera 3D.

• Es prefereix l'ús de C++ o Python.

Publicacions científiques relacionades:

•  N. Alvarado, R. Suárez and M. Roa, ''Determining independent contacts regions to immobilize 2D articulated objects'' 2015 IEEE International Conference on Robotics and Automation, ICRA 2015, Seattle, Washington, USA, May 26-30, 2015, pp. 4292-4297. (DOI 10.1109/ICRA.2015.7139791).

Aquest article presenta un treball equivalent per a objectes en 2D, el treball a realitzar és la implementació del mateix enfocament però en 3D.

• M. Roa and R. Suárez, ''Computation of independent contact regions for grasping 3D objects'', IEEE Transactions on Robotics (ISSN: 1552-3098), Volume 25, Issue 4, Aug. 2009, Pages 839-850.

Aquest article presenta la idea clau de l'enfocament per a objectes sòlids en 3D (no articulats), el treball a realitzar és la implementació d'una generalització de l'enfocament per a objectes articulats.

Posar-se en contacte amb raul.suarez@upc.edu per a més informació.

This project offers the candidate a unique opportunity to apply artificial intelligence techniques to real-world challenges in lung cancer research and treatment. As part of this thesis, the candidate will work with datasets, including patient records, genetic data, molecular alterations, treatment outcomes, and exposome data. These datasets will serve as the foundation for developing AI models that address critical challenges in lung cancer treatment, such as predicting patient outcomes and identifying optimal treatment strategies.

The candidate will focus on the following core tasks:

Data Exploration and Preprocessing: The candidate will gain experience in handling complex medical datasets by cleaning, preparing, and structuring the data to ensure it is suitable for advanced AI analysis.

Building AI Models: Using machine learning and deep learning techniques, the candidate will develop models aimed at predicting lung cancer progression, evaluating treatment efficacy, and understanding the impact of various environmental and genetic factors.

Interpretability and Explainability: A significant emphasis will be placed on making AI models interpretable and transparent. The candidate will explore techniques to ensure that the models produced are not just accurate but also explainable, providing healthcare professionals with clear insights into the model's predictions and decisions.

Exploring Interaction Networks: The candidate will analyze interaction networks, studying relationships between patient genetics, environmental factors, and treatment responses to identify key drivers of lung cancer outcomes.

Throughout the project, the candidate will not only gain hands-on experience with cutting-edge AI tools and methodologies but also develop a deeper understanding of AI's role in healthcare. This project provides an impactful opportunity to contribute to a field where AI innovation can directly improve patient outcomes.

The application of Artificial Intelligence (AI) and Machine Learning (ML) to network security (AI4SEC) is paramount against cybercrime. While AI/ML is mainstream in domains such as computer vision and natural language processing, traditional AI/ML has produced below-par results in AI4SEC. Solutions do not properly generalize, are ineffective in real deployments, and are vulnerable to adversarial attacks. A fundamental limitation is the lack of AI/ML technology specific to network security. Due to their unique ability to learn and generalize over graph-structured information, graph-learning approaches, and in particular Graph Neural Networks (GNNs), have recently enabled groundbreaking applications in multiple fields where data are generally represented as graphs. Network security data are intrinsically relational, and initial research suggests that graph-structured representations and GNNs have the potential to become foundational to AI4SEC, in the way convolutional and recursive networks were to computer vision and natural language processing.
The goal of GRAPHS4SEC is to leverage graph data representations and modern GNN technology to conceive a new breed of robust GNN-based network security methods which could radically advance the AI4SEC practice. The objectives of GRAPHS4SEC are: (a) to investigate algorithmic methods that facilitate modeling and learning from graph-based network security data; (b) to compare the benefits and overheads of GNN-based AI4SEC to traditional AI/ML in terms of detection performance, generalization, scalability, and robustness against adversarial attacks; (c) to showcase the benefits and improvements of GRAPHS4SEC technology in four critical, real-world network security applications with significant impact for society, considering (in particular) the detection and early mitigation of phishing and fake/malicious websites, a threat among the most popular and society-wide harmful in today's Internet.

In the proposed project, we are interested in the mobile setting, and propose the use of depth information, on top of the usual RGB (Red, Green, Blue) pixel data acquired by mobile device cameras, to track and quantify visual attention. Depth information can either be estimated with post computer visual processing or acquired directly with high precision, using advanced LiDAR sensors that newer smartphone models are currently equipped with. Furthermore, we propose the use of "lightweight" Deep Learning (DL) techniques to achieve an accurate and robust gaze point estimation without the need of extensive calibration. Unlike prior art, we will consider the use of historical information to inform future predictions and will examine how such models can be tailored to each user by injecting personalized data. In addition, we propose a more lightweight Neural Network (NN) architecture, suitable for the processing power of mobile devices, that also leverages the use of video or photo frames with depth sensory data.

The candidate will:

• Develop an app for iPhone (in Swift) for collecting gaze information and image data (using the device's frontal camera and LiDAR sensors), while completing a simple task of tracking a red dot in a matrix.
  
• Incorporate in the app the functionality offered by SensingKit,  an open-source mobile sensing framework compatible with iOS specialised in capturing motion, orientation, location and proximity (using iBeacon¿ or Eddystone¿) data and transmitting them on a server over any Internet connection. [https://github.com/SensingKit/SensingKit-iOS]
• Carry out a crowdsourcing study and collect data from a number of participants.
• Train lightweight DL models to predict accurately gaze point estimation, using the collected data, and compare against prior baselines/experiments (these should be replicated).
• Carry out ablation studies, personalisation techniques, error analyses, etc.
• Contribute to authoring a scientific article

Eye movement features are considered to be direct signals reflecting human attention distribution with a low cost to obtain, inspiring researchers to augment language models with eye-tracking (ET) data. In this project, we want to investigate how to operationalise eye tracking (ET) features, such as first fixation duration (FFD) and total reading time (TRT), as the cognitive signals to augment LAI models' attention mechanism (e.g., Transformer attention) during training. We want to demonstrate experimentally that augmenting a model with ET data carries linguistic features complementing the information captured by the model and demonstrate that it improves the models' performance. To this end, we will have to collect data from participants and test how different Transformer models benefit from different types of ET attention masks.

The candidate will:

• Carry out controlled studies and collect data from a number of participants.
• Try different approaches to incorporating gaze features in the training process of DL/LLM models and compare against baselines/experiments (these should be replicated).
• Carry out ablation studies, personalisation techniques, error analyses, etc.
• Contribute to authoring a scientific article