B02

B02

Transfer learning for forecasting short environmental time series using process-guided neural networks

Project summary

In many fields of science, and particularly in environmental science, process models have been developed to represent our knowledge of the mechanisms underlying fluxes and states. We hypothesize that such process knowledge can substantially improve purely data-driven neural networks in small data settings. Thus, we want to expand approaches for process models in neural networks by augmenting neural networks with existing biophysical process knowledge and using explainable AI to improve process models. We will specifically consider augmentation data by simulations from a process model, and direct uses of process models by regularization, post-processing of process-model output with a neural network, or by embedding the process model into a series of neural networks to combine process model fitting with prediction optimization.

Our methods

  • Combining knowledge- and data-driven modeling
  • Differential equations
  • Neural networks
  • Pre-training

Principal investigator 1

Doctoral researcher position 1

(supervised by PI Bödecker)

Tasks

Network architecture search across model designs, design comparison, new designs, and explainable artificial intelligence techniques.

Requirements

  • Master’s degree or equivalent in computer science, machine learning, or related fields
  • Solid understanding of and hands-on experience with deep learning
  • Experience in hyperparameter optimization techniques is a plus
  • Advanced programming skills in Python (preferably familiarity with PyTorch)

Principal investigator 2

Doctoral researcher position 2

(supervised by PI Dormann)

Tasks

Implementing and operationalizing the use of process models, new designs, and explainable artificial intelligence techniques.

Requirements

  • Master’s degree or equivalent in natural or computer science

Administrative Manager

Marc Schumacher

Institute of Medical Biometry and Statistics,
Faculty of Medicine and Medical Center –
University of Freiburg