SmallData Symposium 2024

Prof. Dr.  

Frank Hutter

Department of Computer Science, Faculty of Engineering, University of Freiburg
Georges-Köhler-Allee 074, 79110 Freiburg

Projects

Publications

Maurer T, Purucker L, Hutter F, Pfaffelhuber P, Heinzel CS. Enhancing Intra-Continental Biogeographical Ancestry Prediction Through a Machine Learning Marker Selection Method, bioRxiv. Nov 2025
Pfefferle A, Hog J, Purucker L, Hutter F. nanoTabPFN: A Lightweight and Educational Reimplementation of TabPFN, arXiv. Nov 2025
Erickson N, Purucker L, [...], Hutter F. TabArena: A Living Benchmark for Machine Learning on Tabular Data, The Thirty-ninth Annual Conference on Neural Information Processing Systems. Oct 2025
Jehle D, Purucker L, Hutter F. Agentic NL2SQL to Reduce Computational Costs, arXiv. Oct 2025
Krishnakumar A, [...], Hutter F, Klein A. Where to Begin: Efficient Pretraining via Subnetwork Selection and Distillation, arXiv. Oct 2025
Heinzel CS, Purucker L, Hutter F, Pfaffelhuber P. Advancing biogeographical ancestry predictions through machine learning, Forensic Science International: Genetics. Sep 2025
Das B, Purucker L, Carstensen T, Hutter F. Quickly Tuning Foundation Models for Image Segmentation, arXiv. Aug 2025
Schäfer B, Purucker L, Janowski M, Hutter F. How Usable is Automated Feature Engineering for Tabular Data? arXiv. Aug 2025
Mráz M, Das B, Gupta A, Purucker L, Hutter F. Towards Benchmarking Foundation Models for Tabular Data With Text, ICML 2025. Jul 2025
Küken J, Purucker L, Hutter F. Early Stopping Tabular In-Context Learning, arXiv. Jun 2025
Pineda Arango S, Janowski M, Purucker L, Zela A, Hutter F, Grabocka J. Regularized Neural Ensemblers, AutoML 2025. Jun 2025
Bühler M, Purucker L, Hutter F. Towards Synthetic Data for Fine-tuning Tabular Foundation Models, ICML. Jun 2025
Garg A, Ali M, Hollmann N, Purucker L, Müller S, Hutter F. Real-TabPFN: Improving Tabular Foundation Models via Continued Pre-training With Real-World Data, ICML. Jun 2025
Cong T, [...], Purucker L, [...], Hutter F. Position: Unlocking the Full Potential of Data Science Requires Tabular Foundation Models, Agents, and Humans, Personal Website of Daniel Gomm. May 2025
Tschalzev A, Purucker L, Lüdtke S, Hutter F, Bartelt C, Stuckenschmidt H. Unreflected Use of Tabular Data Repositories Can Undermine Research Quality, ICLR 2025. Apr 2025
Hog J, Rajan R, Biedenkapp A, Awad N, Hutter F, Nguyen V. Meta-learning Population-based Methods for Reinforcement Learning, Transactions on Machine Learning Research. Mar 2025
Hollmann N, Müller S, Purucker L, [...], Hutter F. Accurate predictions on small data with a tabular foundation model, Nature. Jan 2025
Mallik N, Janowski M, Hog J, Rakotoarison H, Klein A, Grabocka J, Hutter F. Warmstarting for Scaling Language Models, NeurIPS 2024. Nov 2024
Sukthanker RS, Zela A, Staffler B, Klein A, Purucker L, Franke JKH, Hutter F. HW-GPT-Bench: Hardware-Aware Architecture Benchmark for Language Models, The Thirty-eight Conference on Neural Information Processing Systems Datasets and Benchmarks Track. Nov 2024
Matus D, [...], Hutter F, Backofen R. RNA-Protein Interaction Classification via Sequence Embeddings, bioRxiv. Nov 2024
Strangmann T, Purucker L, Franke JKH, Rapant I, Ferreira F, Hutter F. Transfer Learning for Finetuning Large Language Models, NeurIPS 2024. Nov 2024
Pineda Arango S, Janowski M, Purucker L, Zela A, Hutter F, Grabocka J. Ensembling Finetuned Language Models for Text Classification, arXiv. Oct 2024
Pfefferle A, Purucker L, Hutter F. DAFT: Data-Aware Fine-Tuning of Foundation Models for Efficient and Effective Medical Image Segmentation, CVPR 2024. Oct 2024
Küken J, Purucker L, Hutter F. Large Language Models Engineer Too Many Simple Features for Tabular Data, NeurIPS 2024: Third Table Representation Learning Workshop. Oct 2024
Runge F, Hutter F. Machine Learning for RNA Design: LEARNA, RNA Design: Methods and Protocols. Sep 2024
Bergman E, Feurer M, Bahram A, Balef AR, Purucker L, Segel S, Lindauer M, Hutter F, Eggensperger K. AMLTK: A Modular AutoML Toolkit in Python, The Journal of Open Source Software. Aug 2024
Rapant I, Purucker L, Ferreira F, Arango SP, Kadra A, Grabocka J, Hutter F. Quick-Tune-Tool: A Practical Tool and its User Guide for Automatically Finetuning Pretrained Models, AutoML Conference 2024 (Workshop Track). Jul 2024
Bergman E, Purucker L, Hutter F. Don't Waste Your Time: Early Stopping Cross-Validation, arXiv. May 2024
Franke JKH, Runge F, Koeksal R, Backofen R, Hutter F. RNAformer: a simple yet effective deep learning model for RNA secondary structure prediction., bioRxiv. Feb 2024

Related Resources in the Small Data Companion

Grabocka J, et al. (2024) Finetuning Text Classifiers
Model, algorithm or code
Grabocka J, et al. (2024) IMDB
Dataset
Grabocka J, et al. (2024) Tweet Sentiment Extraction
Dataset
Grabocka J, et al. (2024) AG News
Dataset
Grabocka J, et al. (2024) DBpedia 14
Dataset
Grabocka J, et al. (2024) SST-2
Dataset
Grabocka J, et al. (2024) SetFit MNLI
Dataset
Awad N, et al. (2025) MetaPB2
Model, algorithm or code
Franke JKH, et al. (2024) HW-GPT-Bench
Model, algorithm or code
Franke JKH, et al. (2024) OpenWebTextCorpus
Dataset
Franke JKH, et al. (2024) HW-GPT-Bench: Hardware-Aware Architecture Benchmark for Language Models
Original Preprint
Carstensen T, et al. (2025) QTT-SEG
Model, algorithm or code
Carstensen T, et al. (2025) SAM 2
Model, algorithm or code
Carstensen T, et al. (2025) AutoGluon
Model, algorithm or code
Hutter F, et al. (2024) LLMs Feature Engineering Bias
Model, algorithm or code
Hutter F, et al. (2024) AutoML Benchmark
Dataset
Hutter F, et al. (2024) Large Language Models Engineer Too Many Simple Features for Tabular Data
Original Preprint
Hutter F, et al. (2024) DAFT
Model, algorithm or code
Hutter F, et al. (2024) LiteMedSAM
Model, algorithm or code
Hutter F, et al. (2024) Segment Anything in Medical Images on Laptop competition
Dataset
Das B, et al. (2025) TextTabBench: A Dataset Pool for Text-Tabular Learning
Model, algorithm or code
Hollmann N, et al. (2025) TabPFN Zenodo archive
Model, algorithm or code
Hollmann N, et al. (2025) TabPFN
Model, algorithm or code
Hollmann N, et al. (2025) tabpfn-client
Model, algorithm or code
Hollmann N, et al. (2025) tabpfn-extensions
Model, algorithm or code
Hollmann N, et al. (2025) OpenML AutoML Benchmark
Dataset
Hollmann N, et al. (2025) Accurate predictions on small data (and time series) with the tabular foundation model TabPFN
Video
Hollmann N, et al. (2025) Frank Hutter (University of Freiburg) - Accurate predictions on small data with TabPFN
Video
Hollmann N, et al. (2025) 863: TabPFN: Deep Learning for Tabular Data (That Actually Works!) — with Prof. Frank Hutter
Video
Hollmann N, et al. (2025) TabPFN - What are Prior Labs' plans?
Video
Hollmann N, et al. (2025) 184: Why do you call TabPFN a revolution for data science?
Podcast
Hollmann N, et al. (2025) TabPFN: A Revolution in AutoML?
Podcast
Hollmann N, et al. (2025) TabPFN Documentation
Website
Hollmann N, et al. (2025) What exactly has TabPFN learned to do?
Blog post
Hollmann N, et al. (2025) TabPFN: Foundation Model for Tabular Data in Galaxy
Blog post
Hollmann N, et al. (2025) TabPFN Colab Notebook
Tutorial
Backofen R, et al. (2024) RNAInterAct
Dataset
Backofen R, et al. (2024) RNAInter
Dataset
Backofen R, et al. (2024) GenBank
Dataset
Backofen R, et al. (2024) UniProt
Dataset
Backofen R, et al. (2024) Ensembl
Dataset
Backofen R, et al. (2024) Rfam
Dataset
Backofen R, et al. (2024) Pfam
Dataset
Backofen R, et al. (2024) xPRI
Dataset
Backofen R, et al. (2024) RNAcentral: The non-coding RNA sequence database
Dataset
Backofen R, et al. (2024) The UniProt Reference Clusters (UniRef)
Dataset
Hutter F, et al. (2025) Early-exit / early-stopping tabular in-context learning implementation
Model, algorithm or code
Bahram A, et al. (2024) AMLTK
Model, algorithm or code
Bahram A, et al. (2024) AMLTK Zenodo archive
Model, algorithm or code
Bahram A, et al. (2024) [REVIEW]: AMLTK: A Modular AutoML Toolkit in Python #6367
Publication review
Desai PM, et al. (2025) TabArena
Model, algorithm or code
Desai PM, et al. (2025) AutoGluon implementation framework
Model, algorithm or code
Desai PM, et al. (2025) TabArena Leaderboard for Predictive Machine Learning on IID Tabular Data
Benchmark
Hog J, et al. (2025) nanoTabPFN
Model, algorithm or code
Ali M, et al. (2025) Real-TabPFN model checkpoint
Model, algorithm or code
Ali M, et al. (2025) OpenML AutoML Benchmark
Dataset
Ali M, et al. (2025) GitTables
Dataset
Ali M, et al. (2025) TabPFN-v2-clf
Programming package
Bergman E, et al. (2024) Don't Waste Your Time: early stopping cross-validation code
Model, algorithm or code
Bergman E, et al. (2024) AutoML Benchmark
Dataset
Heinzel CS, et al. (2025) BGA Classification
Model, algorithm or code
Backofen R, et al. (2024) RNAformer
Model, algorithm or code
Backofen R, et al. (2024) bpRNA: large-scale automated annotation and analysis of RNA secondary structure
Dataset
Backofen R, et al. (2024) Exact calculation of loop formation probability identifies folding motifs in RNA secondary structures
Dataset
Backofen R, et al. (2024) TurboFold II: RNA structural alignment and secondary structure prediction informed by multiple homologs
Dataset
Backofen R, et al. (2024) RNA STRAND v2.0 - The RNA secondary STRucture and statistical ANalysis Database
Dataset
Backofen R, et al. (2024) Protein Data Bank: the single global archive for 3D macromolecular structure data
Dataset
Grabocka J, et al. (2025) Regularized Neural Ensemblers
Model, algorithm or code
Grabocka J, et al. (2025) TabRepo
Dataset
Grabocka J, et al. (2025) QuickTune meta-datasets
Dataset
Grabocka J, et al. (2025) Finetuning Text Classifiers
Dataset
Grabocka J, et al. (2025) NAS-Bench-201
Dataset
Heinzel CS, et al. (2025) BGA-Classification
Model, algorithm or code
Heinzel CS, et al. (2025) Development and evaluations of the ancestry informative markers of the VISAGE Enhanced Tool for Appearance and Ancestry
Dataset
Heinzel CS, et al. (2025) Advancing Biogeographical Ancestry Predictions Through Machine Learning
Original Preprint
Heinzel CS, et al. (2025) Website GUI The TabPFN Classifier for Biogeographical Ancestry
Website
Carstensen T, et al. (2025) whittle
Model, algorithm or code
Hutter F, et al. (2025) RelBench
Dataset
Arango SP, et al. (2024) Quick-Tune-Tool
Model, algorithm or code
Arango SP, et al. (2024) Oxford Flowers 102
Dataset
Arango SP, et al. (2024) Stanford Cars
Dataset
Arango SP, et al. (2024) Imagenette
Dataset
Arango SP, et al. (2024) FGVC-Aircraft
Dataset

Administrative Manager

Marc Schumacher

Institute of Medical Biometry and Statistics,
Faculty of Medicine and Medical Center –
University of Freiburg