Tobias Christian Nauen
PhD Student
RPTU Kaiserslautern-Landau
German Research Center for Artificial Intelligence (DFKI)
Biography
I’m a researcher of artificial intelligence at DFKI and RPTU Kaiserslautern-Landau. My research interests include efficient deep learning, transformer models, multimodal learning, and computer vision. In my PhD project, my focus lies on the development of efficient transformer models for vision, language, and multimodal tasks.
Interests
- Artificial Intelligence
- Computer Vision
- Efficient Transformer Models
Education
M.Sc. in Mathematics, 2022
Leibniz University Hannover
B.Sc. in Computer Science, 2022
Leibniz University Hannover
B.Sc. in Mathematics, 2019
Leibniz University Hannover
Skills
Technical
Python
Linux Terminal
LaTeX
Hobbies
Electric Guitar
Hiking
Bicycle Traveling
Recent Publications
Quickly discover relevant content by filtering publications.
(2024).
TaylorShift: Shifting the Complexity of Self-Attention from Squared to Linear (and Back) using Taylor-Softmax.
ICPR 2024 (oral).
(2024).
Distill the Best, Ignore the Rest: Improving Dataset Distillation with Loss-Value-Based Pruning.
arXiv.
(2024).
Zoomed In, Diffused Out: Towards Local Degradation-Aware Multi-Diffusion for Extreme Image Super-Resolution.
arXiv.
Projects
*
At its core, Albatross is a research project in the area of continual learning.
Energy- and data-saving methods for environmental perception in embedded AI systems using the case study of smart factory and smart farming applications; funded by the Carl Zeiss Foundation.
SustainML is dedicated to creating a sustainable ML framework for Green AI. By prioritizing energy efficiency, SustainML aims to pave the way for environmentally conscious AI solutions that are both efficient and effective.
Contact
If you have any questions, want to collaborate, or just want to chat, feel free to reach out to me.
- tobias_christian.nauen@dfki.de
- Trippstadter Str. 122, Kaiserslautern, 67663
- Enter the main building and take the stairs to Office 3.09 on the third floor.