Selected publications

You can find a complete list of my articles on my Google Scholar profile.

Modular Arithmetic: Language Models Solve Math Digit by Digit
Tanja Baeumel, Daniil Gurgurov, Yusser Al Ghussin, Josef van Genabith, Simon Ostermann
Accepted to IJCNLP-AACL Findings (2025)
View Paper

Language Arithmetics: Towards Systematic Language Neuron Identification and Manipulation
Daniil Gurgurov, Katharina Trinley, Yusser Al Ghussin, Tanja Baeumel, Josef van Genabith, Simon Ostermann
Accepted to IJCNLP-AACL (2025)
View Paper

The Lookahead Limitation: Why Multi-Operand Addition is Hard for LLMs
Tanja Baeumel, Josef van Genabith, Simon Ostermann
Accepted to BlackboxNLP (2025)
View Paper

Investigating the Encoding of Words in BERT's Neurons using Feature Textualization
Tanja Baeumel, Soniya Vijayakumar, Josef van Genabith, Günter Neumann, Simon Ostermann
Proceedings of the 6th BlackboxNLP Workshop: Analyzing and Interpreting Neural Networks for NLP (2023)
View Paper