Publications

You can also find my articles on my Google Scholar profile.

Conference Papers


Computing Fixpoints of Learned Functions: Chaotic Iteration and Simple Stochastic Games

Published in TACAS, 2026

An significant generalization of the results from the CAV paper, including results for stochastic games, chaotic iteration, and generalizations of convergence results for purely model-based reinforcement learning algorithms.

Recommended citation: Baldan, P., Gurke, S., König, B., Wittbold, F. (2026). Computing Fixpoints of Learned Functions: Chaotic Iteration and Simple Stochastic Games. In: Junges, S., Katz, G. (eds) Tools and Algorithms for the Construction and Analysis of Systems. TACAS 2026. Lecture Notes in Computer Science, vol 16505. Springer, Cham.
Download Paper | Download Slides | Download Bibtex

Unsupervised Automata Learning via Discrete Optimization

Published in JELIA, 2025

Learning finite automata from unlabeled data using discrete optimization techniques.

Recommended citation: Lutz, S. et al. (2026). Unsupervised Automata Learning via Discrete Optimization. In: Casini, G., Dundua, B., Kutsia, T. (eds) Logics in Artificial Intelligence. JELIA 2025. Lecture Notes in Computer Science(), vol 16093. Springer, Cham.
Download Paper | Download Bibtex

Approximating Fixpoints of Approximated Functions

Published in CAV, 2025

Approximating fixpoints of non-expansive functions using only a sequence of approximations to the function of interest with applications to model-based reinforcement learning.

Recommended citation: Baldan, P., Gurke, S., König, B., Padoan, T., Wittbold, F. (2025). Approximating Fixpoints of Approximated Functions. In: Piskac, R., Rakamarić, Z. (eds) Computer Aided Verification. CAV 2025. Lecture Notes in Computer Science, vol 15932. Springer, Cham.
Download Paper | Download Bibtex

Stochastic Decision Petri Nets

Published in Petri Nets, 2023

Introduction of stochastic decision Petri nets, an extension of stochastic Petri nets introducing non-deterministic choices along with first complexity results and an algorithm for optimal constant strategies.

Recommended citation: Wittbold, F., Bernemann, R., Heckel, R., Heindel, T., König, B. (2023). Stochastic Decision Petri Nets. In: Gomes, L., Lorenz, R. (eds) Application and Theory of Petri Nets and Concurrency. PETRI NETS 2023. Lecture Notes in Computer Science, vol 13929. Springer, Cham.
Download Paper | Download Slides | Download Bibtex