Self-improving coding agents. Safety in realistic settings.
My goal is to build continuous self-improvement cycles for coding agents: generating tasks, acting in an environment, learning from feedback, and using that experience to improve the next attempt.
In parallel, I aim to build environments that evaluate AI safety in realistic scenarios, not just isolated prompts. I want progress in agent capability to be matched by rigorous evidence of safe, reliable behavior in practical workflows.
Open to research collaboration on agent self-improvement and realistic safety evaluation. Get in touch →
Current research
Self-improving coding agents
How can an agent turn its successes and failures into the next round of useful training? I study task synthesis, learning from trajectories, and self-retrospection as components of a sustained improvement cycle.
How do we test safety when an agent is acting in a realistic workflow? I focus on environments that capture context, multi-step interactions, and practical constraints, exposing failure modes that static benchmarks can miss.
FrogNano: Training a 4B Coding Agent via Online Task Synthesis
ArXiv 2026
M. Kim*, Z. Shi*, E. Penaloza*, C. Cui*, R. Castanyer*, M. Hashemazadeh, I. White, J. Light, J. Kim, M. Pereira, D. Moldavskaya, C. Singh, F. Vera, B. Peng, X. Yuan*, M.-A. Côté*, A. Sordoni*
KV-streams for Efficient Compaction in Agentic Reinforcement Learning
arXiv 2026
E. Penaloza, D. Malenfant, D. Vattikonda, R. C. Castanyer, S. Venkatraman, A. Puri, J. Light, M. J. Sargent, A. N. Mavor-Parker, M. Caccia, L. Caccia, G. Berseth, E. S. Whitammer, A. Sordoni, M. Kim, M.-A. Côté, L. Charlin, G. Lajoie
Thesis: Towards Safe and Robust Representation with Self‑Supervised Learning Advisor: Sung Ju Hwang
Mar. 2018 – Feb. 2020
M.S., Electrical Engineering · KAIST
Thesis: Differential representation of face pareidolia in human and deep neural network Advisor: Dae‑shik Kim
Mar. 2013 – Feb. 2018
B.S., Bio & Brain Engineering and Computer Science · KAIST
Double major
Contact
I welcome research collaborations on self-improving coding agents and realistic safety-evaluation environments, especially work connecting task generation, agent learning, and evaluation in practical settings.