Interactive Optimization for AI
How can AI systems continually improve through interaction with humans? We develop sample-efficient optimization methods that enable AI systems to adapt their behavior to individual preferences, goals, and feedback.
We build AI systems that go beyond intelligence fixed at deployment. They learn through interaction, adapt to human preferences, understand their environments, and plan actions to achieve complex goals.
How do we move AI from intelligence that is merely trained to intelligence that can continuously interact, learn, and adapt?
Most modern AI follows a train-then-deploy paradigm. We study what changes when intelligence is treated instead as an ongoing process of interaction, adaptation, and decision-making.
How can AI systems continually improve through interaction with humans? We develop sample-efficient optimization methods that enable AI systems to adapt their behavior to individual preferences, goals, and feedback.
How can AI understand design intent and turn it into effective actions? We develop intelligent agents that can evaluate, generate, and iteratively improve designs through sequences of decisions.
How can intelligent agents understand unfamiliar environments and anticipate the consequences of their actions? We develop world models that enable agents to learn environment dynamics, predict future outcomes, and plan over long horizons.
Our work spans adaptive interfaces, human-in-the-loop optimization, mixed reality, computational models of interaction, and learning-based intelligent systems.
Learning priors from simulated users to enable efficient human-in-the-loop optimization.
LLM-based agents are employed to configure optimization for real-time VR interface adaptation.
Learning population-level structure while adapting optimization to each new user.
Meta-learning prior preferences to accelerate personalized visual optimization.
Turning sparse preference signals into personalized multi-objective interface adaptation.
Fast calibration of wrist-based interactions with only a handful of user trials.
Four tiny games and demos, each built on a method behind our work: Bayesian optimization with you in the loop, world models for web agents, and a reinforcement-learning agent you can try to outwit. For a longer adventure, BO Quest teaches Bayesian optimization in five chapters.
Open-source tools from the lab for Bayesian optimization, human-in-the-loop design, and running research projects.
A research and teaching library for Bayesian optimization: from a Gaussian process in plain NumPy to transfer, continual, multi-objective and meta-learned BO, with reproducible benchmarks and servers for studies where a person evaluates each design.
Multi-objective Bayesian optimization for designing interaction techniques, for one user or a whole group, connected to your application over WebSocket.
Hands-on courses spanning human-centered design, modern AI models, agents, and the evaluation of AI-native systems, plus self-paced online courses on human-AI interaction and on Bayesian optimization.
CSIE 5648 · Wed 9:10–12:10 · 資 101 · Human-centered AI, modern AI models, model steering, agents, and evaluating AI systems, with a group project building a working AI-native system.
Virtual online course · 22 chapters played as short browser games · HCI and design, research methods and statistics, deep learning, how large language models work, and how to harness them.
Virtual online course · 5 chapters played as short browser games · Probability, Gaussian processes, Bayesian optimization, multi-objective BO, and preferential BO.

Computer Science & Information Engineering (CSIE), NTU
Interactive Intelligence · Human–AI Interaction · Bayesian Optimization

CSIE, NTU
Administrative Assistant

CSIE, NTU
Representation learning · World model

CSIE, NTU
Preferential learning · Model steering

CSIE, NTU
Design agent · LLM benchmark

CSIE, NTU
Test-time optimization · VLM + optimization

CSIE, NTU
Design agent · LLM-as-judge

CSIE, NTU
High-dimensional optimization · Graph-structured optimization

CSIE, NTU
Interactive optimization library
A new opportunity appeared!
We are recruiting students across levels who are excited by machine learning, HCI, agents, optimization, or computational approaches to intelligent interactive systems.
See recruiting informationWe welcome researchers, students, and friends to visit us and chat about research. If you would like to stop by, please get in touch with Yi-Chi by email.
Department of Computer Science & Information Engineering
National Taiwan University
No. 1, Sec. 4, Roosevelt Road,
Taipei, 10617
Taiwan (R.O.C.)