National Taiwan University · CSIE

From Trained
to Interactive
Intelligence.

▶ Press start

We build AI systems that go beyond intelligence fixed at deployment. They learn through interaction, adapt to human preferences, understand their environments, and plan actions to achieve complex goals.

The question behind the lab
How do we move AI from intelligence that is merely trained to intelligence that can continuously interact, learn, and adapt?
01 · Research

AI should keep learning after deployment.

Most modern AI follows a train-then-deploy paradigm. We study what changes when intelligence is treated instead as an ongoing process of interaction, adaptation, and decision-making.

Quest 01

Interactive Optimization for AI

How can AI systems continually improve through interaction with humans? We develop sample-efficient optimization methods that enable AI systems to adapt their behavior to individual preferences, goals, and feedback.

Bayesian OptimizationPreference LearningHuman-in-the-Loop Optimization
Quest 02

Design Intelligence

How can AI understand design intent and turn it into effective actions? We develop intelligent agents that can evaluate, generate, and iteratively improve designs through sequences of decisions.

Intelligent Design AgentsDesign EvaluationReinforcement Learning
Quest 03

World Models for Interactive Agents

How can intelligent agents understand unfamiliar environments and anticipate the consequences of their actions? We develop world models that enable agents to learn environment dynamics, predict future outcomes, and plan over long horizons.

World ModelsRepresentation LearningLong-Horizon Planning
03 · Play

Play with our research.

Four tiny games and demos, each built on a method behind our work: Bayesian optimization with you in the loop, world models for web agents, and a reinforcement-learning agent you can try to outwit. For a longer adventure, BO Quest teaches Bayesian optimization in five chapters.

Bonus stage

Six tries to find the peak of a hidden curve, then race a Bayesian optimization agent.

Pick the tile closest to a reference photo, and preferential Bayesian optimization tunes five color filters for you.

Guess what a click will do to a web page, then watch an AI agent try. Why web agents need world models.

Build a maze and hide a treasure. A reward-free RL agent explores and learns to reach any goal; how long can your maze hold out?

BO Quest

A whole online course on Bayesian optimization, played as five short adventure games. Pick a chapter and start walking.

06 · People

A small group tackling ambitious questions.

Yi-Chi Liao

Yi-Chi Liao

Computer Science & Information Engineering (CSIE), NTU

Interactive Intelligence · Human–AI Interaction · Bayesian Optimization

Cindy Lin

Cindy Lin

CSIE, NTU

Administrative Assistant

Jheng-Ling Lee

Jheng-Ling Lee

CSIE, NTU

Representation learning · World model

Chih-Hao Hsu

Chih-Hao Hsu

CSIE, NTU

Preferential learning · Model steering

Yu-Chian Duan

Yu-Chian Duan

CSIE, NTU

Design agent · LLM benchmark

You-Chen Lai

You-Chen Lai

CSIE, NTU

Test-time optimization · VLM + optimization

Liang-Yen Chen

Liang-Yen Chen

CSIE, NTU

Design agent · LLM-as-judge

Zhi-Wen Qiu

Zhi-Wen Qiu

CSIE, NTU

High-dimensional optimization · Graph-structured optimization

Kuan-Lin Lee

Kuan-Lin Lee

CSIE, NTU

Interactive optimization library

07 · Contact · Join us

Come build interactive intelligence with us.

A new opportunity appeared!

We are recruiting students across levels who are excited by machine learning, HCI, agents, optimization, or computational approaches to intelligent interactive systems.

See recruiting information
Visit us

Come visit us.

We welcome researchers, students, and friends to visit us and chat about research. If you would like to stop by, please get in touch with Yi-Chi by email.

Contact

yichi@csie.ntu.edu.tw ↗

Find us

Department of Computer Science & Information Engineering
National Taiwan University

No. 1, Sec. 4, Roosevelt Road,
Taipei, 10617
Taiwan (R.O.C.)