Publications
I am passionate about designing synthetic agents that can be incorporated into everyday life as human companions.
My research interest lies in developing methods that enable agents to
communicate effectively and collaborate seamlessly with humans
in households or public spaces,
increasing the quality of human lives
, while
evolving alongside humans by learning from them.
Topics of interest include human-in-the-loop learning, interactive human-robot collaboration, reinforcement learning, and imitation learning,
especially for robotics applications.
|
|
Human-Feedback Efficient Reinforcement Learning for Online Diffusion Model Finetuning
Ayano Hiranaka*, Shang-Fu Chen*, Chieh-Hsin Lai*,
Dongjun Kim, Naoki Murata, Takashi Shibuya, Wei-Hsiang Liao,
Shao-Hua Sun**, Yuki Mitsufuji**
ICLR 2025  
paper
Finetuning text-to-image diffusion models for a variety of tasks in a human-feedback-efficient manner
by combining feedback-aligned representation learning and feedback-guided image generation.
|
|
NOIR: Neural Signal Operated Intelligent Robot for Daily Activities
Ruohan Zhang*, Sharon Lee*, Minjune Hwang*,
Ayano Hiranaka*,
Chen Wang, Wensi Ai, Jin Jie Ryan Tan, Shreya Gupta,
Yilun Hao, Gabrael Levine, Ruohan Gao, Anthony Norcia,
Li Fei-Fei, Jiajun Wu
CoRL 2023  
project page
/
paper
Brain-robot interface system for everyday activities using EEG signal decoding,
primitive skills, and robot intelligence aided by foundation models.
|
|
Primitive Skill-based Robot Learning from Human Evaluative Feedback
Ayano Hiranaka*,
Minjune Hwang*, Sharon Lee, Chen Wang, Li Fei-Fei, Jiajun Wu, Ruohan Zhang
(*equal contribution, alphabetically ordered)
IROS 2023  
project page
/
paper
Combining intuitive skill-based action space and human evaluative feedback, enabling a
more safe and sample efficient long-horizon task learning in the real world.
|
|
A Dual Representation Framework for Robot Learning with Human Guidance
Ruohan Zhang*, Dhruva Bansal*, Yilun Hao*,
Ayano Hiranaka,
Roberto Martín-Martín, Chen Wang, Li Fei-Fei, Jiajun Wu,
Best paper award at Aligning Robot Representations with Humans workshop
CoRL 2022  
project page
/
paper
A sample-efficient RLHF framework for low-level robot control policy leveraging
a human-interpretable high-level state representation for active query.
|
|