|
Ayano Hiranaka
I am a CS PhD student at University of Southern California (USC) co-advised by Professor
Daniel Seita
and Professor
Erdem Biyik.
Prior to coming to USC, I completed my Master's degree at Stanford University, where I was a research assistant at
Stanford Vision and Learning Lab (SVL).
I received my undergraduate degree in mechanical engineering from the University of Illinois at Urbana-Champaign (UIUC).
I have also been fortunate to work as a research intern at Sony AI's Deep Generative Modeling team in Tokyo.
My experiences are a unique blend of computer science and mechanical engineering,
ranging from AI to robotics to mechanical design.
Email /
CV /
Google Scholar /
Github
|
|
Publications
I design AI agents, both embodied and non-embodied, that co-evolve with humans through
effective communication and collaboration.
My research focuses on creating learning processes where
humans help AI agents learn, and AI agents, in turn, foster human growth.
I am passionate about building human-AI teams that achieve shared understanding
and long-term development through mutual adaptation and continuous learning.
|
|
|
Active Reward Learning and Iterative Trajectory Improvement from Comparative Language Feedback
Eisuke Hirota*, Zhaojing Yang*, Ayano Hiranaka, Miru Jun,
Jeremy Tien, Stuart J. Russell, Anca Dragan, Erdem Bıyık
International Journal of Robotics Research 2025  
project page
/
paper
Improving robot trajectories by learning reward functions aligned with human preferences, utilizing a
joint represntation space of robot trajectory and natural language feedback.
|
|
|
Human-Feedback Efficient Reinforcement Learning for Online Diffusion Model Finetuning
Ayano Hiranaka*, Shang-Fu Chen*, Chieh-Hsin Lai*,
Dongjun Kim, Naoki Murata, Takashi Shibuya, Wei-Hsiang Liao,
Shao-Hua Sun**, Yuki Mitsufuji**
ICLR 2025  
project page
/
paper
Finetuning text-to-image diffusion models for a variety of tasks in a human-feedback-efficient manner
by combining feedback-aligned representation learning and feedback-guided image generation.
Work during internship at Sony AI.
|
|
|
NOIR: Neural Signal Operated Intelligent Robot for Daily Activities
Ruohan Zhang*, Sharon Lee*, Minjune Hwang*,
Ayano Hiranaka*,
Chen Wang, Wensi Ai, Jin Jie Ryan Tan, Shreya Gupta,
Yilun Hao, Gabrael Levine, Ruohan Gao, Anthony Norcia,
Li Fei-Fei, Jiajun Wu
CoRL 2023  
project page
/
paper
Brain-robot interface system for everyday activities using EEG signal decoding,
primitive skills, and robot intelligence aided by foundation models.
|
|
|
Primitive Skill-based Robot Learning from Human Evaluative Feedback
Minjune Hwang*,
Ayano Hiranaka*,
Sharon Lee, Chen Wang, Li Fei-Fei, Jiajun Wu, Ruohan Zhang
IROS 2023  
project page
/
paper
Combining intuitive skill-based action space and human evaluative feedback, enabling a
more safe and sample efficient long-horizon task learning in the real world.
|
|
|
A Dual Representation Framework for Robot Learning with Human Guidance
Ruohan Zhang*, Dhruva Bansal*, Yilun Hao*,
Ayano Hiranaka,
Roberto Martín-Martín, Chen Wang, Li Fei-Fei, Jiajun Wu,
Best paper award at Aligning Robot Representations with Humans workshop
CoRL 2022  
project page
/
paper
A sample-efficient RLHF framework for low-level robot control policy leveraging
a human-interpretable high-level state representation for active query.
|
|