Research Interests

Machine Learning for Computer Vision and Multimedia processing.

Work Experience

Researcher Associate (Oct. 2020 - Sep. 2025)

Y. Sato Laboratory, Institute of Industrial Science, The University of Tokyo, Japan

Assistant Professor (Apr. 2019 - Sep. 2020)

Taniguchi Laboratory, Department of Information and Computer Technology, Tokyo University of Science, Japan

Visiting Researcher (May 2019 - Sep. 2020)

Yamasaki Laboratory, Department of Information and Communication Engineering, The University of Tokyo, Japan

Education

Ph.D., (Apr. 2016 - Mar. 2019)

Department of Information and Communication Engineering,
Graduate School of Information Science and Technology,
The University of Tokyo.
Advisor: Prof. Toshihiko Yamasaki

M.S., (Apr. 2014 - Mar. 2016)

Department of Information and Communication Engineering,
Graduate School of Information Science and Technology,
The University of Tokyo.
Advisor: Prof. Toshihiko Yamasaki

B.E., (Apr. 2010 - Mar. 2014)

Department of Information and Communication Engineering,
The University of Tokyo.
Advisor: Prof. Kiyoharu Aizawa and Prof. Toshihiko Yamasaki

Publications

Journal

• Hisataka Nozawa, Ayumi Kunikata, Yuki Sakai, Liangyang Ouyang, Ryosuke Furuta, Yoichi Sato, and Hikoro Matsui
  Multi‑Agent First‑Person Perspective Analysis for Leadership Assessment in Pediatric Emergency Simulations: A Feasibility Study
  Critical Care Explorations, 2026.

• Yota Yamamoto, Ryoga Takahashi, Ryosuke Furuta, and Yukinobu Taniguchi
  Detecting Door-Closing Defects via Pre-Training with Physics-Based Simulations
  SN Computer Science, 2026.

• Kristen Grauman, Andrew Westbury, Lorenzo Torresani, ... , Ryosuke Furuta, ... , and Michael Wray
  Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectives
  IJCV, 2025.

• Takuma Yagi, Misaki Ohashi, Yifei Huang, Ryosuke Furuta, Shungo Adachi, Toutai Mitsuyama, and Yoichi Sato
  FineBio: A Fine-Grained Video Dataset of Biological Experiments with Hierarchical Annotation
  IJCV, 2025.

• Tomoyuki Hatakeyama, Ryosuke Furuta, and Yoichi Sato
  Simultaneous Control of Head Pose and Expressions in 3D Facial Keypoint-Based GAN
  MTAP, 2024.

• Takehiko Ohkawa, Ryosuke Furuta, and Yoichi Sato
  Efficient Annotation and Learning for 3D Hand Pose Estimation: A Survey
  International Journal of Computer Vision (IJCV), 2023. [arXiv] [Springer Link]

• Ryosuke Furuta, Naoto Inoue, and Toshihiko Yamasaki
  PixelRL: Fully Convolutional Network with Multi-Step Reinforcement Learning for Image Processing
  IEEE TMM, 2020. (IEEE SPS Japan Young Author Best Paper Award) [arXiv] [IEEE Xplore] [project page] [code]

• Ryosuke Furuta, Naoto Inoue, and Toshihiko Yamasaki
  Efficient and Interactive Spatial-Semantic Image Retrieval
  MTAP, 2019. [pdf (open access)]

• Ryosuke Furuta, Satoshi Ikehata, Toshihiko Yamasaki, and Kiyoharu Aizawa
  Efficiency-Enhanced Cost-Volume Filtering featuring Coarse-to-Fine Strategy
  MTAP, 2018. [pdf (open access)] [code]

• Ryosuke Furuta, Ikuko Tsubaki, and Toshihiko Yamasaki
  Fast Volume Seam Carving with Multi-pass Dynamic Programming
  IEEE TCSVT, 2018. (Telecom System Technology Award 2018) [pdf (open access)] [video] [supplementary]

International conference

• Naru Suzuki, Takehiko Ohkawa, Tatsuro Banno, Jihyun Lee, Ryosuke Furuta, and Yoichi Sato
  Affordance-Guided Diffusion Prior for 3D Hand Reconstruction
  ECCV, 2026.

• Liangyang Ouyang, Yifei Huang, Mingfang Zhang, Caixin Kang, Ryosuke Furuta, and Yoichi Sato
  Multi-speaker Attention Alignment for Multimodal Social Interaction
  CVPR, 2026.

• Nie Lin, Yansen Wang, Dongqi Han, Weibang Jiang, Jingyuan Li, Ryosuke Furuta, Yoichi Sato, and Dongsheng Li
  EgoBrain: Synergizing Minds and Eyes For Human Action Understanding
  ICLR, 2026.

• Yuki Sakai*, Ryosuke Furuta*, Juichun Yen, and Yoichi Sato (*co-first authors)
  EgoInstruct: An Egocentric Video Dataset of Face-to-face Instructional Interactions with Multi-modal LLM Benchmarking
  I-HFM workshop at ICCV 2025.

• Takehiko Ohkawa, Jihyun Lee, Shunsuke Saito, Jason Saragih, Fabian Prada, Yichen Xu, Shoou-I Yu, Ryosuke Furuta, Yoichi Sato, and Takaaki Shiratori
  Generative Modeling of Shape-Dependent Self-Contact Human Poses
  I-HFM Workshop at ICCV 2025.

• Takehiko Ohkawa, Jihyun Lee, Shunsuke Saito, Jason Saragih, Fabian Prada, Yichen Xu, Shoou-I Yu, Ryosuke Furuta, Yoichi Sato, and Takaaki Shiratori
  Generative Modeling of Shape-Dependent Self-Contact Human Poses
  HANDS Workshop at ICCV 2025.

• Tatsuro Banno, Takehiko Ohkawa, Ruicong Liu, Ryosuke Furuta, and Yoichi Sato
  AssemblyHands-X: Modeling 3D Hand-Body Coordination for Understanding Bimanual Human Activities
  HANDS Workshop at ICCV 2025.

• Naru Suzuki, Takehiko Ohkawa, Tatsuro Banno, Jihyun Lee, Ryosuke Furuta, and Yoichi Sato
  Affordance-Guided Diffusion Prior for 3D Hand Reconstruction
  HANDS Workshop at ICCV 2025.

• Takehiko Ohkawa, Jihyun Lee, Shunsuke Saito, Jason Saragih, Fabian Prada, Yichen Xu, Shoou-I Yu, Ryosuke Furuta, Yoichi Sato, and Takaaki Shiratori
  Generative Modeling of Shape-Dependent Self-Contact Human Poses
  ICCV, 2025.

• Liangyang Ouyang, Yuki Sakai, Ryosuke Furuta, Hisataka Nozawa, Hikoro Matsui, and Yoichi Sato
  Leadership Assessment in Pediatric Intensive Care Unit Team Training
  EgoVis Workshop at CVPR 2025.

• Nie Lin, Takehiko Ohkawa, Mingfang Zhang, Yifei Huang, Minjie Cai, Ming Li, Ryosuke Furuta, and Yoichi Sato
  SiMHand: Mining Similar Hands for Large-Scale 3D Hand Pose Pre-training
  ICLR, 2025.

• Ryoga Takahashi, Yota Yamamoto, Ryosuke Furuta, and Yukinobu Taniguchi
  Detection of Door-Closing Defects by Learning from Physics-Based Simulations
  VISAPP, 2025.

• Takehiko Ohkawa, Takuma Yagi, Taichi Nishimura, Ryosuke Furuta, Atsushi Hashimoto, Yoshitaka Ushiku, and Yoichi Sato
  Exo2EgoDVC: Dense Video Captioning of Egocentric Procedural Activities Using Web Instructional Videos
  WACV, 2025.

• Masatoshi Tateno, Takuma Yagi, Ryosuke Furuta, and Yoichi Sato
  Learning Multiple Object States from Actions via Large Language Models
  WACV, 2025.

• Takara Taniguchi, and Ryosuke Furuta
  Learning Gaussian Data Augmentation in Feature Space for One-shot Object Detection in Manga
  ACM Multimedia Asia, 2024.

• Liangyang Ouyang, Ruicong Liu, Yifei Huang, Ryosuke Furuta, and Yoichi Sato
  ActionVOS: Action as Prompts for Video Object Segmentation
  ECCV, 2024.

• Takehiko Ohkawa, Takuma Yagi, Taichi Nishimura, Ryosuke Furuta, Atsushi Hashimoto, Yoshitaka Ushiku, and Yoichi Sato
  Dense Video Captioning of Egocentric Procedural Activities Using Web Instructional Videos
  LPVL 2024 at CVPR 2024.

• Masatoshi Tateno, Takuma Yagi, Ryosuke Furuta, and Yoichi Sato
  Learning Object States from Actions via Large Language Models
  LPVL 2024 at CVPR 2024.

• Kristen Grauman, Andrew Westbury, Lorenzo Torresani, ... , Ryosuke Furuta, ... , and Michael Wray
  Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectives
  CVPR, 2024.

• Ryoga Takahashi, Yota Yamamoto, Ryosuke Furuta, and Yukinobu Taniguchi
  Detection of Door Closing Defects by Analyzing Video from a High-speed Camera
  IW-FCV, short paper, 2024. (Best Poster Award)

• Yuan Yin, Yifei Huang, Ryosuke Furuta, and Yoichi Sato
  Proposal-based Temporal Action Localization with Point-level Supervision
  BMVC, 2023.

• Takuma Yagi, Misaki Ohashi, Yifei Huang, Ryosuke Furuta, Shungo Adachi, Toutai Mitsuyama, and Yoichi Sato
  FineBio: A Fine-Grained Video Dataset of Biological Experiments with Hierarchical Annotations
  EPIC 2023 at CVPR 2023.

• Ken Kariya, Go Irie, Ryosuke Furuta, Yota Yamamoto, Shin Aoki, and Yukinobu Taniguchi
  Point Cloud Based Deep Molecular Pose Estimation for Structure-Based Virtual Screening
  IW-FCV, 2023. (Best Paper Award)

• Xinyun Li, Ryosuke Furuta, Go Irie, Yota Yamamoto, and Yukinobu Taniguchi
  Interactive Indoor Localization Based on Image Retrieval and Question Response
  VISAPP, 2023.

• Zecheng Yu, Yifei Huang, Ryosuke Furuta, Takuma Yagi, Yusuke Gotsu, and Yoichi Sato
  Fine-grained Affordance Annotation for Egocentric Hand-Object Interaction Videos
  WACV, 2023.

• Takehiko Ohkawa, Yu-Jhe Li, Qichen Fu, Ryosuke Furuta, Kris Kitani, and Yoichi Sato
  Domain Adaptive Hand Keypoint and Pixel Localization in the Wild
  ECCV, 2022.

• Koya Tango, Takehiko Ohkawa, Ryosuke Furuta, and Yoichi Sato
  Background Mixup Data Augmentation for Hand and Object-in-Contact Detection
  HANDS 2022 at CVPR 2022.

• Zecheng Yu, Yifei Huang, Ryosuke Furuta, Takuma Yagi, Yusuke Gotsu, and Yoichi Sato
  Precise Affordance Annotation for Egocentric Action Video Datasets
  EPIC 2022 at CVPR 2022.

• Delong Ouyang, Ryosuke Furuta, Yugo Shimizu, Yukinobu Taniguchi, Ryota Hinami, and Shonosuke Ishiwatari
  Interactive Manga Colorization with Fast Flat Coloring
  SIGGRAPH ASIA Posters, 2021.

• Xinyun Li, Ryosuke Furuta, Go Irie, and Yukinobu Taniguchi
  Accurate Indoor Localization using Multi-view Image Distance
  IEVC, 2021. (Best Student Paper Award)

• Risako Ii, Ryosuke Furuta, and Yukinobu Taniguchi
  Distortion Correction and Stitching of Overlapping Cattle Barn Images
  IEVC, 2021.

• Yugo Shimizu, Ryosuke Furuta, Delong Ouyang, Yukinobu Taniguchi, Ryota Hinami, and Shonosuke Ishiwatari
  Painting Style-Aware Manga Colorization Based on Generative Adversarial Networks
  IEEE ICIP, 2021. [arXiv]

• Shunta Komatsu, Ryosuke Furuta, and Yukinobu Taniguchi
  Passenger Flow Estimation with Bipartite Matching on Bus Surveillance Cameras
  IEEE MIPR, 2021.

• Masaki Sugimoto, Ryosuke Furuta, and Yukinobu Taniguchi
  Weakly-Supervised Human-Object Interaction Detection
  VISAPP, 2021.

• Ryosuke Furuta, Naoaki Noguchi, Xueting Wang, and Toshihiko Yamasaki
  Feature Point Matching in Cross-Spectral Images with Cycle Consistency Learning
  ICPR, 2020.

• Ryosuke Furuta, Naoto Inoue, and Toshihiko Yamasaki
  Fully Convolutional Network with Multi-Step Reinforcement Learning for Image Processing
  AAAI, 2019. (acceptance rate 16.2%) [arXiv] [proceedings] [project page] [code]

• Naoto Inoue, Ryosuke Furuta, Toshihiko Yamasaki, and Kiyoharu Aizawa
  Cross-Domain Weakly-Supervised Object Detection through Progressive Domain Adaptation
  IEEE CVPR, 2018. (acceptance rate 29.1%) [pdf] [project page] [code]

• Ryosuke Furuta, Naoto Inoue, and Toshihiko Yamasaki
  Efficient and Interactive Spatial-Semantic Image Retrieval
  MMM, 2018. [pdf]

• Sijie Shen, Ryosuke Furuta, Toshihiko Yamasaki and Kiyoharu Aizawa
  Fooling Neural Networks in Face Attractiveness Evaluation: Adversarial Examples with High Attractiveness Score but Low Subjective Score
  IEEE BigMM (short paper), 2017.

• Naoto Inoue, Ryosuke Furuta, Toshihiko Yamasaki and Kiyoharu Aizawa
  Object Detection Refinement Using Markov Random Field Based Pruning and Learning Based Rescoring
  IEEE ICASSP, 2017. [pdf]

• Ryosuke Furuta, Ikuko Tsubaki, and Toshihiko Yamasaki
  Fast Volume Seam Carving with Multi-pass Dynamic Programming
  IEEE ICIP, 2016. [pdf] [video]

• Ryosuke Furuta, Yusuke Fukushima, Toshihiko Yamasaki, and Kiyoharu Aizawa
  Multi-Label Classification using Class Relations Based on Higher-Order MRF Optimization
  IEEE CVPRW (BigVision), 2016. [pdf]

• Toshihiko Yamasaki, Yusuke Fukushima, Ryosuke Furuta, and Kiyoharu Aizawa
  Towards Online Prediction of Oral Presentation
  IEEE BigMM-ACM, 2016.

• Toshihiko Yamasaki, Yusuke Fukushima, Ryosuke Furuta, Litian Sun, Kiyoharu Aizawa, and Danushka Bollegala
  Prediction of User Ratings of Oral Presentations using Label Relations
  ACMMM-ASM, 2015.

• Ryosuke Furuta, Satoshi Ikehata, Toshihiko Yamasaki, and Kiyoharu Aizawa
  Coarse-to-Fine Strategy for Efficient Cost-Volume Filtering
  IEEE ICIP, 2014. (Top 10% Paper Award and IEEE SPS Japan Student Paper Award) [pdf]

Preprint

• Ryosuke Furuta
  Inference-time Trajectory Optimization for Manga Image Editing
  arXiv, 2026.

• Ryosuke Furuta and Yoichi Sato
  Seeking Flat Minima with Mean Teacher on Semi- and Weakly-Supervised Domain Generalization for Object Detection
  arXiv, 2024.

Domestic conferences

• 93 papers

Awards

• Outstanding Reviewer, CVPR2025
• MIRU Paper Evaluation Contribution Award in The Meeting on Image Recognition and Understanding (MIRU) 2024.
• MIRU Audience Award in The Meeting on Image Recognition and Understanding (MIRU) 2024.
• Best Poster Award in The International Workshop on Frontiers of Computer Vision (IW-FCV) 2024. (co-author)
• Best Paper Award in The International Workshop on Frontiers of Computer Vision (IW-FCV) 2023. (co-author)
• Outstanding Presentation Award in Expressive Japan 2022. (three papers, co-author)
• Best Student Paper Award in IIEEJ International Conference on Image Electronics and Visual Computing (IEVC) 2021. (co-author)
• IIEEJ Research Encouragement Award, 2020. (co-author)
• IEEE Signal Processing Society (SPS) Japan Young Author Best Paper Award, 2020.
• IE Special Award, Technical Committee on Image Engineering, Institute of Electronics, Information and Communication Engineers, 2018.
• IE Award, Technical Committee on Image Engineering, Institute of Electronics, Information and Communication Engineers, 2018.
• Telecom System Technology Award, The Telecommunications Advancement Foundation, 2018.
• IE Award, Technical Committee on Image Engineering, Institute of Electronics, Information and Communication Engineers, 2015.
• IMPS Best and Frontier Paper Award, 2015. (co-author)
• IEEE Signal Processing Society (SPS) Japan Student Conference Paper Award, 2015.
• Harashima Hiroshi Science Award, Association for Promotion of Electrical, Electronic and Information Engineering, 2015.
• Top 10% Paper Award in IEEE International Conference on Image Processing (ICIP) 2014.
• ITE Outstanding Student Release Award, The Institute of Image Information and Television Engineers, 2013.
• ITE Suzuki Memorial Young Researcher's Award, The Institute of Image Information and Television Engineers, 2013.

Funding sources

• Grant-in-Aid for Early-Career Scientists, Japan Society for the Promotion of Science (JSPS). (FY2023 - FY2025)
• Research grant, Kayamori Foundation of Informational Science Advancement. (FY2022 - FY2024)
• Grant-in-Aid for Early-Career Scientists, Japan Society for the Promotion of Science (JSPS). (FY2021 - FY2022)
• Grant-in-Aid for Research activity start-up, Japan Society for the Promotion of Science (JSPS). (FY2019 - FY2020)
• Research fellowship for young scientists (DC1), Japan Society for the Promotion of Science (JSPS). (FY2016 - FY2018)
• ITE Financial Support to International Conference Student Release, The Institute of Image Information and Television Engineers, 2014.

Links

Sato Laboratory/Sugano Laboratory

Institute of Industrial Science, The University of Tokyo

Taniguchi Laboratory

Tokyo University of Science

Yamasaki Laboratory

Graduate School of Information Science and Technology

The University of Tokyo