Rintaro Yanagi
Researcher,
Computer Vision Research Team,
Artificial Intelligence Research Center,
National Institute of Advanced Industrial Science and Technology (AIST)
WebPage
[Google Scholar] 🏢 Central 1, 1-1-1 Umezono, Tsukuba, Ibaraki 305-8560, JAPAN 📧 rintaro.yanagi [at] aist.go.jp
About me
I am a researcher with the Computer Vision Research Team at the National Institute of Advanced Industrial Science and Technology (AIST) [site]. My research interests lie in vision and language, generative models, retrieval, and interaction. I am passionate about developing AI systems that can achieve goals through user-centered interaction.
Work Experience
- Apr, 2024 – present Researcher, Computer Vision Research Team, National Institute of Advanced Industrial Science and Technology
Education
- Apr, 2021 – Mar, 2024 Ph.D., Information Science and Technology, Hokkaido University
- Apr, 2019 – Mar, 2021 MS, Information Science and Technology, Hokkaido University
- Apr, 2015 – Mar, 2019 B.S., Department of Engineering, Hokkaido University
Publications
Journal Articles
- AMDIS: Amplitude dissimilarity reduced reference IQA metric for neural radiance, Ren Togo, Rintaro Yanagi, Masato Kawai, Takahiro Ogawa, Miki Haseyama. IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences.
- Parameter-efficient tuning of cross-modal retrieval for a specific database via trainable textual and visual prompts, Huaying Zhang, Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama, International Journal of Multimedia Information Retrieval.
- Material compound-property retrieval using electron microscope images for rubber material development, Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama, IEEE Access.
- Cross-modal image retrieval considering semantic relationships with many-to-many correspondence loss, Huaying Zhang, Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama, IEEE Access.
- Recallable question answering-based re-ranking considering semantic region for cross-modal retrieval, Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama, IEEE Open Journal of Signal Processing.
- Interactive re-ranking via object entropy-guided question answering for cross-modal image retrieval, Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama, ACM Transactions on Multimedia Computing, Communications, and Applications.
- Domain Adaptive Cross-Modal Image Retrieval via Modality and Domain Translations, Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama, IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences.
- Enhancing cross-modal retrieval based on modality-specific and embedding spaces, Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama, IEEE Access.
- Text-to-Image GAN-based scene retrieval and re-ranking considering word importance, Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama, IEEE Access.
- Query is gan: Scene retrieval with attentional text-to-image generative adversarial network, Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama, IEEE Access.
Conference/Workshop Papers
- Boosting synthetic data for VLMs via diffusion noise optimization, Ren Ohkubo, Rintaro Yanagi, Hirokatsu Kataoka, Yutaka Satoh, CVPR Workshop SynData4CV.
- GASR: Generated artwork dataset for image super-resolution, Noritake Kodama, Go Ohtani, Yuto Matsuo, Rintaro Yanagi, Nakamasa Inoue, Yoshimitsu Aoki, Hirokatsu Kataoka, CVPR Workshop SynData4CV.
- DQG: Database question generation for exact text-based image retrieval, Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama, ACM International Conference on Multimedia.
- Zero-shot composed image retrieval considering query-target relationship leveraging masked image-text pairs, Huaying Zhang, Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama, IEEE International Conference on Image Processing.
- Learning 3d point cloud registration as a single optimization problem, Rintaro Yanagi, Atsushi Hashimoto, Naoya Chiba, Yoshitaka Ushiku, Asian Conference on Computer Vision.
- Personalized content recommender system via non-verbal interaction using face mesh and Facial Expression, Yuya Moroto, Rintaro Yanagi, Naoki Ogawa, Kyohei Kamikawa, Keigo Sakurai, Ren Togo, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama, ACM International Conference on Multimedia Demo Track.
- Reference-based dense pose estimation via partial 3D point cloud matching, Rintaro Yanagi, Atsushi Hashimoto, Naoya Chiba, Yoshitaka Ushiku, ACM International Conference on Multimedia Demo Track.
- Parameter-efficient Tuning of a pre-trained model via prompt learning in cross-modal retrieval, Huaying Zhang, Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama, IEEE International Conference on Consumer Electronics-Taiwan.
- Rubber material retrieval system using electron microscope images for rubber material development, Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama, ACM International Conference on Multimedia Demo Track.
- Free-viewpoint sports video generation based on dynamic NeRF considering time series, Masato Kawai, Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama, IEEE Global Conference on Consumer Electronics.
- Cross-modal image retrieval considering semantic relationships with object information, Huaying Zhang, Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama, IEEE Global Conference on Consumer Electronics.
- Database-adaptive re-ranking for enhancing cross-modal image retrieval, Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama, ACM International Conference on Multimedia.
- IR Questioner: QA-based interactive retrieval system, Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama, ACM International Conference on Multimedia Retrieval.
- Interactive re-ranking for cross-modal retrieval based on object-wise question answering, Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama, ACM International Conference on Multimedia Asia.
- Image retrieval with lingual and visual paraphrasing via generative models, Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama, IEEE International Conference on Image Processing.
- Image retrieval with data augmentation of sentence labels based on paraphrasing, Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama, IEEE International Conference on Consumer Electronics-Taiwan.
- Voice-input multimedia information retrieval system based on Text-to-image GAN, Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama, IEEE Global Conference on Consumer Electronics Demo Track.
- Scene retrieval using text-to-image GAN-based visual similarities and image-to-text model-based textual similarities, Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama, IEEE Global Conference on Consumer Electronics.
- Scene retrieval from multiple resolution generated images based on text-to-image GAN, Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama, IEEE International Symposium on Circuits and Systems.
- Image retrieval from vague description based on AttnGAN, Rintaro Yanagi, Ren Togo, Takahiro Ogawa, Miki Haseyama, IEEE Global Conference on Consumer Electronics.
Awards
- Dean’s Award at Hokkaido University Graduate School of Information Science and Technology (Ph.D.)
- The 2022 IEEE Sapporo Section Student Paper Contest Encouraging Prize
- IEEE GCCE 2022 Excellent Poster Award Silver Prize
- 2021 IEEE Sapporo Section Paper Awards, Encouragement Award Winner
- Dean’s Award at Hokkaido University Graduate School of Information Science and Technology(MS)
- Best Paper Runner-up Award of ACM Multimedia Asia 2020
- 2020 IEEE Sapporo Section Paper Awards, Best Paper Award Winner
- 2019 IEEE 8th Global Conference on Consumer Electronics (GCCE 2019) Outstanding Prize IEEE GCCE2019 Excellent Demo! Award