Yuki Saito, Ph.D.

Language: EN/JP


I'm a Project Research Associate (post-doctoral researcher) in System #1 Lab. at the University of Tokyo.
My research interests are speech synthesis, voice conversion, machine learning, machine intelligence, and so on.

My CV is available [here].

Email: yuuki_saito {at} ipc.i.u-tokyo.ac.jp

Demonstrations:

Publications:

Journal Papers

  1. Satoshi Mizoguchi, Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "DNN-based low-musical-noise single-channel speech enhancement based on higher-order-moments matching," IEICE Transactions on Information and Systems, Vol. E104-D, No. 11, pp. 1971--1980, Nov. 2021. (J-STAGE)
  2. Takaaki Saeki, Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Real-time full-band voice conversion with sub-band modeling and data-driven phase estimation of spectral differentials," IEICE Transactions on Information and Systems, Vol. E104-D, No. 7, pp. 1002--1016, Jul. 2021. (2021 IEICE Journal Paper Award), (J-STAGE)
  3. Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Perceptual-similarity-aware deep speaker representation learning for multi-speaker generative modeling," IEEE/ACM Transactions on Audio, Speech, and Language Processing, Vol. 29, pp. 1033--1048, Feb. 2021. (IEEE Xplore, Poster at ICASSP2022)
  4. Yuki Saito, Taiki Nakamura, Yusuke Ijima, Kyosuke Nishida, and Shinnosuke Takamichi, "Non-parallel and many-to-many voice conversion using variational autoencoders integrating speech recognition and speaker verification," Acoustical Science and Technology, Vol. 42, No. 1, pp. 1--11, Jan. 2021. (J-STAGE)
  5. Yuki Saito, Kei Akuzawa, and Kentaro Tachibana, "Joint adversarial training of speech recognition and synthesis models for many-to-one voice conversion using phonetic posteriorgrams," IEICE Transactions on Information and Systems, Vol. 103-D, No. 9, pp. 1978--1987, Sep. 2020. (J-STAGE)
  6. Shinnosuke Takamichi, Ryosuke Sonobe, Kentaro Mitsui, Yuki Saito, Tomoki Koriyama, Naoko Tanji, and Hiroshi Saruwatari, "JSUT and JVS: free Japanese voice corpora for accelerating speech synthesis research," Acoustical Science and Technology, Vol. 41, No. 5, pp. 761--768, 2020. (J-STAGE)
  7. Shinnosuke Takamichi, Yuki Saito, Norihiro Takamune, Daichi Kitamura, and Hiroshi Saruwatari, "Phase reconstruction from amplitude spectrograms based on directional-statistics deep neural networks," Signal Processing, Vol. 169, pp. 107368, Apr. 2020. (ScienceDirect)
  8. Hiroki Tamaru, Yuki Saito, Shinnosuke Takamichi, Tomoki Koriyama, and Hiroshi Saruwatari, "Generative moment matching network-based neural double-tracking for synthesized and natural singing voices," IEICE Transactions on Information and Systems, Vol. E103-D, No. 3, pp. 639--647, Mar. 2020. (J-STAGE)
  9. Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Vocoder-free text-to-speech synthesis incorporating generative adversarial networks using low-/multi-frequency STFT amplitude spectra," Computer Speech and Language, Vol. 58, pp. 347--363, Nov. 2019. (ScienceDirect)
  10. Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Statistical parametric speech synthesis incorporating generative adversarial networks," IEEE/ACM Transactions on Audio, Speech, and Language Processing, Vol. 26, No. 1, pp. 84--96, Jan. 2018. (The 34th TELECOM System Technology Award for Students from TAF, IEEE Signal Processing Society Japan Student Journal Paper Award, 2020 IEEE SPS Young Author Best Paper Award), (IEEE Xplore)
  11. Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Voice conversion using input-to-output highway networks," IEICE Transactions on Information and Systems, Vol. E100-D, No. 8, pp. 1925--1928, Aug. 2017. (J-STAGE)

International Conferences (Peer-Reviewed)

  1. Yuki Saito, Yuto Nishimura, Shinnosuke Takamichi, Kentaro Tachibana, and Hiroshi Saruwatari, "STUDIES: Corpus of Japanese Empathetic Dialogue Speech Towards Friendly Voice Agent," Proc. INTERSPEECH, pp. xxxx--xxxx, Incheon, South Korea, Sep. 2022. (ACCEPTED) (Speech samples)
  2. Yuto Nishimura, Yuki Saito, Shinnosuke Takamichi, Kentaro Tachibana, and Hiroshi Saruwatari, "Acoustic Modeling for End-to-End Empathetic Dialogue Speech Synthesis Using Linguistic and Prosodic Contexts of Dialogue History," Proc. INTERSPEECH, pp. xxxx--xxxx, Incheon, South Korea, Sep. 2022. (ACCEPTED, Google Travel Grants for Students in East Asia) (Speech samples)
  3. Wataru Nakata, Tomoki Koriyama, Shinnosuke Takamichi, Yuki Saito, Yusuke Ijima, Ryo Masumura, and Hiroshi Saruwatari, "Predicting VQVAE-based Character Acting Style from Quotation-Annotated Text for Audiobook Speech Synthesis," Proc. INTERSPEECH, pp. xxxx--xxxx, Incheon, South Korea, Sep. 2022. (ACCEPTED) (Speech samples)
  4. Kenta Udagawa, Yuki Saito, and Hiroshi Saruwatari, "Human-in-the-loop Speaker Adaptation for DNN-based Multi-speaker TTS," Proc. INTERSPEECH, pp. xxxx--xxxx, Incheon, South Korea, Sep. 2022. (ACCEPTED) (Speech samples)
  5. Xuan Luo, Shinnosuke Takamichi, Tomoki Koriyama, Yuki Saito, and Hiroshi Saruwatari, "Emotion-controllable speech synthesis using emotion soft labels and fine-grained prosody factors," Proc. APSIPA ASC, pp. 794--799, Tokyo, Japan, Dec. 2021. (PDF, Speech samples)
  6. Detai Xin, Yuki Saito, Shinnosuke Takamichi, Tomoki Koriyama, and Hiroshi Saruwatari, "Cross-lingual speaker adaptation using domain adaptation and speaker consistency loss for text-to-speech synthesis," Proc. INTERSPEECH, pp. 1614--1618, Brno, Czech Republic, Sep. 2021. (PDF)
  7. Yota Ueda, Kazuki Fujii, Yuki Saito, Shinnosuke Takamichi, Yukino Baba, and Hiroshi Saruwatari, "HumanACGAN: conditional generative adversarial network with human-based auxiliary classifier and its evaluation in phoneme perception," Proc. ICASSP, pp. 6468--6472, Toronto, Canada, Jun. 2021. (PDF, arXiv preprint, Poster)
  8. Yuki Yamashita, Tomoki Koriyama, Yuki Saito, Shinnosuke Takamichi, Yusuke Ijima, Ryo Masumura, and Hiroshi Saruwatari, "Investigating effective additional contextual factors in DNN-based spontaneous speech synthesis," Proc. INTERSPEECH, pp. 3201--3205, Shanghai, China, Oct. 2020. (PDF)
  9. Detai Xin, Yuki Saito, Shinnosuke Takamichi, Tomoki Koriyama, and Hiroshi Saruwatari, "Cross-lingual text-to-speech synthesis via domain adaptation and perceptual similarity regression in speaker space," Proc. INTERSPEECH, pp. 2947--2951, Shanghai, China, Oct. 2020. (PDF) (Speech samples)
  10. Shunsuke Goto, Kotaro Ohnishi, Yuki Saito, Kentaro Tachibana, and Koichiro Mori, "Face2Speech: towards multi-speaker text-to-speech synthesis using an embedding vector predicted from a face image," Proc. INTERSPEECH, pp. 1321--1325, Shanghai, China, Oct. 2020. (PDF) (Demo)
  11. Takaaki Saeki, Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Real-time, full-band, online DNN-based voice conversion system using a single CPU," Proc. INTERSPEECH, pp. 1021--1022, Shanghai, China, Oct. 2020. (PDF, Video)
  12. Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "SMASH corpus: a spontaneous speech corpus recording third-person audio commentaries on gameplay," Proc. LREC, pp. 6573--6579, Marseille, France, May 2020. (PDF)
  13. Yuki Yamashita, Tomoki Koriyama, Yuki Saito, Shinnosuke Takamichi, Yusuke Ijima, Ryo Masumura, and Hiroshi Saruwatari, "DNN-based speech synthesis using abundant tags of spontaneous speech corpus," Proc. LREC, pp. 6440--6445, Marseille, France, May 2020. (PDF)
  14. Kazuki Fujii, Yuki Saito, Shinnosuke Takamichi, Yukino Baba, and Hiroshi Saruwatari, "HumanGAN: generative adversarial network with human-based discriminator and its evaluation in speech perception modeling," Proc. ICASSP, pp. 6239--6243, Barcelona, Spain, May 2020. (Main contribution paper for FujiSankei Business i Awards, Main contribution paper for National Institute of Technology Student Award) (PDF, arXiv preprint, Video)
  15. Takaaki Saeki, Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Lifter training and sub-band modeling for computationally efficient and high-quality voice conversion using spectral differentials," Proc. ICASSP, pp. 7784--7788, Barcelona, Spain, May 2020. (PDF, arXiv preprint, Video)
  16. Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "DNN-based speaker embedding using subjective inter-speaker similarity for multi-speaker modeling in speech synthesis," Proc. The 10th ISCA SSW, pp. 51--56, Vienna, Austria, Sep. 2019. (PDF, arXiv preprint, Poster)
  17. Taiki Nakamura, Yuki Saito, Shinnosuke Takamichi, Yusuke Ijima, and Hiroshi Saruwatari, "V2S attack: building DNN-based voice conversion from automatic speaker verification," Proc. The 10th ISCA SSW, pp. 161--165, Vienna, Austria, Sep. 2019. (PDF, arXiv preprint, Poster)
  18. Hiroki Tamaru, Yuki Saito, Shinnosuke Takamichi, Tomoki Koriyama, and Hiroshi Saruwatari, "Generative moment matching network-based random modulation post-filter for DNN-based singing voice synthesis and neural double-tracking," Proc. ICASSP, pp. 7070--7074, Brighton, United Kingdom, May 2019. (PDF, arXiv preprint, Poster, Demo)
  19. Masakazu Une, Yuki Saito, Shinnosuke Takamichi, Daichi Kitamura, Ryoichi Miyazaki and Hiroshi Saruwatari, "Generative approach using the noise generation models for DNN-based speech synthesis trained from noisy speech," Proc. APSIPA ASC, pp. 99--103, Hawaii, U.S.A., Nov. 2018. (Invited Special Session), (PDF, Slide)
  20. Shinnosuke Takamichi, Yuki Saito, Norihiro Takamune, Daichi Kitamura, and Hiroshi Saruwatari, "Phase reconstruction from amplitude spectrograms based on von-Mises-distribution deep neural network," Proc. IWAENC, pp. 286--290, Tokyo, Japan, Sep. 2018. (PDF, Poster)
  21. Yuki Saito, Yusuke Ijima, Kyosuke Nishida, and Shinnosuke Takamichi, "Non-parallel voice conversion using variational autoencoders conditioned by phonetic posteriorgrams and d-vectors," Proc. ICASSP, pp. 5274--5278, Alberta, Canada, Apr. 2018. (Grants for Researchers Attending International Conferences from NEC C&C, Outstanding Paper Award for Young C&C Researchers) (PDF, Poster)
  22. Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Text-to-speech synthesis using STFT spectra based on low-/multi-resolution generative adversarial networks," Proc. ICASSP, pp. 5299--5303, Alberta, Canada, Apr. 2018. (PDF, Poster)
  23. Hiroyuki Miyoshi, Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Voice conversion using sequence-to-sequence learning of context posterior probabilities," Proc. INTERSPEECH, pp. 1268--1272, Stockholm, Sweden, Aug. 2017. (PDF, Slide, Speech samples)
  24. Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Training algorithm to deceive anti-spoofing verification for DNN-based speech synthesis," Proc. ICASSP, pp. 4900--4904, New Orleans, U.S.A., Mar. 2017. (Spoken Language Processing Student Grant of ICASSP 2017), (PDF, Slide)
  25. Yuki Saito, and Hiroshi Tenmoto, "Construction of highly interpretable classification rule based on linear SVM," Proc. ISTS, Taipei, Taiwan, Nov. 2014.

Technical Reports

  1. Yuto Nishimura, Yuki Saito, Shinnosuke Takamichi, Kentaro Tachibana, and Hiroshi Saruwatari, "Empathetic dialogue synthesis considering textual and prosodic information of dialogue history," IPSJ SIG Technical Report, 2022-SLP-140, No. 16, pp. 1--6, Mar. 2022. (in Japanese) (PDF, Speech samples, Slide)
  2. Yusuke Nakai, Kenta Udagawa, Yuki Saito, and Hiroshi Saruwatari, "Training algorithm for multi-speaker TTS considering adversarial regularizer," IEICE Technical Report, SP2021-57, Vol. 121, No. 385, pp. 50--55, Mar. 2022. (in Japanese) (PDF, Speech samples, Slide)
  3. Wataru Nakata, Tomoki Koriyama, Shinnosuke Takamichi, Yuki Saito, Yusuke Ijima, Ryo Masumura, and Hiroshi Saruwatari, "Multi-speaker audiobook speech synthesis using discrete character acting styles acquired by VQVAE," IEICE Technical Report, SP2021-47, Vol. 121, No. 282, pp. 42--47, Dec. 2021. (PDF, Slide, Speech samples)
  4. Kazuki Fujii, Yuki Saito, and Hiroshi Saruwatari, "Japanese non-augoregressive end-to-end text-to-speech synthesis conditioned by prosodic information," IPSJ SIG Technical Report, 2021-SLP-138, No. 16, pp. 1--6, Oct. 2021. (PDF, Slide)
  5. Kenta Udagawa, Yuki Saito, and Hiroshi Saruwatari, "Speech synthesis adaptation based on human speech perception feedback," IEICE Technical Report, SP2021-33, Vol. 121, No. 202, pp. 46--51, Oct. 2021. (PDF, Slide, Speech samples)
  6. Masaki Kurata, Shinnosuke Takamichi, Takaaki Saeki, Riku Arakawa, Yuki Saito, Keita Higuchi, and Hiroshi Saruwatari, "A method for obtaining speaking characteristics based on real-time DNN-based voice conversion feedback," IPSJ SIG Technical Report, 2021-SLP-136, No. 31, pp. 1--6, Mar. 2021. (in Japanese) (PDF, Slide)
  7. Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Active learning for DNN-based speaker embedding considering subjective inter-speaker similarity," IPSJ SIG Technical Report, 2021-SLP-136, No. 30, pp. 1--6, Mar. 2021. (in Japanese, 2021 IPSJ SIG-SLP Best Student Paper Award (Yahoo! JAPAN Award)) (PDF, Slide)
  8. Kazuki Fujii, Yuki Saito, Shinnosuke Takamichi, Yukino Baba, and Hiroshi Saruwatari, "HumanGAN: generative adversarial networks based on human perception evaluation and its application in speech naturalness modeling," IEICE Technical Report, SP2020-06, Vol. 120, No. 57, pp. 15--20, June 2020. (in Japanese, Student Poster Award) (PDF)
  9. Satoshi Naitou, Yuki Saito, Shinnosuke Takamichi, Yasuyuki Saito, and Hiroshi Saruwatari, "Automatic estimation of breath position for singing VOCALOID song," IPSJ SIG Technical Report, 2020-MUS-127, No. 33, pp. 1--6, June 2020. (in Japanese) (PDF)
  10. Yuki Yamashita, Tomoki Koriyama, Yuki Saito, Shinnosuke Takamichi, Yusuke Ijima, Ryo Masumura, and Hiroshi Saruwatari, "The effectiveness of additional context in DNN-based spontaneous speech synthesis," IEICE Technical Report, SP2019-61, Vol. 119, No. 441, pp. 65--70, Mar. 2020. (in Japanese) (PDF)
  11. Takaaki Saeki, Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Lifter training and sub-band modeling for DNN-based voice conversion using spectral differentials," IPSJ SIG Technical Report, 2020-SLP-131, No. 2, pp. 1--6, Feb. 2020. (in Japanese) (PDF, Slide)
  12. Kazuki Fujii, Yuki Saito, Shinnosuke Takamichi, Yukino Baba, and Hiroshi Saruwatari, "HumanGAN: generative adversarial networks trained with human perception evaluation," Information-based Induction Sciences (IBIS) Workshop 2019, 2-037, Nov. 2019. (in Japanese) (Poster)
  13. Taiki Nakamura, Yuki Saito, Shinnosuke Takamichi, Yusuke Ijima, and Hiroshi Saruwatari, "Speaker V2S attack: statistical voice conversion built from speaker verification and its evaluation on speaker spoofing attack," Computer Security Symposium (CSS) 2019, 2E1-2, pp. 697--703, Oct. 2019. (in Japanese) (PDF, Slide)
  14. Shinnosuke Takamichi, Kentaro Mitsui, Yuki Saito, Tomoki Koriyama, Naoko Tanji, and Hiroshi Saruwatari, "JVS corpus: online available Japanese versatile speech corpus," IPSJ SIG Technical Report, 2019-SLP-129, No. 1, pp. 1--6, Oct. 2019. (in Japanese) (PDF, Slide)
  15. Hiroki Tamaru, Yuki Saito, Shinnosuke Takamichi, Tomoki Koriyama, and Hiroshi Saruwatari, "Generative moment matching network-based random modulation post-filter for singing voices synthesized using DNNs and its application to neural double-tracking," IPSJ SIG Technical Report, 2018-SLP-125, No. 1, pp. 1--6, Dec. 2018. (in Japanese) (PDF, Slide)
  16. Satoshi Mizoguchi, Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Evaluation of DNN-based low-musical-noise speech enhancement using kurtosis matching," IEICE Technical Report, EA2018-66, Vol. 118, No. 312, pp. 19--24, Nov. 2018. (in Japanese) (PDF, Poster)
  17. Shinnosuke Takamichi, Yuki Saito, Norihiro Takamune, Daichi Kitamura, and Hiroshi Saruwatari, "Phase reconstruction from amplitude spectra based on von Mises distribution DNN," IPSJ SIG Technical Report, 2018-SLP-122, No. 1, pp. 1--6, June 2018. (in Japanese, Presentation Award, IPSJ Yamashita SIG Research Award) (PDF, Poster)
  18. Yuki Saito, Yusuke Ijima, Kyosuke Nishida, and Shinnosuke Takamichi, "Non-parallel and many-to-many voice conversion using variational autoencoder conditioned by phonetic posteriorgrams and d-vectors," IEICE Technical Report, SP2017-88, Vol. 117, No. 517, pp. 21--26, Mar. 2018. (in Japanese, 2017 IEICE ISS Young Researcher's Award in Speech Field) (PDF, Slide)
  19. Masakazu Une, Yuki Saito, Shinnosuke Takamichi, Daichi Kitamura, Ryoichi Miyazaki and Hiroshi Saruwatari, "Generative adversarial training of the noise generation model for speech synthesis using speech in noise," IPSJ SIG Technical Report, 2017-SLP-118, No. 1, pp. 1--6, Oct. 2017. (in Japanese) (PDF, Slide)
  20. Hiroyuki Miyoshi, Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Voice conversion using sequence-to-sequence learning of context posterior probabilities and evaluation of the dual learning," IEICE Technical Report, SP2017-16, Vol. 117, No. 160, pp. 9--14, Jul. 2017. (in Japanese) (PDF, Slide)
  21. Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Training algorithm to deceive anti-spoofing verification for DNN-based text-to-speech synthesis," IPSJ SIG Technical Report, 2017-SLP-115, No. 1, pp. 1--6, Feb. 2017. (in Japanese) (PDF, Slide)
  22. Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Evaluation of DNN-based voice conversion deceiving anti-spoofing verification," IEICE Technical Report, SP2016-69, Vol. 116, No. 414, pp. 29--34, Jan. 2017. (in Japanese, Student Poster Award) (PDF, Poster)

Domestic Conferences

  1. Wataru Nakata, Tomoki Koriyama, Shinnosuke Takamichi, Yuki Saito, Yusuke Ijima, Ryo Masumura, and Hiroshi Saruwatari, "Audiobook speech synthesis based on character embedding for distinguishable character acting," Proc. ASJ, Spring meeting, 3-3-1, pp. 965--968, Mar. 2022. (in Japanese) (PDF)
  2. Yuki Saito, Yuto Nishimura, Shinnosuke Takamichi, Kentaro Tachibana, Hiroshi Saruwatari, " STUDIES: A Japanese empathetic dialogue speech corpus towards expressive speech synthesis," Proc. ASJ, Spring meeting, 2-3P-15, pp. 1133--1136, Mar. 2022. (in Japanese) (PDF, Speech samples)
  3. Yuki Saito, Kohei Yatabe, and Shogun, "Classification of SSBU characters from sounds generated by a controller while playing," Proc. ASJ, Spring meeting, 1-1Q-8, pp. 351--352, Mar. 2022. (PDF)
  4. Kenta Udagawa, Yuki Saito, and Hiroshi Saruwatari, "Investigating on search method for speaker adaptation of speech synthesis using human perceptual evaluation as feedback," Proc. ASJ, Spring meeting, 1-3-16, pp. 927--930, Mar. 2022. (in Japanese) (PDF)
  5. Xuan Luo, Shinnosuke Takamichi, Tomoki Koriyama, Yuki Saito, and Hiroshi Saruwatari, "Controllable text-to-speech synthesis using prosodic features and emotion soft-label," Proc. ASJ, Autumn meeting, 3-3-21, pp. 985--988, Sep. 2021. (in Japanese) (PDF)
  6. Yuki Saito and Hiroshi Saruwatari, "Investigation of effects caused by catastrophic forgetting in continual learning of end-to-end text-to-speech synthesis," Proc. ASJ, Autumn meeting, 1-3Q-8, pp. 1069--1072, Sep. 2021. (in Japanese) (PDF)
  7. Detai Xin, Yuki Saito, Shinnosuke Takamichi, Tomoki Koriyama, and Hiroshi Saruwatari, "Cross-lingual speaker adaptation using domain adaptation and speaker consistency loss for text-to-speech synthesis," Proc. ASJ, Autumn meeting, 1-3Q-8, pp. 1049--1052, Sep. 2021. (in Japanese) (PDF)
  8. Yota Ueda，Kazuki Fujii，Yuki Saito，Shinnosuke Takamichi，Yukino Baba，and Hiroshi Saruwatari， "HumanACGAN: conditional generative adversarial network using human-based auxiliary classifier and its evaluation in representing conditional distribution of phoneme perception," Proc. ASJ, Spring meeting, 1-2-14, pp. 819--822, Mar. 2021. (in Japanese) (PDF)
  9. Takaaki Saeki, Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Implementation and evaluation of real-time full-band DNN-based Voice Conversion based on sub-band filtering," Proc. ASJ, Autumn meeting, 1-2-11, pp. 715--718, Sep. 2020. (in Japanese) (Slide, PDF)
  10. Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "DNN-based speaker embedding using graph embedding of subjective inter-speaker similarity," Proc. ASJ, Autumn meeting, 1-2-4, pp. 697--698, Sep. 2020. (in Japanese, Awaya Prize Young Researcher Award of ASJ) (PDF, Slide)
  11. Kazuki Fujii, Yuki Saito, Shinnosuke Takamichi, Yukino Baba, and Hiroshi Saruwatari, "HumanGAN: generative adversarial network with human-based discriminator and its evaluation in naturalness modeling of speech," Proc. ASJ, Spring meeting, 3-P-40, pp. 1181--1184, Mar. 2020. (in Japanese) (PDF)
  12. Shinnosuke Takamichi, Kai Onuma, Taku Kaneda, Takashi Kaneda, Yuki Saito, Tomoki Koriyama, and Hiroshi Saruwatari, "Crowdsourcing-based parameter optimization for frequency warping-based speaker anonymization," Proc. ASJ, Spring meeting, 3-P-31, pp. 1159--1162, Mar. 2020. (in Japanese) (PDF)
  13. Shunsuke Goto, Kotaro Ohnishi, Yuki Saito, Kentaro Tachibana, and Koichiro Mori, "Multi-speaker text-to-speech synthesis using an embedding vector based on a face image," Proc. ASJ, Spring meeting, 2-Q-49, pp. 1141--1144, Mar. 2020. (in Japanese) (PDF, poster)
  14. Takaaki Saeki, Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Sub-band lifter-training method for full-band voice conversion using spectral differentials," Proc. ASJ, Spring meeting, 2-2-5, pp. 1085--1088, Mar. 2020. (in Japanese) (PDF)
  15. Shinnosuke Takamichi, Yuki Saito, Tomohiko Nakamura, Tomoki Koriyama, and Hiroshi Saruwatari, "manga2voice: speech analysis towards audio synthesis from comic image," Proc. ASJ, Spring meeting, 1-2-15, pp. 1065--1068, Mar. 2020. (in Japanese) (PDF)
  16. Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "SMASH corpus: spontaneous speech corpus of audio commentaries on gameplay," Proc. ASJ, Spring meeting, 1-2-14, pp. 1061--1064, Mar. 2020. (in Japanese) (PDF, Slide)
  17. Satoshi Naitou, Yuki Saito, Shinnosuke Takamichi, Yasuyuki Saito, and Hiroshi Saruwatari, "Estimation of breath position for VOCALOID song sung by user," Proc. ASJ, Spring meeting, 1-2-12, pp. 1057--1058, Mar. 2020. (in Japanese) (PDF)
  18. Yuki Saito, Kei Akuzawa, and Kentaro Tachibana, "Joint adversarial training algorithm of speech recognition and synthesis models for many-to-one voice conversion using phonetic posteriorgrams," Proc. ASJ, Autumn meeting, 2-4-2, pp. 963--966, Sep. 2019. (in Japanese) (PDF, Slide)
  19. Takaaki Saeki, Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Filter estimation for computational complexity reduction of DNN-based voice conversion using spectral differentials," Proc. ASJ, Autumn meeting, 2-4-1, pp. 961--962, Sep. 2019. (in Japanese) (PDF, Slide)
  20. Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Evaluation of DNN-based multi-speaker speech synthesis using DNN-based speaker embedding considering subjective inter-speaker similarity," Proc. ASJ, Autumn meeting, 1-P-18, pp. 999--1002, Sep. 2019. (in Japanese) (PDF, Poster)
  21. Hiroki Tamaru, Yuki Saito, Shinnosuke Takamichi, Tomoki Koriyama, and Hiroshi Saruwatari, "Neural double-tracking based on generative moment matching network for users' singing," Proc. ASJ, Autumn meeting, 1-4-2, pp. 935--938, Sep. 2019. (in Japanese) (PDF, Slide)
  22. Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "DNN-based speaker embedding considering subjective inter-speaker similarity towards DNN-based speech synthesis," Proc. ASJ, Spring meeting, 3-10-7, pp. 1067--1070, Mar. 2019. (in Japanese) (PDF, Slide)
  23. Taiki Nakamura, Yuki Saito, Kyosuke Nishida, Yusuke Ijima, and Shinnosuke Takamichi, "Evaluation of VAE-based non-parallel and many-to-many voice conversion conditioned by phonetic posteriorgrams and d-vectors in terms of training data and dimensionality of d-vectors," Proc. ASJ, Spring meeting, 2-P-30, pp. 1149--1150, Mar. 2019. (in Japanese) (PDF, Poster)
  24. Hiroki Tamaru, Yuki Saito, Shinnosuke Takamichi, Tomoki Koriyama, and Hiroshi Saruwatari, "Generative moment matching network-based random modulation post-filter for singing voices and its application to double-tracking," Proc. ASJ, Spring meeting, 2-10-5, pp. 1035--1038, Mar. 2019. (in Japanese, IEEE Signal Processing Society Tokyo Joint Chapter Student Award) (PDF)
  25. Satoshi Mizoguchi, Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Low-musical-noise DNN-based speech enhancement applied to noise with various kurtosis," Proc. ASJ, Spring meeting, 1-6-6, pp. 185--188, Mar. 2019. (in Japanese) (PDF)
  26. Shinnosuke Takamichi, Yuki Saito, Norihiro Takamune, Daichi Kitamura, and Hiroshi Saruwatari, "Phase reconstruction from amplitude spectrograms based on directional-statistics DNNs," Proc. ASJ, Autumn meeting, 2-4-2, pp. 1127--1130, Sep. 2018. (in Japanese) (PDF, Slide)
  27. Satoshi Mizoguchi, Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Low-musical-noise speech enhancement based on DNNs and kurtosis matching," Proc. ASJ, Autumn meeting, 2-1-7, pp. 177--180, Sep. 2018. (in Japanese, Student Presentation Award) (PDF, Slide)
  28. Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Adversarial DNN-based speech synthesis using multi-frequency resolution STFT spectra," Proc. ASJ, Spring meeting, 3-8-14, pp. 259--262, Mar. 2018. (in Japanese) (PDF, Slide)
  29. Masakazu Une, Yuki Saito, Shinnosuke Takamichi, Daichi Kitamura, Ryoichi Miyazaki and Hiroshi Saruwatari, "Generative approach using the noise generation models for DNN-based speech synthesis trained from noisy speech," Proc. ASJ, Spring meeting, 3-8-8, pp. 243--244, Mar. 2018. (in Japanese) (PDF, Slide)
  30. Shinnosuke Takamichi, Tomoki Koriyama, Yuki Saito, and Hiroshi Saruwatari, "Evaluation of inter-utterance variation in speech synthesis based on moment-matching networks," Proc. ASJ, Autumn meeting, 1-8-9, pp. 195--196, Sep. 2017. (in Japanese) (PDF, Slide)
  31. Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Experimental investigation of divergences in adversarial DNN-based speech synthesis," Proc. ASJ, Autumn meeting, 1-8-7, pp. 189--192, Sep. 2017. (in Japanese) (PDF, Slide)
  32. Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "F0 contour and duration generation for adversarial DNN-based speech synthesis," Proc. ASJ, Spring meeting, 2-6-6, pp. 257--258, Mar. 2017. (in Japanese) (PDF, Slide)
  33. Hiroyuki Miyoshi, Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Voice conversion using sequence-to-sequence learning of context posterior probabilities," Proc. ASJ, Spring meeting, 1-6-15, pp. 237--238, Mar. 2017. (in Japanese) (PDF, Slide)
  34. Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Adversarial DNN-based voice conversion based on spectral differentials using highway networks," Proc. ASJ, Spring meeting, 1-6-14, pp. 235--236, Mar. 2017. (in Japanese, IEEE Signal Processing Society Tokyo Joint Chapter Student Award) (PDF, Slide)
  35. Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "Training algorithm considering anti-spoofing verification for DNN-based speech synthesis," Proc. ASJ, Autumn meeting, 3-5-1, pp. 149--150, Sep. 2016. (in Japanese, Student Presentation Award) (PDF, Slide)

Dissertations

  1. Yuki Saito (adviser: Professor Hiroshi Saruwatari), "Statistical speech synthesis based on human's speech information processing abilities," Ph.D. Thesis, Graduate School of Information Science and Technology, the University of Tokyo, 2021. (Dean's Award) (PDF, Slide)
  2. Yuki Saito (supervisor: Professor Hiroshi Saruwatari), "High-quality statistical parametric speech synthesis using generative adversarial networks," M.S. Thesis, Graduate School of Information Science and Technology, the University of Tokyo, 2018. (PDF, Slide)

Competitive Funds:

  1. Grant-in-Aid for Young Scientists, Japan Society of the Promotion of Science (JSPS), 3,600,000 JPY, Apr. 2022--Mar. 2025.
  2. Research Grant (A) from Tateisi Science and Technology Foundation, 2,200,000 JPY, Apr. 2022--Mar. 2023.
  3. Grant-in-Aid for Research Activity Start-up, Japan Society of the Promotion of Science (JSPS), 2,400,000 JPY, Sep. 2021--Mar. 2023.
  4. KIOXIA Incentive Research, 1,000,000 JPY, Jun. 2021--Mar. 2022.
  5. Grant-in-Aid for JSPS Fellows, the Japan Society of the Promotion of Science (JSPS), 2,500,000 JPY, May 2018--Mar. 2021.
  6. Grants for Researchers Attending International Conferences from NEC C&C, 250,000 JPY, Apr. 2018.

Awards:

  1. 2021 IEICE Journal Paper Award, Jun. 2022.
  2. 2021 IPSJ SIG-SLP Best Student Paper Award (Yahoo! JAPAN Award), Mar. 2022.
  3. 2020 IEEE SPS Young Author Best Paper Award, Jun. 2021.
  4. Dean's Award, Graduate School of Information Science and Technology, The University of Tokyo, Mar. 2021.
  5. The 49th Awaya Prize Young Researcher Award of ASJ, Mar. 2021.
  6. Outstanding Paper Award for Young C&C Researchers, Jan. 2019.
  7. The 12th IEEE Signal Processing Society Japan Student Journal Paper Award, Nov. 2018.
  8. 2017 IEICE ISS Young Researcher's Award in Speech Field, Aug. 2018.
  9. Partial Exemption from Repayment of Scholarship Loan for Students with Outstanding Results, Japan Student Services Organization (JASSO), May 2018.
  10. The 34th TELECOM System Technology Award for Students from TAF, Mar. 2018.
  11. The 1st IEEE Signal Processing Society Tokyo Joint Chapter Student Award, Nov. 2017.
  12. Spoken Language Processing Student Grant of ICASSP, Mar. 2017.
  13. 2017 IEICE ISS Student Poster Award, Jan. 2017.
  14. The 14th Best Student Presentation Award of ASJ, Mar. 2017.
  15. Graduation Research Award, Advanced Course of Electronic and Information Systems Engineering, National Institute of Technology, Kushiro College, Feb. 2016.
  16. Dean's Award, Department of Information Engineering, National Institute of Technology, Kushiro College, Mar. 2014.

Co-author's Awards:

  1. Google Travel Grants for Students in East Asia, Jul. 2022. (Awardee: Yuto Nishimura)
  2. National Institute of Technology Student Award, Mar. 2021. (Awardee: Kazuki Fujii)
  3. IPSJ SIG-MUS/SLP Student Poster Award, June 2020. (Awardee: Kazuki Fujii)
  4. FujiSankei Business i Awards, June 2020. (Awardee: Kazuki Fujii)
  5. IPSJ Yamashita SIG Research Award, Mar. 2020. (Awardee: Shinnosuke Takamichi)
  6. The 3rd IEEE Signal Processing Society Tokyo Joint Chapter Student Award, Dec. 2019. (Awardee: Hiroki Tamaru)
  7. The 18th Best Student Presentation Award of ASJ, Mar. 2019. (Awardee: Satoshi Mizoguchi)
  8. IPSJ SIG-MUS/SLP Presentation Award, June 2018. (Awardee: Shinnosuke Takamichi)

Professional Activities:

  1. Paper Reviews for APSIPA Transactions on Signal and Information Processing (from 2021)
  2. Paper Reviews for EURASIP Journal on Audio Speech and Music Processing (from 2021)
  3. Paper Reviews for INTERSPEECH (from 2021)
  4. Paper Reviews for IEEE Access (from 2021)
  5. Paper Reviews for IEEE/ACM Transactions on Audio, Speech, and Language Processing (from 2020)
  6. Paper Reviews for IEEE MLSP (from 2019)
  7. Paper Reviews for IEEE Signal Processing Letter (from 2018)
  8. Paper Reviews for IEEE ICASSP (from 2018)

Research and Work Experiences:

  1. Project Research Associate of The University of Tokyo, Japan. Apr. 1, 2021--xxx. xx, 2025. ("Research and Development on Acoustic Information Processing and Voice Conversion," Moonshot Research & Development Program of Japan Science and Technology Agency, Representative: Hiroshi Saruwatari) (Project)
  2. Research assistant of The University of Tokyo, Japan. Apr. 1, 2019--Mar. 31, 2021. ("Stress-free, real-time, and full-band voice conversion based on perceptual models," executed under the Commissioned Research of MIC SCOPE 182103104, Representative: Shinnosuke Takamichi) (Project)
  3. Short-time researcher in DeNA Co., Ltd., Japan, Oct. 1, 2018--Mar. 31, 2019 & June 1, 2019--Mar. 31, 2020. (Mentor: Kentaro Tachibana)
  4. Research fellow (DC1) of Japan Society for the Promotion of Science, Japan, Apr. 1, 2018--Mar. 31, 2021. ("Active speech synthesis based on listener perceptual modeling," JSPS KAKENHI 18J22090, Representative: Yuki Saito) (KAKEN) (Project)
  5. Short-time researcher in NTT Media Intelligence Laboratories, NTT Corporation, Japan, Aug. 30, 2017--Oct. 31, 2017. (Mentor: Yusuke Ijima)
  6. Short-time researcher in NTT Communication Science Laboratories, NTT Corporation, Japan, Aug. 8, 2016--Sep. 9, 2016. (Mentor: Hirokazu Kameoka)

Volunteer Works:

  1. Acoustical Society of Japan (ASJ) Students and Young Researchers Forum, Organizing member (from Mar. 2017) and Vice President (from Apr. 2019 to Mar. 2022)

Speech Corpora:

  1. Yuki Saito, Shinnosuke Takamichi, and Hiroshi Saruwatari, "SMASH Corpus: A spontaneous speech corpus recording third-person audio commentaries on gameplay," Jul. 2022. (URL)
  2. Yuki Saito, Yuto Nishimura, Shinnosuke Takamichi, Kentaro Tachibana, and Hiroshi Saruwatari, "STUDIES Corpus: Japanese empathetic dialogue speech corpus," Mar. 2022. (URL, arXiv preprint)
  3. Shinnosuke Takamichi, Kentaro Mitsui, Yuki Saito, Tomoki Koriyama, Naoko Tanji, and Hiroshi Saruwatari, "JVS corpus: free Japanese multi-speaker voice corpus," Aug. 2019. (URL, arXiv preprint)

Lectures:

Education:

Misc.: