CV

Detailed curriculum vitae is here📄

Publications

International Conference

• Miyu Oba, Yohei Oseki, Akiyo Fukatsu, Akari Haga, Hiroki Ouchi, Taro Watanabe, Saku Sugawara. “Can Language Models Induce Grammatical Knowledge from Indirect Evidence?” Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP-2024, Main, long), 2024/11 (to appear) [paper | arXiv]
• Akari Haga, Saku Sugawara, Akiyo Fukatsu, Miyu Oba, Hiroki Ouchi, Taro Watanabe, Yohei Oseki. “Modeling Overregularization in Children with Small Language Models.” Findings of the 62nd Annual Meeting of the Association for Computational Linguistics (ACL-2024, Findings, long), 2024/08. [paper | arXiv]
• Miyu Oba, Akari Haga, Akiyo Fukatsu, Yohei Oseki. “BabyLM Challenge: Curriculum learning based on sentence complexity approximating language acquisition”, the BabyLM Challenge at the 27th Conference on Computational Natural Language Learning, 2023/12. [paper | arXiv]
• Miyu Oba, Tatsuki Kuribayashi, Hiroki Ouchi, Taro Watanabe. “Second Language Acquisition of Neural Language Models.” Findings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL-2023, Findings, long), 2023/07. [paper | arXiv]

Journal

• 大羽未悠, 栗林樹生, 大内啓樹, 渡辺太郎. 言語モデルの第二言語獲得. 自然言語処理 (domestic journal), Volume 31, Number 2, pp.433-455, 2024/06. [paper]

Dometic Conference

• 尾崎 慎太郎, 林 和樹, 大羽 未悠, 坂井 優介, 上垣外 英剛, 渡辺 太郎. マルチモーダル大規模言語モデルは非言語コミュニケーションを理解しているか？. 第19回NLP若手の会 シンポジウム (YANS), 2024/09. [ Encouragement Award (奨励賞) received to 1st author ]
• 井手佑翼, 西田悠人, 大羽未悠, 坂井優介, Justin Vasselli, 渡辺太郎, 上垣外英剛. 大規模言語モデルに適した容認性判断手法の検討. 第260回自然言語処理研究会, 8pages, 2024/06. [ Young Researcher Award (若手奨励賞) receive to 1st author ] [paper]
• 大羽未悠, 大関洋平, 深津聡世, 芳賀あかり, 大内啓樹, 渡辺太郎, 菅原朔. 言語モデルの文法知識評価における間接肯定証拠の分析. 言語処理学会第30回年次大会, 4pages, 2024/3. [paper]
• 芳賀あかり, 菅原朔, 深津聡世, 大羽未悠, 大内啓樹, 渡辺太郎, 大関洋平. 小規模言語モデルによる子供の過剰一般化のモデリング. 言語処理学会第30回年次大会, 4pages, 2024/3. [paper]
• 大羽未悠, 芳賀あかり, 深津聡世, 大関洋平. 言語獲得過程を模倣した文の複雑さに基づくカリキュラム学習. 第18回NLP若手の会 シンポジウム (YANS), 2023/08.
• 大羽未悠, 栗林樹生, 大内啓樹, 渡辺太郎. 言語モデルの第二言語獲得. 言語処理学会第29回年次大会, 4pages, 2023/3. [ Young Researcher Award (若手奨励賞) ] [paper]
• 大羽未悠, 栗林樹生, 大内啓樹, 渡辺太郎. 言語モデルの第二言語獲得効率. 第254回自然言語処理研究会, 6pages, 2022/11. [ IPSJ Yamashita SIG Research Award (山下記念研究賞), Best Paper Award (優秀研究賞) ] [paper]
• 大羽未悠, 栗林樹生, 大内啓樹, 渡辺太郎. 言語モデルの第二言語獲得効率. 第17回NLP若手の会 シンポジウム (YANS), 2022/08. [ Encouragement Award (奨励賞) ]

Education

• 2024/04-present: Doctor of Engineering, Division of Information Science, NARA Institute of Science and Technology
  • Research on natural language processing, computational (psycho)linguistics
• 2023/04-2024/03: Master of Engineering, Division of Information Science, NARA Institute of Science and Technology
  • Research on natural language processing, computational (psycho)linguistics
• 2018/04-2022/03: Bachelor of Foreign Studies, Department of French Studies, Nanzan University
  • Study of linguistics and french culture
• 2015/04-2018/03: High School Diploma, Meiwa High School

Experiences

• 2024/10-: Guest Researcher
  • University of Göttingen, Germany
  • Supervisor: Lisa Beinborn
  • Cognitive-inspired multilingual language processing
• 2023/04-: Research Assistant
  • National Institute of Informatics
  • Supervisor: Saku Sugawara
  • Survey papers on Linguistics and Cognitive science related to Natural language processing.
• 2022/08-2023/01: Natural Language Processing R&D Engineer
  • Trustworthy AI team, LINE Corp.
  • Work on Ethics for NLP
  • Survey and implement evaluation methods for fairness of language models
• 2020/06-2022/03: Data Scientist
  • ROX Inc.
  • Demand forecasting, data analysis in the logistics and retail sectors
  • Development of applications using forecast data

Grants

• 2024/04-Present: NAIST Granite Program (PhD Scholarship; JST SPRING)
• 2022/04-2024/03: JASSO Scholarship: Full Repayment exemption due to outstanding achievements (特に優れた業績による全額返済免除)
• 2023/07: ACL SRW Travel Grants

Activities/Talks/Interviews

• 2023/08: Present the highly intersted research “How to Plant Trees in Language Models: Data and Architectural Effects on the Emergence of Syntactic Inductive Biases” at 最先端NLP勉強会 [slides]
• 2023/03: Graduate student interview with Gender Equality Promotion Office [page]
• 2023/03: 言語モデルの第二言語獲得 -研究のきっかけとこれから-. 言語処理学会第29回年次大会ワークショップ 深層学習時代の計算言語学. [page]
• 2021/12: Fundamental Information Technology Engineer Examination (FE; 基本情報技術者試験)
• 2020/12: JPHACKS2020 (Domestic Hackathon) [ Finalists, NTT Resonant Award & Studio Arcana Award ]
• 2020/11: Call for Code2020 (International Hackathon) [ Regional Finalists (日本上位4位) ]
• 2020/09: TOEIC 855
• 2020/06: Build＠Mercari (Software Engineer Training Program)