Tomoya Iwakura | DeepAI

DeepAI

AI Chat AI Image Generator AI Video AI Music Voice Chat Ghibli AI

Featured Co-authors

Tatsuya Hiraoka
6 publications

research

∙ 04/21/2023

Tokenization Tractability for Human and Machine Learning Model: An Annotation Study

Is tractable tokenization for humans also tractable for machine learning...

0 Tatsuya Hiraoka, et al. ∙

research

∙ 04/21/2023

Downstream Task-Oriented Neural Tokenizer Optimization with Vocabulary Restriction as Post Processing

This paper proposes a method to optimize tokenization for the performanc...

0 Tatsuya Hiraoka, et al. ∙