Microsoft

BEAST: Efficient Tokenization of B-Splines Encoded Action Sequences for Imitation Learning

We present the B-spline Encoded Action Sequence Tokenizer (BEAST), a novel action tokenizer that encodes action sequences into compact discrete or continuous tokens using B-splines. In contrast to ...
IEEE

Optimizing Byte Pair Encoding Tokenization for South African Languages

Abstract: In this paper, we introduce an Optimized Byte Pair Encoding (OBPE) tokenizer where the algorithm is optimized for the South African languages, including Sesotho, Setswana, Xhosa, Xitsonga, ...
marktechpost

Apple Researchers Propose a Novel AI Algorithm to Optimize a Byte-Level Representation for Automatic Speech Recognition ASR and Compare it with UTF-8 Representation

End-to-end (E2E) neural networks have emerged as flexible and accurate models for multilingual automatic speech recognition (ASR). However, as the number of supported languages increases, particularly ...
Microsoft

Microsoft at ICML 2024: Innovations in machine learning

In an era increasingly steered by data, machine learning is a pivotal force, transforming vast amounts of information into actionable intelligence with unprecedented speed and accuracy. For example, ...
marktechpost

T-FREE: A Tokenizer-Free Approach for Efficient and Scalable Text Encoding in Large Language Models

Natural language processing (NLP) drives researchers to develop algorithms that enable computers to understand, interpret, and generate human languages. These efforts cover various applications, such ...