EntropyMoE: Entropy-Aware Sparse Expert Routing for Tokenizer-Free LLMs

arXiv:2608.06398v1 Announce Type: new Abstract: Recent bytelevel large language models LLMs have made tokenizerfree modeling increasingly competitive by grouping bytes into dynamically sized patches.