All-in-One Multilingual Scene Text Recognizer Powered by Script-Aware Mixture‑of‑Experts
training
| Source: HF Papers | Original article
Researchers propose an all‑in‑one multilingual scene text recognizer that uses a script‑aware mixture‑of‑experts to handle diverse scripts without needing separate models.
A new paper released on 20 September proposes an “all‑in‑one” multilingual scene‑text recogniser that sidesteps the two main obstacles that have long hampered optical‑character‑recognition for non‑Latin scripts: a chronic shortage of labelled training data and the engineering overhead of maintaining separate models for each language.
The authors introduce Script‑aware Mixture‑of‑Experts (ScriptMoE), a sparsely‑gated architecture that routes image features to script‑specific expert sub‑networks while keeping the overall model size comparable to a single‑language recogniser. To train the system they built TextMuSS‑10M, a synthetic dataset that spans ten writing systems and 229 languages, deliberately balanced to supply supervision where real‑world samples are scarce. According to the authors, the resulting recogniser is lighter than contemporary vision‑language models, yet delivers higher accuracy than both monolithic multilingual nets and collections of per‑language experts.
If the claims hold up, the approach could reshape how companies deploy OCR in multilingual environments—from retail signage in Scandinavia to public‑transport displays across Europe and beyond. By eliminating the need for a fleet of language‑specific models, developers can cut inference costs and reduce error propagation that arises when multiple recognisers are chained together.
The work arrives on the heels of renewed interest in mixture‑of‑experts techniques, such as the block‑level conditioning framework reported earlier this month. Observers will be watching for benchmark results on standard STR suites, open‑source releases of the codebase (currently hosted on GitHub), and any follow‑up studies that extend ScriptMoE to additional scripts or integrate it with larger vision‑language pipelines. Early adoption by OCR service providers could provide the first real‑world validation of the method’s promised efficiency and accuracy gains.
Sources
Back to AIPULSEN