"This study is the first attempt to apply the masked language modeling approach to corrupted inscriptions in Hebrew and Aramaic languages, both using the Hebrew alphabet consisting mostly of consonant symbols. In our experiments, we evaluate several transformer-based models, which are fine-tuned on the Biblical texts and tested on three different percentages of randomly masked parts in the testing corpus."

Niv Fono, Harel Moshayof, Eldar Karol, Itai Assraf, and Mark Last. 2024. Embible: Reconstruction of Ancient Hebrew and Aramaic Texts Using Transformers. In Findings of the Association for Computational Linguistics: EACL 2024, pages 846–852, St. Julian’s, Malta. Association for Computational Linguistics.

https://aclanthology.org/2024.findings-eacl.56

#ComputationalLinguistics #Linguistics #Ancient #Hebrew #Aramaic #Language #Languages @linguistics