A Refutation of Finite-State Language Models through Zipf’s Law for Factual Knowledge
Łukasz Dębowski • Entropy
(2021)
We present a hypothetical argument against finite-state processes in statistical language modeling that is based on semantics rather than syntax. In this theoretical model, we suppose that the semantic properties of texts in a natural langu...
DOAJ
Open Access (DOAJ)
DOI:
10.3390/e23091148