vix.ing · top · new · best · stats · spec

Quantitative Entropy Study of Language Complexity

2016/11/14 by Xie, R. R., Deng, W. B., Wang, D. J. +1
#Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Physical sciences #Physics and Society (physics.soc-ph)

paper · doi:10.48550/arxiv.1611.04841

Abstract

We study the entropy of Chinese and English texts, based on characters in case of Chinese texts and based on words for both languages. Significant differences are found between the languages and between different personal styles of debating partners. The entropy analysis points in the direction of lower entropy, that is of higher complexity. Such a text analysis would be applied for individuals of different styles, a single individual at different age, as well as different groups of the population.

Related