product iamge

Experiments on predictability of word in context and information rate in natural language

This document was uploaded by one of our users. The uploader already confirmed that they had the permission to publish it. If you are author/publisher or own the copyright of this documents, please report to us by using this DMCA report form.

Download
Search on Amazon

Simply click on the Download Book button.

Yes, Book downloads on Ebookily are 100% Free.

Sometimes the book is free on Amazon As well, so go ahead and hit "Search on Amazon"

J. Information Processes 6(3), 229-236
December 26, 2006
14 pages
Abstract
Based on data from a large-scale experiment with human subjects, we conclude that the logarithm of probability to guess a word in context (unpredictability) depends linearly on the word length. This result holds both for poetry and prose, even though with prose, the subjects don't know the length of the omitted word.
We hypothesize that this e ffect re flects a tendency of natural language to have an even
information rate.

Author(s): Manin Yu.

Language: English
Commentary: 567453
Tags: Языки и языкознание;Лингвистика;Прикладная лингвистика;Матметоды и моделирование в лингвистике