Received: from mail-ey0-f189.google.com ([209.85.215.189]:52123) by stodi.digitalkingdom.org with esmtps (TLSv1:RC4-SHA:128) (Exim 4.76) (envelope-from ) id 1Sinn4-0000No-E6; Sun, 24 Jun 2012 07:28:01 -0700 Received: by eaad14 with SMTP id d14sf2357329eaa.16 for ; Sun, 24 Jun 2012 07:27:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=beta; h=x-beenthere:received-spf:mime-version:in-reply-to:references:date :message-id:subject:from:to:x-original-sender :x-original-authentication-results:reply-to:precedence:mailing-list :list-id:x-google-group-id:list-post:list-help:list-archive:sender :list-subscribe:list-unsubscribe:content-type; bh=QsIb+hkWdM4YD8rTxhWGJNNO/VNUzdUBERz6sFE+5Zg=; b=elMg2a6/OdWhkSQmEPFy9VmQECCqxKSvwlYGl4b7JRX8jrfQc9MwRuJ6iKhahKYB8Q /vB9pg0L+JR2/Y9KJXHZwVg9hmvNfLmwk5fvoxZeJ0AzugUBnnRJUvnXZO440oFsIy/W iCa3theIGSlslo+nSPiSZ7jJvta1YrJ74mwi8= Received: by 10.204.154.19 with SMTP id m19mr360446bkw.7.1340548063006; Sun, 24 Jun 2012 07:27:43 -0700 (PDT) X-BeenThere: lojban@googlegroups.com Received: by 10.204.154.21 with SMTP id m21ls2896081bkw.2.gmail; Sun, 24 Jun 2012 07:27:41 -0700 (PDT) Received: by 10.204.152.217 with SMTP id h25mr901238bkw.3.1340548061299; Sun, 24 Jun 2012 07:27:41 -0700 (PDT) Received: by 10.204.152.217 with SMTP id h25mr901237bkw.3.1340548061276; Sun, 24 Jun 2012 07:27:41 -0700 (PDT) Received: from mail-lb0-f169.google.com (mail-lb0-f169.google.com [209.85.217.169]) by gmr-mx.google.com with ESMTPS id iv15si10687066bkc.0.2012.06.24.07.27.41 (version=TLSv1/SSLv3 cipher=OTHER); Sun, 24 Jun 2012 07:27:41 -0700 (PDT) Received-SPF: pass (google.com: domain of eyeonus@gmail.com designates 209.85.217.169 as permitted sender) client-ip=209.85.217.169; Received: by lbjn8 with SMTP id n8so6872869lbj.14 for ; Sun, 24 Jun 2012 07:27:40 -0700 (PDT) MIME-Version: 1.0 Received: by 10.152.146.101 with SMTP id tb5mr8849558lab.0.1340548060854; Sun, 24 Jun 2012 07:27:40 -0700 (PDT) Received: by 10.152.46.36 with HTTP; Sun, 24 Jun 2012 07:27:40 -0700 (PDT) In-Reply-To: References: <74243394-F7AA-46CD-B731-21E95827CE6B@yahoo.com> <5fbb3fd1-8c00-42a4-9dac-e9889e69757f@googlegroups.com> <000eea56-0a1e-4f54-8862-3cc817d539e1@googlegroups.com> <9cb9e4c0-f3fa-4183-8582-f14de670148c@googlegroups.com> Date: Sun, 24 Jun 2012 08:27:40 -0600 Message-ID: Subject: Re: [lojban] Re: Are Natlang the best case for entropy in communication ? From: Jonathan Jones To: lojban@googlegroups.com X-Original-Sender: eyeonus@gmail.com X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of eyeonus@gmail.com designates 209.85.217.169 as permitted sender) smtp.mail=eyeonus@gmail.com; dkim=pass header.i=@gmail.com Reply-To: lojban@googlegroups.com Precedence: list Mailing-list: list lojban@googlegroups.com; contact lojban+owners@googlegroups.com List-ID: X-Google-Group-Id: 1004133512417 List-Post: , List-Help: , List-Archive: Sender: lojban@googlegroups.com List-Subscribe: , List-Unsubscribe: , Content-Type: multipart/alternative; boundary=e89a8f2348b3f8ba0204c338aa4e X-Spam-Score: -0.7 (/) X-Spam_score: -0.7 X-Spam_score_int: -6 X-Spam_bar: / --e89a8f2348b3f8ba0204c338aa4e Content-Type: text/plain; charset=ISO-8859-1 That's not evidence. /ignore On Sun, Jun 24, 2012 at 8:25 AM, Escape Landsome wrote: > * NUMERICAL ESTIMATE OF ENTROPY IN EXAMPLE (1) : > > For instance in French : << et alors elle a ouvert la mouche pour > parler >> is correctly understood as << la bouche >> instead of << la > mouche >>. Still the set X of all possible choices is big : X = { > bouche, couche, douche, louche, mouche, souche, touche } > > But the context prevents other Xouche words than body organs to be > selected, so the entropy is very low in context. > > p(bouche) > 0.9, sum p(Xouche) < 0.1 for other X, since worst case is > equiprobability for all those, > > S(example 1) < -(0.9*log_2(0.9) + 6*0.1*log_2(0.1)) = 2.129 > > > * NUMERICAL ESTIMATE OF ENTROPY IN EXAMPLE (2) : > > > Now consider a lojban sentence where somebody would talk of a number > of people in a room, he would use so'V but would mistype the V letter. > > The X set has 5 elements but none of them can be best selected given > the context. > > THEN S(example 2) ~ -5*log_2(0.2) = 11.609 > > > * 11.609 IS MUCH BIGGER THAN 2.129 > > -- > You received this message because you are subscribed to the Google Groups > "lojban" group. > To post to this group, send email to lojban@googlegroups.com. > To unsubscribe from this group, send email to > lojban+unsubscribe@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/lojban?hl=en. > > -- mu'o mi'e .aionys. .i.e'ucai ko cmima lo pilno be denpa bu .i doi.luk. mi patfu do zo'o (Come to the Dot Side! Luke, I am your father. :D ) -- You received this message because you are subscribed to the Google Groups "lojban" group. To post to this group, send email to lojban@googlegroups.com. To unsubscribe from this group, send email to lojban+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/lojban?hl=en. --e89a8f2348b3f8ba0204c338aa4e Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable That's not evidence.

/ignore

O= n Sun, Jun 24, 2012 at 8:25 AM, Escape Landsome <escaaape@gmail.com&g= t; wrote:
* NUMERICAL ESTIMATE OF ENTROPY IN EXAMPLE (= 1) :

For instance in French : << et alors elle a ouvert la mouche pour
parler >> is correctly understood as << la bouche >> inst= ead of << la
mouche >>. =A0 Still the set X of all possible choices is big : X =3D= {
bouche, couche, douche, louche, mouche, souche, touche }

=A0But the context prevents other Xouche words than body organs to be
selected, so the entropy is very low in context.

p(bouche) > 0.9, sum p(Xouche) < 0.1 for other X, since worst c= ase is
equiprobability for all those,

S(example 1) < -(0.9*log_2(0.9) + 6*0.1*log_2(0.1)) =3D 2.129


* NUMERICAL ESTIMATE OF ENTROPY IN EXAMPLE (2) :


Now consider a lojban sentence where somebody would talk of a number
of people in a room, he would use so'V but would mistype the V letter.<= br>
The X set has 5 elements but none of them can be best selected given
the context.

THEN S(example 2) ~ -5*log_2(0.2) =3D 11.609


* 11.609 IS MUCH BIGGER THAN 2.129

--
You received this message because you are subscribed to the Google Groups &= quot;lojban" group.
To post to this group, send email to lojban@googlegroups.com.
To unsubscribe from this group, send email to lojban+unsubscribe@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/lojba= n?hl=3Den.




--
mu'o mi= 'e .aionys.

.i.e'ucai ko cmima lo pilno be denpa bu .i doi.l= uk. mi patfu do zo'o
(Come to the Dot Side! Luke, I am your father. = :D )

--
You received this message because you are subscribed to the Google Groups "= lojban" group.
To post to this group, send email to lojban@googlegroups.com.
To unsubscribe from this group, send email to lojban+unsubscribe@googlegrou= ps.com.
For more options, visit this group at http://groups.google.com/group/lojban= ?hl=3Den.
--e89a8f2348b3f8ba0204c338aa4e--