From jcowan@reutershealth.com Sat Dec 04 15:44:54 2004 Received: with ECARTIS (v1.0.0; list lojban-list); Sat, 04 Dec 2004 15:44:54 -0800 (PST) Received: from [65.246.141.37] (helo=ratanakiri.reutershealth.com) by chain.digitalkingdom.org with esmtp (Exim 4.34) id 1Caja1-0003LY-SR for lojban-list@lojban.org; Sat, 04 Dec 2004 15:44:46 -0800 Received: from skunk.reutershealth.com (mail [65.246.141.36]) by ratanakiri.reutershealth.com (8.13.1/8.13.1) with SMTP id iB4NiErX013343 for ; Sat, 4 Dec 2004 18:44:14 -0500 (EST) Received: by skunk.reutershealth.com (sSMTP sendmail emulation); Sat, 4 Dec 2004 18:44:14 -0500 Date: Sat, 4 Dec 2004 18:44:14 -0500 From: John Cowan To: lojban-list@lojban.org Subject: [lojban] Re: Updated Letter Frequency Data Message-ID: <20041204234414.GC6154@skunk.reutershealth.com> References: <20041204184629.GU25791@chain.digitalkingdom.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20041204184629.GU25791@chain.digitalkingdom.org> User-Agent: Mutt/1.4.1i X-archive-position: 9065 X-ecartis-version: Ecartis v1.0.0 Sender: lojban-list-bounce@lojban.org Errors-to: lojban-list-bounce@lojban.org X-original-sender: jcowan@reutershealth.com Precedence: bulk Reply-to: lojban-list@lojban.org X-list: lojban-list Robin Lee Powell scripsit: > My data, sorted by number of occurences: [snip] > The only previous work on this I'm aware of is: > > http://www.lojban.org/files/papers/scrabble.unf > > Which, it turns out, is amazingly flawed (which is fine, because > that was a long time ago!). The two sets of statistics aren't comparable, because the Scrabble data counts each distinct word only once, which is appropriate for Scrabble. Your data (I assume) counts every letter in the running text. -- John Cowan www.reutershealth.com www.ccil.org/~cowan jcowan@reutershealth.com Arise, you prisoners of Windows / Arise, you slaves of Redmond, Wash, The day and hour soon are coming / When all the IT folks say "Gosh!" It isn't from a clever lawsuit / That Windowsland will finally fall, But thousands writing open source code / Like mice who nibble through a wall. --The Linux-nationale by Greg Baker