From nobody@digitalkingdom.org Wed Nov 16 12:27:32 2005 Received: with ECARTIS (v1.0.0; list lojban-list); Wed, 16 Nov 2005 12:27:32 -0800 (PST) Received: from nobody by chain.digitalkingdom.org with local (Exim 4.54) id 1EcTsI-0005yY-Di for lojban-list-real@lojban.org; Wed, 16 Nov 2005 12:27:22 -0800 Received: from rlpowell by chain.digitalkingdom.org with local (Exim 4.54) id 1EcTsI-0005yR-3U for lojban-list@lojban.org; Wed, 16 Nov 2005 12:27:22 -0800 Date: Wed, 16 Nov 2005 12:27:22 -0800 To: lojban-list@lojban.org Subject: [lojban] Re: A ranking system for Lojban speaking proficiency? Message-ID: <20051116202722.GC8740@chain.digitalkingdom.org> Mail-Followup-To: lojban-list@lojban.org References: Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.9i From: Robin Lee Powell X-archive-position: 10786 X-ecartis-version: Ecartis v1.0.0 Sender: lojban-list-bounce@lojban.org Errors-to: lojban-list-bounce@lojban.org X-original-sender: rlpowell@digitalkingdom.org Precedence: bulk Reply-to: lojban-list@lojban.org X-list: lojban-list On Wed, Nov 16, 2005 at 08:27:34PM +0100, Arnt Richard Johansen wrote: > It has come to my attention that many beginners (and some advanced > learners) are in search of a way of comparing their spoken Lojban > skills with others. > > One way of doing this, that was suggested on IRC yesterday, is to > set up a system based on the ELO ranking system[1], which was > originally designed for the game of chess. For the record: Jay Kominek has implemented a little program using Chessmetrics (http://www.chessmetrics.com/CM2/Formulas.asp) rather than ELO. > The way we are thinking of adapting this to Lojban is roughly as > follows: Each "match" is a conversation. After the conversation, > both parties throw a secret ballot which indicates whether they > thought themselves better or worse than their "opponent". If the > ballots agree, a winner is designated appropriately. If the > ballots disagree, the conversation is treated as a draw for the > purposes of the ELO system. We've discussed what to do in the second case a lot, and we don't think this works, because if someone always lies that they are better, their score will not ever go down very far. Other suggestions have been allowing players to agree that they are about the same rating (a draw) and then either discarding mismatches (which is probably even worse) or calling them a loss (which penalizes honest mistakes). -Robin -- http://www.digitalkingdom.org/~rlpowell/ *** http://www.lojban.org/ Reason #237 To Learn Lojban: "Homonyms: Their Grate!" Proud Supporter of the Singularity Institute - http://singinst.org/ To unsubscribe from this list, send mail to lojban-list-request@lojban.org with the subject unsubscribe, or go to http://www.lojban.org/lsg2/, or if you're really stuck, send mail to secretary@lojban.org for help.