[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Wikineurotic] Wiki page PEG changed by najrut



The page PEG was changed by najrut at 14:33 UTC

You can view the page by following this link:
 
http://www.lojban.org/tiki/PEG

You can view a diff back to the previous version by following this link: 
http://www.lojban.org/tiki/tiki-pagehistory.php?page=PEG&compare=1&oldver=9&newver=10


***********************************************************
The changes in this version follow below, followed after by the current full page text.
***********************************************************


+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
@@ -Lines: 6-20 changed to +Lines: 6-16 @@
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+

! 4th Baseline Machine Grammar Proposal
- 
((.alyn.post.)) is working on a proposal for a 4th Machine Grammar Baseline, replacing the 3rd baseline's ((YACC)) grammar with a PEG grammar.  This work is scheduled for inclusion into ((Suggestions for CLL, second edition|CLL version 2.0)) or ((CLL Peg Errata|CLL version 2.1)).

!! Morphology
- 
Since PEG does not have a separate lexing stage, any PEG Machine Grammar will also need to express the Lojban Morphology in PEG.
- 
* ((BPFK Section: Formal Morphology))

!! Technical Points of the PEG language
- 
* The '.' characters means any character, in any character set.  It is only used after fa'o, which unconditionally consumes the remaining characters.
* '!.' is the way EOF is tested in PEG.

+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
@@ -Lines: 22-41 changed to +Lines: 18-33 @@
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+

!! CLL
- 
The CLL will need to be updated to account for changes resulting from the translation of the grammar to PEG.
- 
Main Article: ((CLL PEG Errata))

!! Uncategorized Material
- <br />* ((Stuff that would require a baseline change))<br />* ((rant about &quot;exploiting the preparser&quot;))
+ ** ((Practicable syntax changes))<br />** ((Exploiting the preparser))<br />*** ((rant about &quot;exploiting the preparser&quot;))

! Open Discussion Points
- 
* jbogenturfa'i further transforms the PEG grammar into an idealized representation.  This parse tree is suitable for programmatic manipulation.  Why is this idealized parse tree not the way the PEG is written?

! Lojban parsers that use PEG
- 
* ((camxes)), the original PEG parser from which all others are based.
* ((jbogentufa'i))

+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
@@ -Lines: 43-49 changed to +Lines: 35-40 @@
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+

! See Also
- 
* [http://www.teddyb.org/~rlpowell/hobbies/lojban/grammar/|Robin Powell's PEG Grammar Page].  This document builds on the work ((camgusmis)) and ((xorxes)) have done, documented on this page.
* ((Grammar)), for a discussion of Lojban's grammar beyond PEG.
* ((YACC)), the language in which Lojban's official grammar is defined.
* ((BNF)), widely considered easier to read than the YACC grammar.




***********************************************************
The new page content follows below.
***********************************************************

Parsing Expression grammars.  Parsing expression grammars allow for full lookahead and backtracking in time linear to the input size.  This makes them more expressive than ((YACC)) or ((BNF)), which are limited in the how far they look ahead, and as a consequence how far they can backtrack.  They also require more memory than either YACC or BNF to parse an equivalently sized input.

PEG grammars also do not have a separate lexing stage.  Lexing and parsing are performed at the same time, using the same language for both.

See wikipedia for additional general information on [http://en.wikipedia.org/wiki/Parsing_expression_grammar|Parsing Expression Grammars].

! 4th Baseline Machine Grammar Proposal
((.alyn.post.)) is working on a proposal for a 4th Machine Grammar Baseline, replacing the 3rd baseline's ((YACC)) grammar with a PEG grammar.  This work is scheduled for inclusion into ((Suggestions for CLL, second edition|CLL version 2.0)) or ((CLL Peg Errata|CLL version 2.1)).

!! Morphology
Since PEG does not have a separate lexing stage, any PEG Machine Grammar will also need to express the Lojban Morphology in PEG.
* ((BPFK Section: Formal Morphology))

!! Technical Points of the PEG language
* The '.' characters means any character, in any character set.  It is only used after fa'o, which unconditionally consumes the remaining characters.
* '!.' is the way EOF is tested in PEG.
* space is defined as the literal '.' (as opposed to the '.' operator of PEG), whitespace, and all punctuation other than ',' and '''.

!! CLL
The CLL will need to be updated to account for changes resulting from the translation of the grammar to PEG.
Main Article: ((CLL PEG Errata))

!! Uncategorized Material
** ((Practicable syntax changes))
** ((Exploiting the preparser))
*** ((rant about "exploiting the preparser"))

! Open Discussion Points
* jbogenturfa'i further transforms the PEG grammar into an idealized representation.  This parse tree is suitable for programmatic manipulation.  Why is this idealized parse tree not the way the PEG is written?

! Lojban parsers that use PEG
* ((camxes)), the original PEG parser from which all others are based.
* ((jbogentufa'i))
* ((jbominje)), John Leuner's PEG grammar.  The [http://subvert-the-dominant-paradigm.net/~jbominji/code/lojban_grammar.peg|lojban_grammar.peg|grammar] is derived from camxes.

! See Also
* [http://www.teddyb.org/~rlpowell/hobbies/lojban/grammar/|Robin Powell's PEG Grammar Page].  This document builds on the work ((camgusmis)) and ((xorxes)) have done, documented on this page.
* ((Grammar)), for a discussion of Lojban's grammar beyond PEG.
* ((YACC)), the language in which Lojban's official grammar is defined.
* ((BNF)), widely considered easier to read than the YACC grammar.


_______________________________________________
Wikineurotic mailing list
Wikineurotic@lojban.org
http://mail.lojban.org/mailman/listinfo/wikineurotic