Erez Sh
7c6e94bf73
Fixed issues with the use_bytes PR, and added documentation
4 years ago
MegaIng1
c93106f143
Tests for bytes parser (credit to @ctrlcctrlv )
4 years ago
MegaIng1
0c89189b5f
Support for bytes parser
4 years ago
Nathaniel Hartley
c7fa5e3aa3
Allows building TraditionalLexer with current configuration convention
4 years ago
pwwang
2a73afd355
Change LOGGER to logger
4 years ago
Erez Sh
7dc00179e6
Lark now loads faster
- Refactored lexer interface into LexerConf
- Lexer now compiles regexps only when used (especially useful for ContextualLexer)
- Lexer now doesn't validate on deserialize (noticable speedup)
4 years ago
pwwang
5c8a25c733
Avoid using root logger
4 years ago
julienmalard
86a162d6d8
Added `regex` module as optional mode.
4 years ago
Erez Sh
3b3a8c1c92
Added docs for on_error
4 years ago
Erez Sh
66a073d0aa
Added support for error handling, using a puppet parser.
TODO: Add docs
4 years ago
Erez Sh
46bb1e1d63
Cache now also depends on the Lark version
4 years ago
Erez Sh
61b76a1fd0
Updated README about syntax highlighting for intellij
4 years ago
Erez Sh
9cc57abd8a
Added 'cache' option to Lark (Issue #479 )
4 years ago
Erez Sh
acde77eef8
Nicer and more correct documentation
4 years ago
MegaIng1
926c98bd41
Renamed global_flags to g_regex_flags
4 years ago
MegaIng1
3a97029853
Added global_flags option to Lark (+ test)
4 years ago
Erez Sh
21d2016fca
Added methods for saving/loading Lark instances with pickle (Issue #479 )
5 years ago
Erez Sh
c9c1ea90e8
Revert maybe_placeholders to be False by default.. It should be changed in a major release, not 0.8 (Issue #515 )
5 years ago
Erez Sh
ae691bf35e
Revert propagate_positions to be False by default, still not ready for prime-time
5 years ago
Erez Sh
b2f1b3bf7c
Small fixes
5 years ago
Erez Sh
f0da22e9a8
LarkOptions now raises AttributeError instead of KeyError (Issue #503 )
5 years ago
Erez Sh
b9c81a5450
Refactor: Simplify code by assuming rule.options is never None
5 years ago
Erez Sh
fbbea5f730
Removed deprecated feature - profile
5 years ago
Erez Shinan
1815bd7fbd
Support for token visitation in internal transformers, as an alternative mechanism for lexer_callbacks
5 years ago
Erez Shinan
84f08a452f
propagate_positions & maybe_placeholders are now true by default, updated docs, tests & examples accordingly (Issue #449 , #451 )
5 years ago
Erez Sh
35e1029034
Start parameter now accepts unicode in Python 2 (Issue #459 )
5 years ago
Erez Sh
bb57629418
Added 'edit_terminals' option (Issue #406 )
5 years ago
Erez Shinan
0d164bd344
Added get_terminal() method (Issue #412 )
5 years ago
Erez Shinan
94e7e82a19
Updated docstrings for multiple start symbols
5 years ago
Erez Shinan
f1e844accd
Mid work. Not promising
5 years ago
Erez Shinan
e79689dce7
Remove unused rules (Issue #384 )
5 years ago
Erez Shinan
c5cb79307b
Fixes for new standalone (Issue #349 )
5 years ago
Erez Shinan
5ab12b031c
Added transformer, postlex arguments to standalone
5 years ago
Erez Shinan
ae51402cc7
Added serializer test
5 years ago
Erez Shinan
94e15fb6f7
Mid work. Almost stable
5 years ago
Erez Shinan
d13ebb9c15
Using a mostly-generic serialization method
5 years ago
Erez Shinan
066303fdab
Serialized lark is now json compatible
5 years ago
Erez Shinan
244f671665
Small refactor
5 years ago
Erez Shinan
335206911d
Basic serialize/deserialize working!
5 years ago
Erez Shinan
120d5b9ffa
Mid work
5 years ago
Erez Shinan
bd75bf2dff
Refactor - callbacks are now {rule: callback}, instead of a Callback object referenced by Rule.alias
5 years ago
Erez Shinan
688c453456
Corrections
6 years ago
night199uk
80a09697fe
Rebuild the way Earley prioritizes ambiguities
- Makes rule ordering the default ambiguity tie breaker.
E.g.
start: a | b
a: "A"
b: "A"
will return:
start
a
start: b | a
a: "A"
b: "A"
will return
start
b
- Replaces the ambiguity='resolve__antiscore_sum' with a separate option: 'priority'.
The priority option has 4 values: 'auto', 'none', 'normal', 'invert'.
'Auto' maps to 'Normal' for CYK and Earley and 'None' for LALR.
'None' filters your priorities and ignores them. This saves some extra tree walking on Earley.
'Normal' uses your priorities untouched, mimicing the old behaviour.
'Invert' negates your priorities, emulating the old 'resolve__antiscore_sum' behaviour.
This allows you to use priority logic even when ambiguity=='explicit', to get a better idea
of the shape of your tree; and to easily disable priorities without removing them from the
grammar for testing (or performance).
- ambiguity='explicit' now correctly returns an ambiguous tree again, as 0.6 did.
6 years ago
evandrocoan
6c013b9a1d
Fix misspelling on lark/lark.py documentation
6 years ago
Erez Shinan
222df5bab4
New Feature: Added maybe_placeholders option (Issue #285 )
6 years ago
Erez Shinan
6290b1647d
Lark now works under Python -OO (Issue #283 )
6 years ago
Jan Rydzewski
3ef84318b1
Removed unused imports and variables
6 years ago
night199uk
1d5fd7301a
Heavy modifications to the Earley parser to try and make it handle more
types of ambiguity.
- Rewritten along the lines of Elizabeth Scott's parser.
https://www.sciencedirect.com/science/article/pii/S1571066108001497
- Implement SPPF trees per Elizabeth Scott and Bram van der Sanden's work.
http://www.bramvandersanden.com/post/2014/06/shared-packed-parse-forest/
6 years ago
evandrocoan
6fc2f5a6ba
Fix #231
6 years ago
Erez Shinan
cffd610e77
Fixed reconstructor. All tests passing
6 years ago