Erez Sh
e9f4c0304a
Docs: tools page + more explanations
vor 3 Jahren
MegaIng1
2e46211fd6
A few updates to stubs ( fix #856 )
vor 3 Jahren
Erez Sh
5149d38e25
tools.nearley: Add support for case-insensitive strings (Issue #753 )
vor 3 Jahren
Erez Sh
decb3cdcef
Fix for compression. Use base64 for compatibility
vor 4 Jahren
Erez Sh
6a9759d620
Added optional compression to standalone parser
vor 4 Jahren
MegaIng1
2700b794b9
add `--verbose` option & make warnings comments
fixup! make warnings comments
vor 4 Jahren
MegaIng1
2d74539424
lark.tools.serialize and standalone can now take more options. Also added info where options need to be added
vor 4 Jahren
MegaIng1
e1b572c3a9
Allows the standalone parser to take more options.
vor 4 Jahren
Tom Ritchford
ce32310f49
Add print parameter to lark.tools.standalone.main
vor 4 Jahren
MegaIng
f86c4cf14d
Fixed Failing tests
vor 4 Jahren
Erez Sh
bf2d9bf7b1
Standalone generator now remove docstrings and comments.
The result is a much smaller file.
vor 4 Jahren
Blank Spruce
5559b1a211
Add missing elements in standalone parser
Add:
- missing imports
- __version__ variable
Additionally regenerated json parser example
vor 4 Jahren
Erez Sh
621d9f651f
Tiny update (Nearley)
vor 4 Jahren
Erez Sh
b0feed8c12
A few adjustments to Nearley PR (mostly docs)
vor 4 Jahren
Michael Milton
e6ad86f373
For Nearley: add argparse, extras install, allow es6 compiling
vor 4 Jahren
Erez Sh
9cc57abd8a
Added 'cache' option to Lark (Issue #479 )
vor 4 Jahren
Erez Sh
7538c93080
Fixed for mypy (including issue #532 )
vor 4 Jahren
Erez Sh
9ec9acf115
The standalone parser is now licensed under MPL2 (instead of GPL) (Issue #507 )
vor 4 Jahren
Erez Sh
b2f1b3bf7c
Small fixes
vor 4 Jahren
Erez Sh
5402794251
Fix for nearley
vor 4 Jahren
Erez Shinan
d5036eefdd
Serialize tool: Multiple start symbols + bugfix
vor 5 Jahren
Erez Shinan
9ca74d7f67
Added the serialize tool for exporting Lark state & analysis
vor 5 Jahren
Erez Shinan
a798dec779
Fix to new serializer code (Discussed in issue #349 )
vor 5 Jahren
Erez Shinan
5ab12b031c
Added transformer, postlex arguments to standalone
vor 5 Jahren
Erez Shinan
ae51402cc7
Added serializer test
vor 5 Jahren
Erez Shinan
3c64c56bcd
All tests passing
vor 5 Jahren
Erez Shinan
94e15fb6f7
Mid work. Almost stable
vor 5 Jahren
Erez Shinan
bd75bf2dff
Refactor - callbacks are now {rule: callback}, instead of a Callback object referenced by Rule.alias
vor 5 Jahren
Erez Shinan
475312c608
Bugfix in tools.nearley: Added support for null keyword (Issue #342 )
vor 5 Jahren
Erez Shinan
20329e0bf5
Bugfix in tools.nearley: Backslash now handled correctly in strings (Issue #341 )
vor 5 Jahren
night199uk
80a09697fe
Rebuild the way Earley prioritizes ambiguities
- Makes rule ordering the default ambiguity tie breaker.
E.g.
start: a | b
a: "A"
b: "A"
will return:
start
a
start: b | a
a: "A"
b: "A"
will return
start
b
- Replaces the ambiguity='resolve__antiscore_sum' with a separate option: 'priority'.
The priority option has 4 values: 'auto', 'none', 'normal', 'invert'.
'Auto' maps to 'Normal' for CYK and Earley and 'None' for LALR.
'None' filters your priorities and ignores them. This saves some extra tree walking on Earley.
'Normal' uses your priorities untouched, mimicing the old behaviour.
'Invert' negates your priorities, emulating the old 'resolve__antiscore_sum' behaviour.
This allows you to use priority logic even when ambiguity=='explicit', to get a better idea
of the shape of your tree; and to easily disable priorities without removing them from the
grammar for testing (or performance).
- ambiguity='explicit' now correctly returns an ambiguous tree again, as 0.6 did.
vor 5 Jahren
Jan Rydzewski
3ef84318b1
Removed unused imports and variables
vor 5 Jahren
Erez Shinan
0881fe122f
Updated mention of GPL for standalone tool (Issue #247 )
vor 6 Jahren
Erez Shinan
c85098e090
Small refactoring in standalone
vor 6 Jahren
Erez Shinan
720372a386
Standalone parser now uses contextual lexer instead of traditional one (Issue #212 )
It should be easy to allow the user to choose between them, but perhaps unnecessary, as the one and only benefit of the traditional parser is a tiny performance advantage.
vor 6 Jahren
Erez Shinan
53a66132ba
Added visitors & transformers to standalone (Issue #223 )
vor 6 Jahren
Erez Shinan
37cfe5c9f3
BUGFIX: Standalone parser didn't retain filter_out values for terminals (Issue #222 )
vor 6 Jahren
Erez Shinan
843da8e809
Fixed bugs in the standalone generator (Issue #212 )
vor 6 Jahren
Erez Shinan
dee5ac776d
Fix for Python 3.7
vor 6 Jahren
Erez Shinan
c77934f6a2
Fixed nearley
vor 6 Jahren
Erez Shinan
33caa391d5
Breaking backwards compatibility:
* Removed the scanless parsing feature (dynamic lexing is king)
* Default LALR lexer is now contextual
vor 6 Jahren
Erez Shinan
b951b5f79c
Significant reduction in memory consumption (Saving only parse-table instead of analysis instance)
vor 6 Jahren
Erez Shinan
eba4a604cb
Added tests for standalone generator
vor 6 Jahren
Erez Shinan
07f45a0bd3
Style fixes
vor 6 Jahren
Erez Shinan
e697c266a7
Standalone: Significantly reduced generated code size
vor 6 Jahren
Erez Shinan
9b0672fda6
Standalone tools now supports postlex
vor 6 Jahren
Erez Shinan
a409f2835c
Corrections to the standalone tool
vor 6 Jahren
Erez Shinan
5ac4120b71
Stand-alone tool working for LALR+traditional lexer (first commit)
vor 6 Jahren
Erez Shinan
ad30c324f5
Added support for all RE flags.
vor 6 Jahren
Erez Shinan
d846627fb7
A few fixes to escaping
vor 6 Jahren