Erez Shinan
5e546f38a9
args decorators actually work now
7 years ago
Erez Shinan
9daacb9082
Refactored transformers, better code
7 years ago
Erez Shinan
2b4ef11ebf
Columns now start at 1
7 years ago
Erez Shinan
7b32ffd83a
Fixed token visibility rules (Issue #109 )
Anonymous tokens would become visible if they had the same value as named tokens.
That's because they are merged for the lexer. But after this change, the rules for
visibility are based on their use in the rule, and not their name or identity.
7 years ago
Erez Shinan
33caa391d5
Breaking backwards compatibility:
* Removed the scanless parsing feature (dynamic lexing is king)
* Default LALR lexer is now contextual
7 years ago
Erez Shinan
0f0776c0fa
BUGIX in lexer: Embedding strings overwrote priority (Issue #121 )
7 years ago
Erez Shinan
c3bce19dc2
More steps towards a good solution
7 years ago
Erez Shinan
f69bceb335
Snap more things into place
7 years ago
Erez Shinan
f960c1b8ac
Initial: Added transformers.py, and Meta to tree
7 years ago
Erez Shinan
4f2330fc9b
Fixed bug in Earley prioritization
7 years ago
Erez Shinan
25c3c51b1c
Fixed bug in Earley: A tree builder optimization clashed with explicit ambiguity
7 years ago
Erez Shinan
255ef0d973
Added error message for the alias syntax in terminals (Issue #97 )
7 years ago
Erez Shinan
7d11dfa5cd
FEATURE: Added support for ranged-repeat for rules and terminals (Issues #75 , #19 )
Syntax: symbol~number
| symbol~min..max
Example:
HEXCOLOR: "#" (HEXDIGIT~3 | HEXDIGIT~6)
short_sentence: word~4..20
Added range for tokens
7 years ago
Erez Shinan
22e525f53e
Fixed propagate positions. Added lexer_callbacks option.
7 years ago
Erez Shinan
748e9b7248
All relevant tests passing. Also indentation and other refactoring.
7 years ago
Erez Shinan
d173d6d66b
Validate against zero-width terminals in XEarley (Issue #63 )
7 years ago
Erez Shinan
5fd331be54
BUGFIX: Internally repetitive rules are now handled silently (Issue #60 )
7 years ago
Erez Shinan
38c5fd244a
Improved grammar validation and refactored the lexers
7 years ago
Erez Shinan
209ac5ab4e
BUGFIX: Mishandling of quotes (Issue #50 )
7 years ago
Erez Shinan
dcb7297c30
Flags are now part of the terminal identity
7 years ago
Erez Shinan
6f85ca4294
%ignore bug fixed in xearley (thanks to issue #44 )
7 years ago
Erez Shinan
34449651bf
Added UnexpectedInput exception (with line & column) to xearley (Issue #43 )
7 years ago
Erez Shinan
08a8a747b8
Fixed escaping for all tests
7 years ago
Erez Shinan
593446d025
Improved Readme
7 years ago
Erez Shinan
27fb1889cf
Added test
7 years ago
Erez Shinan
816266a5eb
BUGFIX for issue #24 : Dynamic Earley mishandled %ignore tokens
7 years ago
Erez Shinan
692307f683
Added the fruitflies test. Found bug in scanless reconstruction of tokens
7 years ago
Erez Shinan
e8810e3b80
Fixed some deprecation warnings due to changes in Py3.6 regexps
7 years ago
Erez Shinan
baae08e399
Fixed tree-construction semantics: Alias now overrides the "?rule" operator
Breaking change!!
7 years ago
Erez Shinan
035eea234f
BUGFIX: Tree comparison in Earley wasn't hashed, which caused a huge spike in run-time for some cases.
7 years ago
Erez Shinan
b532bf4e3c
Fixed test
7 years ago
Erez Shinan
19a9c9c206
Towards an introspectable tree-builder. Also added tests.
7 years ago
Kaspar Emanuel
ed04b22c4c
Fix UTF-8 test
7 years ago
Kaspar Emanuel
7d21c754a1
Add test for UTF-8 characters in grammar
7 years ago
Erez Shinan
aede340449
Added earley__all_derivations due to performance concerns
7 years ago
Erez Shinan
950f8817ed
Oops!! Important bugfix to last commit
7 years ago
Erez Shinan
ac9ea26b58
Added token priority for standard lexers.
Big Thanks to Seth G of the mappyfile project for financing this feature!
7 years ago
Erez Shinan
5d41371fb3
Added resolve__antiscore_sum
7 years ago
Erez Shinan
9b8ae7aecb
Bugfix: Fixed the %import TOKEN feature
7 years ago
Erez Shinan
0c5acaab8a
Refactoring load_grammar
7 years ago
Erez Shinan
dda0719375
Post-merge cleanup
7 years ago
Erez Shinan
4eec924403
Added prioritization to Earley. Use rule.1 etc. Highest priority will be selected in case of ambiguity.
7 years ago
Erez Shinan
ee8dd8b3f3
Added a test suggested by James McLaughlin
7 years ago
Erez Shinan
1da851516c
Added option: Keep all tokens
8 years ago
Erez Shinan
64d141e486
BUGFIX: Fixes a subtle bug in the LALR(1) parser. See the new test for details.
8 years ago
Erez Shinan
5946e78ed2
Bugfix for Scanless Earley. Thanks Ken!
8 years ago
Erez Shinan
8e2221b2fd
Mid-work. A nice first try
8 years ago
Erez Shinan
d43afcf74a
Trying travis support
8 years ago
Erez Shinan
f374e70b2c
Feature: Added explicit ambiguity option for Earley
8 years ago
Erez Shinan
1685f94ea3
BUGFIX: Solved an elusive bug in Earley parser, when empty rules repeat in the same column
8 years ago