Conlang/libconlang
John f25685560a conlang: Tokenize punctuation (resolves #9)
Things left to consider:
- token::Type enum is getting fairly large.
  breaking it up could invoke substantial code bloat
- Compound operators might make more sense at the parser level
  - Compound-assign operators are ripe for syntactic desugaring,
    but there must be some reason it's done separately in other languages.
  - Operators like FatArrow may still make sense at the tokenizer level, regardless.
  - What is a lexer? A miserable pile of parsers!
- Operator overloading, or user-defined operators? Hmm...
2023-09-28 00:11:31 -05:00
..
examples conlang: Rename literals; split, compose, and document Rules 2023-09-27 18:13:01 -05:00
src conlang: Tokenize punctuation (resolves #9) 2023-09-28 00:11:31 -05:00
.gitignore Initial Commit 2023-09-21 15:41:12 -05:00
Cargo.toml lexer: Tokenize identifiers (resolves #2.) 2023-09-25 14:22:27 -05:00