Feature: Tokenize String Literals #5

New Issue

j · 2023-09-22T00:01:43Z

j commented

2023-09-22 00:01:43 +00:00

Feature Progress

Create string literal types
Define rule for tokenizing string literals

Feature description

A string literal is:

Quote "
Optional sequence of any:
- Arbitrary non-", non-escape character
- Escape sequence
Quote "

An escape sequence represents a character that's disallowed in string literals.
An escape sequence is:

An escape character \
An escape specifier [", ...]
- Other escape characters should be added when necessary

Example

// This is an empty string literal
""
// This string literal has characters inside it
"I love 🦅 and 🦈"
// This string literal has an escape sequence
"Here's an important quote: \" "

# Feature Progress  - [x] Create string literal types - [x] Define rule for tokenizing string literals # Feature description A string literal is: - Quote `"` - Optional sequence of any: - Arbitrary non-`"`, non-escape character - Escape sequence - Quote `"` An escape sequence represents a character that's disallowed in string literals. An escape sequence is: - An escape character `\` - An escape specifier [`"`, ...] - Other escape characters should be added when necessary # Example  ```rust // This is an empty string literal "" // This string literal has characters inside it "I love 🦅 and 🦈" // This string literal has an escape sequence "Here's an important quote: \" " ```

j added the

enhancement

label 2023-09-22 00:01:43 +00:00

j added this to the Basic Syntax project 2023-09-22 00:01:43 +00:00

j changed title from ~~Feature: String Literals~~ to Feature: Tokenize String Literals

2023-09-23 05:19:33 +00:00

j added a new dependency 2023-09-23 05:40:41 +00:00

#7 Feature: Lexer

j commented

2023-09-24 09:30:34 +00:00

Further transformation by the parser will be required to interpret escape sequences.

j closed this issue