Module

lexers.swift_sm

Hand-written Swift lexer using composable scanner mixins.

O(n) guaranteed, zero regex, thread-safe.

Classes

SwiftStateMachineLexer 1
Swift lexer using composable mixins.

Swift lexer using composable mixins.

Methods

tokenize 2 Iterator[Token]
def tokenize(self, code: str, config: LexerConfig | None = None) -> Iterator[Token]
Parameters
Name Type Description
code
config Default:None
Returns
Iterator[Token]