Module

lexers.gleam_sm

Hand-written Gleam lexer using state machine approach.

O(n) guaranteed, zero regex, thread-safe. Gleam is a type-safe language for Erlang/BEAM.

Classes

GleamStateMachineLexer 1
Gleam lexer.

Gleam lexer.

Methods

tokenize 2 Iterator[Token]
def tokenize(self, code: str, config: LexerConfig | None = None) -> Iterator[Token]
Parameters
Name Type Description
code
config Default:None
Returns
Iterator[Token]