Module

lexers.stan_sm

Hand-written Stan lexer using state machine approach.

O(n) guaranteed, zero regex, thread-safe. Stan is a probabilistic programming language.

Classes

StanStateMachineLexer 1
Stan lexer.

Stan lexer.

Methods

tokenize 2 Iterator[Token]
def tokenize(self, code: str, config: LexerConfig | None = None) -> Iterator[Token]
Parameters
Name Type Description
code
config Default:None
Returns
Iterator[Token]