lexers.ruby_sm

Hand-written Ruby lexer using state machine approach.

O(n) guaranteed, zero regex, thread-safe.

Language Support:

• Ruby 3.x syntax
• Symbols (:name, :"string")
• Regular expressions (/pattern/)
• Here-documents (<<EOF, <<-EOF, <<~EOF)
• String interpolation (#{expr})
• Instance variables (@var) and class variables (@@var)
• Global variables ($var)
• Percent strings (%q, %Q, %w, %W, %i, %I, %r, %s, %x)

Special Handling:

Ruby has complex string/regex syntax with multiple delimiters:

• Standard quotes:"string", 'string'
• Percent literals:%q{string}, %r(regex), etc.
• Here-documents: Multiline strings with custom delimiters

Symbols can be barewords (:name) or quoted (:"name with spaces").

Performance:

~60µs per 100-line file (Ruby's syntax complexity adds overhead).

Thread-Safety:

All lookup tables are frozen sets.

See Also:

• rosettes.lexers.python_sm: Similar dynamic language
• rosettes.lexers.perl_sm: Similar regex/string handling