Module

PuduLangDocgen.Api.Lexer

View source

Pudu source reduced to tokens and documentation comments

Types

Name Description
Token One token with its kind, text, and one-based line
TokenKind The lexical classes declarations are read from

Functions

Name Description
tokens Tokens of a source file; ordinary comments and white space are dropped.

tokens

fn tokens(source: Str) -> Array[Token]

Tokens of a source file; ordinary comments and white space are dropped.

Parameters

source
Str

Returns

Array[Token]

View source