Record

Token

type Token = {
  kind: TokenKind,
  text: Str,
  line: Int
}

One token with its kind, text, and one-based line

Fields

Name	Description
`tokens`	Tokens of a source file; ordinary comments and white space are dropped.