LexedSource

A tokenized source whose token production may be lazy.

Properties

Absolute index of the first retained significant token.

abstract val source: Source

Possibly partial source view backing currently retained tokens.

ID-addressable token view; requesting tokens may force lazy lexing.

Forces lexing through EOF and returns an immutable, self-contained source snapshot.

Returns the significant token at an absolute significant-token index. Requests beyond the end of input return the unique end-of-input token.

Forces lexing through EOF and returns retained significant tokens, including EOF.

abstract fun textOf(token: Token): String

Returns the exact source spelling of token, including original escapes and trivia.

open fun textOf(tokenId: Int): String

Returns the exact source spelling of the token with tokenId.

open fun token(id: Int): Token

Returns the token with absolute id, forcing lexing forward if necessary.