current token in navigation

queue of tokens
documents.cls line 594 "tkl = self~tokenized~tokens"
htmlrexxsource.cls line 330 "prevtok = c~tokenized~tokens[1]"
htmlrexxsource.cls line 331 "do t over c~tokenized~tokens"
tokenizer.cls line 68 "self~tokens = tokens"
tokenizer.cls line 210 "tkl~tokens~queue(.token~new(token, 'symbol', start))"
tokenizer.cls line 214 "tkl~tokens~queue(.token~new(lah, self~delims[lah], index))"
tokenizer.cls line 228 "tkl~tokens~queue(.token~new(token, 'symbol', start))"

tokens - queue of token objects

get token by index
tokens index - index of token to retrieve
a token

get first token
tokens current first token

get next token
tokens current next token

get next non blank token
tokens current next non blank token or .nil

return list of subtokens
note this is a list of *new* tokens, not part
of the tokenlist called
starttoke - index of first token to return
endtoke - index of last token to return
- list of tokens

return list of tokens
note this is the list in the tokenlist called
tokens - list of tokens

glue tokens together
tokens starttoke - index of first token to return
endtoke - index of last token to return
- string of assembled tokens