::CLASS rexxtokenizer PRIVATE SUBCLASS tokenizer

specialisation of tokenizer for Rexx programs

Requires

'hashfunction.cls' generate unique ids for html output
'rexxprogram.cls' parse rexx
'tokenizer.cls' tokenizer
'pathsep.cls' fs path separator
'classfinder.cls' class lookup
'nodes.cls' html nodes
Definition at line 1732 of documents.cls

Public Class Methods

  init ()
set up tokenizer in class init

Public Class Attributes

  delims
no comment
  lookaheads
no comment

Public Methods

  init ()
instance init just copies class init

Public Class Methods inherited from tokenizer
two element array of setup (tokelist)
process a list of arrays of delimiter/space pairs

Public Methods inherited from tokenizer
  init (tokelist)
initialize tokenizer
tokenlist toke (line)
tokenize a string

Public Attributes inherited from tokenizer
  delims
list of delimiters
  lookaheads
list of lookahead lengths, descending

Instantiated by

documents.cls line 460

Feature Detail

::ATTRIBUTE delims CLASS
Definition at line 1733 of documents.cls
Statically referenced by
documents.cls line 1781 "self~delims = .rexxtokenizer~delims"

Dynamically referenced by
documents.cls line 1777 "self~delims = array[2]"
documents.cls line 1781 "self~delims = .rexxtokenizer~delims"

::ATTRIBUTE lookaheads CLASS
Definition at line 1734 of documents.cls
Statically referenced by
documents.cls line 1782 "self~lookaheads = .rexxtokenizer~lookaheads"

Dynamically referenced by
documents.cls line 1776 "self~lookaheads = array[1]"
documents.cls line 1782 "self~lookaheads = .rexxtokenizer~lookaheads"

::METHOD init CLASS
set up tokenizer in class init
Definition at line 1737 of documents.cls

::METHOD init
instance init just copies class init
Definition at line 1780 of documents.cls
Get RexxLiterate at SourceForge.net. Fast, secure and Free Open Source software downloads
Generated on 31 Aug 2010 05:20:04 for RexxLiterate by rexxliterate  0.0.1