Tim Schaub
62eb0dd72b
Give token an index and throw unexpected token from a common place
2013-06-25 12:11:49 -06:00
Tim Schaub
d5e133b7d8
Satisfy the build/check-requires-timestamp task (see #785 )
...
I think this line should not be required, as `ol.expression.Char` is only used internally in this file.
2013-06-25 12:11:48 -06:00
Tim Schaub
40b12410f0
Increment after scanning >= and <= (and expect EOF in tests)
2013-06-25 12:11:46 -06:00
Tim Schaub
38c8927ae2
Doc and method reorg
2013-06-25 12:11:46 -06:00
Tim Schaub
fbb028e15e
Call expressions
2013-06-25 12:11:45 -06:00
Tim Schaub
7800e9b0cc
Comments, links, copyrights
2013-06-25 12:11:44 -06:00
Tim Schaub
1f68522837
Utility methods on the lexer
2013-06-25 12:11:43 -06:00
Tim Schaub
d7e0d043f3
Consistently number
2013-06-25 12:11:43 -06:00
Tim Schaub
063b461ffd
Fewer calls to charCodeAt
2013-06-25 12:11:43 -06:00
Tim Schaub
9edc9ebcc5
Use next instead
2013-06-25 12:11:42 -06:00
Tim Schaub
f272350e00
Expose next and peek methods
2013-06-25 12:11:42 -06:00
Tim Schaub
5baa38b82c
Test punctuator scanning
2013-06-25 12:11:42 -06:00
Tim Schaub
957b6db3d7
Skip whitespace
2013-06-25 12:11:42 -06:00
Tim Schaub
50f94911b1
Scan string literals
2013-06-25 12:11:42 -06:00
Tim Schaub
4d62cea700
Escape sequences in our identifiers have already been handled
2013-06-25 12:11:42 -06:00
Tim Schaub
0844df8cc2
Scanning identifiers
...
This includes code that is likely not necessary. The escape sequence scanning will likely not be used in our case, but I'm committing it here so it can be brought back if needed later.
2013-06-25 12:11:42 -06:00
Tim Schaub
a748665646
Space and comment
2013-06-25 12:11:42 -06:00
Tim Schaub
040c80a5ad
Expectations about token type
2013-06-25 12:11:42 -06:00
Tim Schaub
193cf4de50
Scan numeric literals
2013-06-25 12:11:41 -06:00
Tim Schaub
81b344715a
Renaming for clarity
2013-06-25 12:11:41 -06:00
Tim Schaub
a5343161bf
Separate lexer
2013-06-25 12:11:41 -06:00