72d32ec71a
Correct index for tokens
2013-06-25 12:11:50 -06:00
f0567f5053
Expect the unexpected
2013-06-25 12:11:49 -06:00
62eb0dd72b
Give token an index and throw unexpected token from a common place
2013-06-25 12:11:49 -06:00
40b12410f0
Increment after scanning >= and <= (and expect EOF in tests)
2013-06-25 12:11:46 -06:00
063b461ffd
Fewer calls to charCodeAt
2013-06-25 12:11:43 -06:00
f272350e00
Expose next and peek methods
2013-06-25 12:11:42 -06:00
5baa38b82c
Test punctuator scanning
2013-06-25 12:11:42 -06:00
50f94911b1
Scan string literals
2013-06-25 12:11:42 -06:00
0844df8cc2
Scanning identifiers
...
This includes code that is likely not necessary. The escape sequence scanning will likely not be used in our case, but I'm committing it here so it can be brought back if needed later.
2013-06-25 12:11:42 -06:00
040c80a5ad
Expectations about token type
2013-06-25 12:11:42 -06:00
193cf4de50
Scan numeric literals
2013-06-25 12:11:41 -06:00
a5343161bf
Separate lexer
2013-06-25 12:11:41 -06:00
Tim Schaub