Fix tests for unicode escape sequences to actually have the correct expected values.

Fix expected value for a CHAR containing solely a \.
Add new tests for invalid unicode escape sequences (out-of-range, lonely surrogates, etc).
Add test to ensure that \000D gets converted to \000A.
Fix unicode escape sequence handling to pass the above tests. Also ensure it correctly handles the whitespace character after the escape sequence.

svn path=/trunk/libcss/; revision=7549

1 files changed, 40 insertions, 5 deletions

diff --git a/test/data/lex/tests1.dat b/test/data/lex/tests1.dat
index 5a9c173..5e575a9 100644
--- a/test/data/lex/tests1.dat
+++ b/test/data/lex/tests1.dat
@@ -596,21 +596,56 @@ EOF
 #data
 \123\456
 #expected
-IDENT:
+IDENT:ģі
 EOF
 #reset
 
 #data
 \789\abc
 #expected
-IDENT:
+IDENT:މ઼
 EOF
 #reset
 
 #data
-\def
+\000d
 #expected
-IDENT:
+IDENT:\n
+EOF
+#reset
+
+#data
+\d900
+#expected
+IDENT:�
+EOF
+#reset
+
+#data
+\dd00
+#expected
+IDENT:�
+EOF
+#reset
+
+#data
+\fffe
+#expected
+IDENT:�
+EOF
+#reset
+#
+#data
+\1ffff
+#expected
+IDENT:�
+EOF
+#reset
+
+#data
+\110000
+#expected
+IDENT:�
 EOF
 #reset
 
@@ -619,7 +654,7 @@ tes\
 t
 #expected
 IDENT:tes
-CHAR:\
+CHAR:\\
 S
 IDENT:t
 S