Script streaming: remove byte order marks, detect encoding based on them.

Source/core/html/parser/TextResourceDecoder.h

Index: Source/core/html/parser/TextResourceDecoder.h
diff --git a/Source/core/html/parser/TextResourceDecoder.h b/Source/core/html/parser/TextResourceDecoder.h
index 07a697957c98ae7be30a157fde47b44af087b1a1..c3dea3cd50a0fc89d21fec5ab99a9b9f6c43af09 100644
--- a/Source/core/html/parser/TextResourceDecoder.h
+++ b/Source/core/html/parser/TextResourceDecoder.h
@@ -68,6 +68,7 @@ public:
 
     void useLenientXMLDecoding() { m_useLenientXMLDecoding = true; }
     bool sawError() const { return m_sawError; }
+    size_t checkForBOM(const char*, size_t);

[marja, 2014/11/07 13:32:35]

This is sad, but I don't see any other way :(

decode() is a public function which calls this function, but we cannot decode
the full data and try to infer whether BOM was there or not.

Also, I don't think we can try to decode less-than-full data because we don't
know how long the BOM might be, and we don't want to pass incomplete UTF-8 chars
to the decoder.

 
 private:
     TextResourceDecoder(const String& mimeType, const WTF::TextEncoding& defaultEncoding, bool usesEncodingDetector);
@@ -76,7 +77,6 @@ private:
     static ContentType determineContentType(const String& mimeType);
     static const WTF::TextEncoding& defaultEncoding(ContentType, const WTF::TextEncoding& defaultEncoding);
 
-    size_t checkForBOM(const char*, size_t);
     bool checkForCSSCharset(const char*, size_t, bool& movedDataToBuffer);
     bool checkForXMLCharset(const char*, size_t, bool& movedDataToBuffer);
     void checkForMetaCharset(const char*, size_t);