Fix Hangul Tone Marks not to delimit in CachingWordShapeIterator

Fix Hangul Tone Marks not to delimit in CachingWordShapeIterator

This patch includes two fixes for CachingWordShapeIterator not to
delimit Hangul Tone Marks from base characters.

The first fix is not to delmit non-CJK runs when it encounters CJK
marks.

The second fix is to exclude:
  U+302E HANGUL SINGLE DOT TONE MARK
  U+302F HANGUL DOUBLE DOT TONE MARK
from the isCJKIdeographOrSymbol set. This change makes the Hangul tone
marks consistent with other Hangul characters.

BUG=594658
Committed: https://crrev.com/a7051b4065ce7dabe0e1ab758396f7e5c770d02d
Cr-Commit-Position: refs/heads/master@{#385475}

[kojii, 2016-04-06 05:05:55]

Description was changed from

==========
WIP: hangul-tone

BUG=594658
==========

to

==========
Exclude Hangul Tone Marks from isCJKIdeographOrSymbolRanges

This patch excludes:
  U+302E HANGUL SINGLE DOT TONE MARK
  U+302F HANGUL DOUBLE DOT TONE MARK
from the isCJKIdeographOrSymbol set.

Hangul is not a Han ideograph derived script and thus
isCJKIdeographOrSymbol() returns false except these two code points.

This change makes the Hangul tone marks consistent with other Hangul
characters.

BUG=594658
==========

[kojii, 2016-04-06 06:09:54]

Description was changed from

==========
Exclude Hangul Tone Marks from isCJKIdeographOrSymbolRanges

This patch excludes:
  U+302E HANGUL SINGLE DOT TONE MARK
  U+302F HANGUL DOUBLE DOT TONE MARK
from the isCJKIdeographOrSymbol set.

Hangul is not a Han ideograph derived script and thus
isCJKIdeographOrSymbol() returns false except these two code points.

This change makes the Hangul tone marks consistent with other Hangul
characters.

BUG=594658
==========

to

==========
Fix Hangul Tone Marks not to delimit in CachingWordShapeIterator

This patch includes two fixes for CachingWordShapeIterator not to
delimit Hangul Tone Marks from base characters.

The first fix is not to delmit non-CJK runs when it encounters CJK
marks.

The second fix is to exclude:
  U+302E HANGUL SINGLE DOT TONE MARK
  U+302F HANGUL DOUBLE DOT TONE MARK
from the isCJKIdeographOrSymbol set. This change makes the Hangul tone
marks consistent with other Hangul
characters.

BUG=594658
==========

[kojii, 2016-04-06 06:20:55]

Description was changed from

==========
Fix Hangul Tone Marks not to delimit in CachingWordShapeIterator

This patch includes two fixes for CachingWordShapeIterator not to
delimit Hangul Tone Marks from base characters.

The first fix is not to delmit non-CJK runs when it encounters CJK
marks.

The second fix is to exclude:
  U+302E HANGUL SINGLE DOT TONE MARK
  U+302F HANGUL DOUBLE DOT TONE MARK
from the isCJKIdeographOrSymbol set. This change makes the Hangul tone
marks consistent with other Hangul
characters.

BUG=594658
==========

to

==========
Fix Hangul Tone Marks not to delimit in CachingWordShapeIterator

This patch includes two fixes for CachingWordShapeIterator not to
delimit Hangul Tone Marks from base characters.

The first fix is not to delmit non-CJK runs when it encounters CJK
marks.

The second fix is to exclude:
  U+302E HANGUL SINGLE DOT TONE MARK
  U+302F HANGUL DOUBLE DOT TONE MARK
from the isCJKIdeographOrSymbol set. This change makes the Hangul tone
marks consistent with other Hangul characters.

BUG=594658
==========

[kojii, 2016-04-06 07:20:39]

kojii@chromium.org changed reviewers:
+ drott@chromium.org

[kojii, 2016-04-06 07:20:40]

PTAL.

[drott, 2016-04-06 14:03:15]

LGTM, thanks for fixing this!

[kojii, 2016-04-06 16:23:20]

The CQ bit was checked by kojii@chromium.org

[commit-bot: I haz the power, 2016-04-06 16:23:34]

CQ is trying da patch. Follow status at
 https://chromium-cq-status.appspot.com/patch-status/1861033003/40001
View timeline at
 https://chromium-cq-status.appspot.com/patch-timeline/1861033003/40001

[commit-bot: I haz the power, 2016-04-06 16:29:12]

Committed patchset #3 (id:40001)

[commit-bot: I haz the power, 2016-04-06 16:30:13]

Description was changed from

==========
Fix Hangul Tone Marks not to delimit in CachingWordShapeIterator

This patch includes two fixes for CachingWordShapeIterator not to
delimit Hangul Tone Marks from base characters.

The first fix is not to delmit non-CJK runs when it encounters CJK
marks.

The second fix is to exclude:
  U+302E HANGUL SINGLE DOT TONE MARK
  U+302F HANGUL DOUBLE DOT TONE MARK
from the isCJKIdeographOrSymbol set. This change makes the Hangul tone
marks consistent with other Hangul characters.

BUG=594658
==========

to

==========
Fix Hangul Tone Marks not to delimit in CachingWordShapeIterator

This patch includes two fixes for CachingWordShapeIterator not to
delimit Hangul Tone Marks from base characters.

The first fix is not to delmit non-CJK runs when it encounters CJK
marks.

The second fix is to exclude:
  U+302E HANGUL SINGLE DOT TONE MARK
  U+302F HANGUL DOUBLE DOT TONE MARK
from the isCJKIdeographOrSymbol set. This change makes the Hangul tone
marks consistent with other Hangul characters.

BUG=594658

Committed: https://crrev.com/a7051b4065ce7dabe0e1ab758396f7e5c770d02d
Cr-Commit-Position: refs/heads/master@{#385475}
==========

[commit-bot: I haz the power, 2016-04-06 16:30:14]

Patchset 3 (id:??) landed as
https://crrev.com/a7051b4065ce7dabe0e1ab758396f7e5c770d02d
Cr-Commit-Position: refs/heads/master@{#385475}