Update effective-TLD data files using the latest data from Mozilla.

Update effective-TLD data files using the latest data from Mozilla.
Also expand and correct the README describing how to do this update.

Due to bug 96086 (also see https://bugzilla.mozilla.org/show_bug.cgi?id=687165), entries in this list that are also known to be navigable complete URLs have been removed until a more complete solution has been put in place.

This data file is Mozilla's changeset 76449:9411dffc948b, from 2011-09-02 14:08 -0400.

It includes changes (some commented out) from the following Mozilla bugs:

https://bugzilla.mozilla.org/show_bug.cgi?id=669792
https://bugzilla.mozilla.org/show_bug.cgi?id=531758
https://bugzilla.mozilla.org/show_bug.cgi?id=665521

BUG=37436, 96086
TEST=none

Committed: http://src.chromium.org/viewvc/chrome?view=rev&revision=108298
Committed: http://src.chromium.org/viewvc/chrome?view=rev&revision=108453

[Pam (message me for reviews), 2011-10-26 10:31:25]

This patchset also includes effective_tld_names.cc, but the diff is too big for
Rietveld.

[Peter Kasting, 2011-10-26 17:42:48]

Due to http://crbug.com/96086 /
https://bugzilla.mozilla.org/show_bug.cgi?id=687165 , it's problematic to add
all the DynDNS domains to Chrome's copy of the PSL.  For now, please remove
these changes from the update and also remove "appspot.com" and "operaunite.com"
from our copy of the PSL.  I have pinged on the upstream bug in hopes of getting
consensus on a way forward that will let us unfork.

Sorry about all this...

[Pam (message me for reviews), 2011-10-27 13:07:29]

Thanks for the heads-up. I've commented on the bug too. I'll hang onto this for
a couple of days to see if the discussion gets anywhere, and remove the entries
under debate as an interim measure if it doesn't.

- Pam

[Pam (message me for reviews), 2011-10-31 14:25:28]

No progress yet, so let's at least get the fix for gov.co.uk in. Please take a
look.

- Pam

[Peter Kasting, 2011-10-31 21:51:51]

LGTM

[Pam (message me for reviews), 2011-11-02 12:59:09]

Wan-Teh, please review for net/ owners.

Thanks,
- Pam

[wtc, 2011-11-02 14:13:28]

Patch Set 4 LGTM.

I assume the actual CL also includes effective_tld_names.cc
(which is too big to upload).

[Pam (message me for reviews), 2011-11-02 14:22:28]

On 2011/11/02 14:13:28, wtc wrote:
> I assume the actual CL also includes effective_tld_names.cc
> (which is too big to upload).

Yes, it does. Thanks for the review.

- Pam

[commit-bot: I haz the power, 2011-11-02 14:22:43]

CQ is trying da patch. Follow status at
https://chromium-status.appspot.com/cq/pam@chromium.org/8341051/7007

[wtc, 2011-11-02 14:22:59]

pam, pkasting: I have a question about the effective-TLD list.

It seems to be used for two purposes:
- determine if a DNS name is navigable.
- reject Set-Cookie on an effective-TLD.

The two purposes seem to conflict with each other for
appspot.com.  I believe this CL will allow setting a cookie
for appspot.com, but the subdomains of appspot.com should not
share cookies.

If you confirm this conflict between the two purposes,
how do you recommend we resolve this conflict?  By having
two variants of the effective-TLD list?

[Pam (message me for reviews), 2011-11-02 14:27:07]

On 2011/11/02 14:22:59, wtc wrote:
> pam, pkasting: I have a question about the effective-TLD list.
> 
> It seems to be used for two purposes:
> - determine if a DNS name is navigable.
> - reject Set-Cookie on an effective-TLD.
> 
> The two purposes seem to conflict with each other for
> http://appspot.com.  I believe this CL will allow setting a cookie
> for http://appspot.com, but the subdomains of http://appspot.com should not
> share cookies.
> 
> If you confirm this conflict between the two purposes,
> how do you recommend we resolve this conflict?  By having
> two variants of the effective-TLD list?

This is in active discussion on the Mozilla bug mentioned in the change
description. Ultimately I expect we'll end up marking those TLD entries that are
also navigable, so we can allow navigation there (and also allow them to set
their own cookies) but prevent cross-subdomain cookies. The details of what the
annotation in the .dat file will look like are still open.

- Pam

[commit-bot: I haz the power, 2011-11-02 15:34:23]

Change committed as 108298