Update distillability modeling scripts to predict long articles

Update distillability modeling scripts to predict long articles

The model produced from these scripts was added to Chrome here:
https://crrev.com/e9ef74ab7411ca08359015167b2c2bc1b566f95b

Highlight of improvements:
* Generate label according to the distilled length
* Feature extraction and selection
  - Derive features on the fly for scalability
  - Output features by group or one by one
  - Support mobile emulation
  - Support native feature extraction
  - Support using MHTML as input
* Added sanity checking tools
* Add documentation

BUG=610944
R=mdjones@chromium.org

Committed: f8f3308f99ec3dcfa83420b304dec3cc083c9008

[wychen, 2016-03-15 22:11:27]

wychen@chromium.org changed reviewers:
+ mdjones@chromium.org

[wychen, 2016-03-15 22:11:28]

PTAL

[wychen, 2016-05-11 06:03:29]

Description was changed from

==========
Update distillability modeling scripts to predict long articles

The model produced from these scripts was added to Chrome here:
https://crrev.com/e9ef74ab7411ca08359015167b2c2bc1b566f95b

Highlight of improvements:
* Generate label according to the distilled length
* Feature extraction and selection
  - Derive features on the fly for scalability
  - Output features by group or one by one
  - Support mobile emulation
  - Support native feature extraction
  - Support using MHTML as input
* Added sanity checking tools
* Add documentation
==========

to

==========
Update distillability modeling scripts to predict long articles

The model produced from these scripts was added to Chrome here:
https://crrev.com/e9ef74ab7411ca08359015167b2c2bc1b566f95b

Highlight of improvements:
* Generate label according to the distilled length
* Feature extraction and selection
  - Derive features on the fly for scalability
  - Output features by group or one by one
  - Support mobile emulation
  - Support native feature extraction
  - Support using MHTML as input
* Added sanity checking tools
* Add documentation

BUG=610944
==========

[wychen, 2016-05-12 00:19:58]

No more local patches after https://codereview.chromium.org/1972503002/!

[wychen, 2016-05-12 20:21:34]

PTAL

The README.md file can be previewed here:

https://github.com/wychen/dom-distiller/blob/ml-script/heuristics/distillable...

[mdjones, 2016-08-10 00:26:29]

Did a quick skim since this is an internal tool; lgtm

[wychen, 2016-08-10 01:52:54]

Description was changed from

==========
Update distillability modeling scripts to predict long articles

The model produced from these scripts was added to Chrome here:
https://crrev.com/e9ef74ab7411ca08359015167b2c2bc1b566f95b

Highlight of improvements:
* Generate label according to the distilled length
* Feature extraction and selection
  - Derive features on the fly for scalability
  - Output features by group or one by one
  - Support mobile emulation
  - Support native feature extraction
  - Support using MHTML as input
* Added sanity checking tools
* Add documentation

BUG=610944
==========

to

==========
Update distillability modeling scripts to predict long articles

The model produced from these scripts was added to Chrome here:
https://crrev.com/e9ef74ab7411ca08359015167b2c2bc1b566f95b

Highlight of improvements:
* Generate label according to the distilled length
* Feature extraction and selection
  - Derive features on the fly for scalability
  - Output features by group or one by one
  - Support mobile emulation
  - Support native feature extraction
  - Support using MHTML as input
* Added sanity checking tools
* Add documentation

BUG=610944
R=mdjones@chromium.org

Committed: f8f3308f99ec3dcfa83420b304dec3cc083c9008
==========

[wychen, 2016-08-10 01:52:55]

Committed patchset #3 (id:40001) manually as
f8f3308f99ec3dcfa83420b304dec3cc083c9008 (presubmit successful).