Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(456)

Side by Side Diff: components/dom_distiller/core/page_features.h

Issue 1047223003: Add integration of the new heuristics (Closed) Base URL: https://chromium.googlesource.com/chromium/src.git@dd-adaboost-model
Patch Set: whitelist resources for ios Created 5 years, 8 months ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View unified diff | Download patch
OLDNEW
1 // Copyright 2015 The Chromium Authors. All rights reserved. 1 // Copyright 2015 The Chromium Authors. All rights reserved.
2 // Use of this source code is governed by a BSD-style license that can be 2 // Use of this source code is governed by a BSD-style license that can be
3 // found in the LICENSE file. 3 // found in the LICENSE file.
4 4
5 #ifndef COMPONENTS_DOM_DISTILLER_CORE_PAGE_FEATURES_H_ 5 #ifndef COMPONENTS_DOM_DISTILLER_CORE_PAGE_FEATURES_H_
6 #define COMPONENTS_DOM_DISTILLER_CORE_PAGE_FEATURES_H_ 6 #define COMPONENTS_DOM_DISTILLER_CORE_PAGE_FEATURES_H_
7 7
8 #include <vector> 8 #include <vector>
9 9
10 #include "base/values.h" 10 #include "base/values.h"
11 #include "url/gurl.h" 11 #include "url/gurl.h"
12 12
13 namespace dom_distiller { 13 namespace dom_distiller {
14 14
15 // The length of the derived features vector.
16 extern int kDerivedFeaturesCount;
17
15 // The distillable page detector is a model trained on a list of numeric 18 // The distillable page detector is a model trained on a list of numeric
16 // features derived from core more complex features of a webpage (like the 19 // features derived from core more complex features of a webpage (like the
17 // body's .textContent). This derives the numeric features for a set of core 20 // body's .textContent). This derives the numeric features for a set of core
18 // features. 21 // features.
19 // 22 //
20 // Note: It is crucial that these features are derived in the same way and are 23 // Note: It is crucial that these features are derived in the same way and are
21 // in the same order as in the training pipeline. See //heuristics/distillable 24 // in the same order as in the training pipeline. See //heuristics/distillable
22 // in the external DomDistillerJs repo. 25 // in the external DomDistillerJs repo.
23 std::vector<double> CalculateDerivedFeatures(bool isOGArticle, 26 std::vector<double> CalculateDerivedFeatures(bool isOGArticle,
24 const GURL& url, 27 const GURL& url,
25 double numElements, 28 double numElements,
26 double numAnchors, 29 double numAnchors,
27 double numForms, 30 double numForms,
28 const std::string& innerText, 31 const std::string& innerText,
29 const std::string& textContent, 32 const std::string& textContent,
30 const std::string& innerHTML); 33 const std::string& innerHTML);
31 34
32 // Calculates the derived features from the JSON value as returned by the 35 // Calculates the derived features from the JSON value as returned by the
33 // javascript core feature extraction. 36 // javascript core feature extraction.
34 std::vector<double> CalculateDerivedFeaturesFromJSON(const base::Value* json); 37 std::vector<double> CalculateDerivedFeaturesFromJSON(
38 const base::Value* stringified_json);
35 39
36 } // namespace dom_distiller 40 } // namespace dom_distiller
37 41
38 #endif // COMPONENTS_DOM_DISTILLER_CORE_PAGE_FEATURES_H_ 42 #endif // COMPONENTS_DOM_DISTILLER_CORE_PAGE_FEATURES_H_
OLDNEW
« no previous file with comments | « components/dom_distiller/core/javascript/extract_features.js ('k') | components/dom_distiller/core/page_features.cc » ('j') | no next file with comments »

Powered by Google App Engine
This is Rietveld 408576698