Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(42)

Side by Side Diff: components/test/data/password_manager/README

Issue 273523004: Password Manager testing automation (Closed) Base URL: https://chromium.googlesource.com/chromium/src.git@master
Patch Set: log Created 6 years, 7 months ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View unified diff | Download patch
OLDNEW
(Empty)
1 This file contains high-level info about how to use password manager tests and
2 how to create new ones.
3
4 The password manager tests purpose is to allow automatic password manager
5 checking and avoiding to do so manually.
6 The tests are written in python using selenium Webdriver library.
7
8
9 =====Getting started=====
10
11 Build ChromeDriver by building the 'chromedriver' target. This will
12 create an executable binary in the build folder named 'chromedriver[.exe]'.
13
14 Build chrome too by building the 'chrome' target. This will
15 create an executable binary in the build folder named 'chrome[.exe]'.
16
17 Install Selenium (the version tested was 2.41.0):
18 pip install -U selenium
19
20
21 For security reasons, we didn't publish the passwords and the usernames we
22 used to test. So we put them to an xml file (websites.xml). The structure of
23 the file is the following:
24 <websites>
25 <website name = "website name">
26 <username>username</username>
27 <password>password</password>
28 </website>
29 <websites>
30 You can ask someone to give you the websites.xml file and put it in the same
31 folder as the tests. You can also create your own websites.xml with your
32 personal accounts.
33 WARNING: All the content of the PROFILEPATH is going to be deleted.
34 Show the help:
35 python tests.py --help
36 Run all the working tests tests by executing:
37 python tests.py --chrome-path CHROMEPATH --chromedriver-path CHROMEDRIVERPATH
38 --profile-path PROFILEPATH [--passwords_path PASSWORDSPATH]
39
40 Run all the tests by executing:
41 python tests.py --all --chrome-path CHROMEPATH --chromedriver-path
42 CHROMEDRIVERPATH --profile-path PROFILEPATH --passwords_path PASSWORDSPATH]
43
44 Run one or many tests by executing:
45 python tests.py google --chrome-path CHROMEPATH --chromedriver-path
46 CHROMEDRIVERPATH profile-path PROFILEPATH [--passwords_path PASSWORDSPATH]
47
48 python tests.py google facebook --chrome-path CHROMEPATH --chromedriver-path
49 CHROMEDRIVERPATH --profile-path PROFILEPATH [--passwords_path PASSWORDSPATH]
50
51 python tests.py google facebook amazon --chrome-path CHROMEPATH
52 --chromedriver-path CHROMEDRIVERPATH --profile-path PROFILEPATH
53 [--passwords_path PASSWORDSPATH]
54
55
56 =====Creating new test=====
57
58 1) Open tests.py.
59
60 2) Add these lines :
61 website = environment.AddWebsite("website name",
62 "username",
63 "password")
64 * For security reasons, you can use websites.xml which is a private to keep
65 your passwords. You have to add the following line to the xml file:
66
67 <website name = "website name">
68 <username>username</username>
69 <password>password</password>
70 </website>
71
72 Then, to create the new test, you need just to add:
73 class NewWebsite(Website):
74
75 def Login(self):
76 self.GoTo("http://url")
77 self.FillUsernameInto("Username CSS selector")
78 self.FillPasswordInto("Password CSS selector")
79 self.Submit("Password CSS selector")
80
81 def Logout(self):
82 self.Click("Logout button CSS selector")
83
84 environment.AddWebsite(NewWebsite("http://url"))
85
86
87 3) Use the flowing methods to perform the login and logout:
88 The methods that you can use are:
89 * Click: find an element using CSS Selector and click on it. Throw an
90 exception if the element is not visible.
91 self.Click("css_selector")
92 * ClickIfVisible: find an element using CSS Selector and if it's visible,
93 click on it.
94 self.ClickIfVisible("css_selector")
95 * GoTo: navigate the main frame to a url.
96 self.GoTo("url")
97 * HoverOver: find an element using CSS Selector and hover over it.
98 self.HoverOver("css_selector")
99 * SendEnterTo: find an element using CSS Selector and send enter to it.
100 self.SendEnterTo("css_selector")
101
102 * IsDisplayed: check if an element is displayed.
103 self.IsDisplayed("css_selector")
104 * Wait: wait for some amount of time in seconds.
105 self.Wait(10)
106 * WaitUntilDisplayed: wait for an element defined using CSS Selector to be
107 displayed.
108 self.WaitUntilDisplayed("css_selector")
109
110 * FillPasswordInto: find an input element using CSS Selector and fill it with
111 the password.
112 self.FillPasswordInto("css_selector")
113 * FillUsernameInto: find an input element using CSS Selector and fill it with
114 the username.
115 self.FillUsernameInto("css_selector")
116 * FillUsernameIfVisible: find an input element using CSS Selector and fill it
117 with the username. Do nothing if the input element is not visible.
118 self.FillUsernameIfVisible("css_selector")
119 * Submit: find an element using CSS Selector and call its submit() handler.
120 self.Submit("css_selector")
121
122
123 =====Files structure=====
124
125 Classes:
126 * environment.py: the definition the tests Environment.
127 * website.py: Website is defined here. You need to create an instance of this
128 class for each website you want to test.
129
130 Tests:
131 * tests.py: the tests setup and the configuration for each website happens
132 here. This file contain 3 separate kinds of tests:
133
134 1) working tests: tests that are supposed to work. If you have a problem with
135 one of them, rerun it again. Or try using the Known Issues section to fix it.
136 2) tests that can cause a crash (the cause of the crash is not related to the
137 password manager): This means that this set is expected to become a working
138 test or failing test when the issue that causes the crash now is solved.
139 3) failing tests: tests that fail for known bug related to the password
140 manager. When this bug is solved, all the tests that were failing because of
141 it are going to be moved to working tests.
142
143 Other files:
144 * websites.xml : a private file where you can find all the passwords. You can
145 ask someone to give it to you or just create your own with your personal
146 accounts.
147 <websites>
148 <website name = "website name">
149 <username>username</username>
150 <password>password</password>
151 </website>
152 </websites>
153
154
155 =====Known Issues=====
156
157 The tests are very fragile. Here are some suggestions for solving most of the
158 problems:
159 * Restart the tests.
160 * Remove the profile if the tests fail at the beginning for unknown reason.
161 * If tests fail, isolate the one that causes problem, read the log and keep
162 your eyes on the browser window to understand its causes:
163 a) In the tests, we often need to wait for a menu to appear ... If the
164 menu takes more time to appear than expected, the tests are going to fail.
165 b) The websites change very often. And even if they are not changed, they some
166 time show a popup that broke the tests. In the case you need to login manually
167 to the website, close all popup and logout.
168 * If you are logged in when the tests crashes, don't forget to log out before
169 running the tests a second time.
OLDNEW

Powered by Google App Engine
This is Rietveld 408576698