Let's replicate the GreenMiner tests
http://webdocs.cs.ualberta.ca/~hindle1/2014/gm.pdf
First let's run the amoled_image_view firefox tests
green-star/tests/amoled_image_view/firefox
run it 40 times.
2nd update the firefox tests to a new version of firefox or series of firefox version
Get some new firefoxes and update the tests to work on the phone.
Once we start getting these we can then back port and compare to the original green miner
Comments (20)
-
repo owner -
reporter Sounds good
-
repo owner We are running the firefox tests (the batch name is amoled_image_view_kyudai). Today we try to see
https://pizza.cs.ualberta.ca/gm/queue.html
, but we cannot see this page. Other pages is no problem. -
repo owner All of the above tests have been completed. Please check them.
-
repo owner We want to update firefox tests. Is it OK that the content of the screenshot is the same page as the same old screenshots? If so, please tell us the url of the page.
-
reporter https://pizza.cs.ualberta.ca/gm/tests/_web/black_on_white.html https://pizza.cs.ualberta.ca/gm/tests/_web/white_on_black.html
/tests/amoled_screen_test/firefox/script.sh:for page in 'black_on_white.html' 'white_on_black.html' ; do hindle1@st-francis:~/projects/green-star$ cat ./tests/amoled_screen_test/firefox/script.sh
White on Black / Black on White Test
Loads a page with X text on a Y background
Copyright (c) 2013 Jed Barlow, Kent Rasmussen, Alex Wilson
This program is free software: you can redistribute it and/or modify
it under the terms of the GNU General Public License as published by
the Free Software Foundation, either version 2 of the License, or
(at your option) any later version.
This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
GNU General Public License for more details.
You should have received a copy of the GNU General Public License
along with this program. If not, see http://www.gnu.org/licenses/.
Wait for Wattlog
microsleep 10000000
Load App
{{{timing}}} am start -n {{APP}}/.App microsleep 12000000
for page in 'black_on_white.html' 'white_on_black.html' ; do {{{timing}}} # Click on Adress Bar tapnswipe /dev/input/event1 tap 400 100 microsleep 2500000 # Make sure it's clicked! tapnswipe /dev/input/event1 tap 400 100 microsleep 2500000 tapnswipe /dev/input/event1 tap 400 100
# Erase the current url for i in 1 2 3 4 ; do for j in 1 2 3 4 ; do input keyevent DEL input keyevent DEL input keyevent DEL input keyevent DEL input keyevent DEL tapnswipe /dev/input/event1 tap 400 100 done done microsleep 1000000 # Load Idle Page input text 'http://pizza.cs.ualberta.ca/gm/tests/'$page input keyevent ENTER # Tap in 5s to remove possible data sending to firefox microsleep 5000000 tapnswipe /dev/input/event1 tap 553 376 # wait 11s for page to load tapnswipe /dev/input/event1 tap 0 0 microsleep 11000000 {{{timing}}} # wait 120 seconds microsleep 120000000
done
"Exit" Process
{{{timing}}} microsleep 2000000 input keyevent HOME
hindle1@st-francis:~/projects/green-star$
-
repo owner We run test script with new firefox. The displayed screen looked like the below image. In Another browser apps, html page is displayed fitting smartphone. Is is OK?
-
repo owner Should we add new firefox apk to apks folder?
-
repo owner We have fixed the web page for mobile phone.
We are going to run
/amoled_screen_test/firefox/script.sh.
However, new firefox apk which we'll add to apk's folder is firefox-nightly.So, should we add firefox-nightly to firefox-nightly folder and add a test(same as
/amoled_screen_test/
), or add firefox-nightly to firefox folder? -
reporter I think they can go in the firefox folder. The firefox-nightly is unnecessary. There's no special power in the name firefox.
-
repo owner We add some new firefox apks, and the test as
/tests/amoled_screen_test_2/
. Please check them. -
reporter I don't see any test runs. Did you run them?
-
repo owner Sorry, we have added the test but not run it, so we will run test as soon as possible.
-
repo owner We tried to access the test web page on android by executing the test script, but a warning page was displayed due to a problem with the server certificate. Should I add code to the test script to skip the warning page?
-
reporter Can you refresh and try again the SSL Cert did change but it should be legitimate.
-
repo owner We have done new Firefox test. The batch name is “kyudai_firefox”. Please check them.
-
reporter I did check them but there were 3 tests. It looked like it works. Please run a bigger batch.
-
repo owner Sure.
-
repo owner We have run 40 times for each apks(fennec_aurora_62.0a1-2015566484_minAPI21.apk,fennec_aurora_63.0a1-2015580115_minAPI21.apk,fennec_aurora_64.0a1-2015589331_minAPI21.apk). The batch name is "kyudai_firefox". Please check them. Should we add more apks and run tests?
-
reporter Yes they are working. Please add the extra APKs and run more tests. Good work.
We need to consider if we need to test anything new. Like a benchmark.
- Log in to comment
There are some screenshots in
/green-star/tests/amoled_image_view/firefox/screenshots
.So, should we run 40 times for each version apk?