Let's replicate the GreenMiner tests

[Abram Hindle]

http://webdocs.cs.ualberta.ca/~hindle1/2014/gm.pdf

First let's run the amoled_image_view firefox tests

green-star/tests/amoled_image_view/firefox

run it 40 times.

2nd update the firefox tests to a new version of firefox or series of firefox version

https://www.apkmirror.com/apk/mozilla/firefox-nightly-for-developers/firefox-nightly-for-developers-59-0a1-release/

Get some new firefoxes and update the tests to work on the phone.

Once we start getting these we can then back port and compare to the original green miner

[greenminer_kyudai]

There are some screenshots in /green-star/tests/amoled_image_view/firefox/screenshots.

So, should we run 40 times for each version apk?

• 2012-01-28_e99e0dc97746.png
• 2012-06-08_5891cc95eac7.png
• 2012-08-31_fcc533f691e9.png
• 2013-01-31_20bbf73921f4.png
• 2013-04-05_55f9e3e3dae7.png
• 2012-01-29_aee879a3190a.png
• 2012-06-09_95d1bb200f4e.png
• 2012-09-01_a21fd4d085ad.png
• 2013-02-01_50cf5bbcb180.png
• 2013-04-06_768af8d8fad4.png
• 2012-06-01_73783bf75c4c.png
• 2012-07-10_02b26fb307b4.png
• 2012-12-13_edd45de440ba.png
• 2013-02-07_04e13fc9dbff.png
• 2013-04-26_a6104e0e5a2c.png
• 2012-06-02_9274e6b53af4.png
• 2012-07-11_53860f11100c.png
• 2012-12-14_b11065872128.png
• 2013-02-08_fcf79680a057.png
• 2013-04-27_0e45f1b9521f.png

[Abram Hindle]

Sounds good

[greenminer_kyudai]

We are running the firefox tests (the batch name is amoled_image_view_kyudai). Today we try to see https://pizza.cs.ualberta.ca/gm/queue.html, but we cannot see this page. Other pages is no problem.

[greenminer_kyudai]

All of the above tests have been completed. Please check them.

[greenminer_kyudai]

We want to update firefox tests. Is it OK that the content of the screenshot is the same page as the same old screenshots? If so, please tell us the url of the page.

[Abram Hindle]

https://pizza.cs.ualberta.ca/gm/tests/_web/black_on_white.html https://pizza.cs.ualberta.ca/gm/tests/_web/white_on_black.html

/tests/amoled_screen_test/firefox/script.sh:for page in 'black_on_white.html' 'white_on_black.html' ; do hindle1@st-francis:~/projects/green-star$ cat ./tests/amoled_screen_test/firefox/script.sh

White on Black / Black on White Test

Loads a page with X text on a Y background

Copyright (c) 2013 Jed Barlow, Kent Rasmussen, Alex Wilson

This program is free software: you can redistribute it and/or modify

it under the terms of the GNU General Public License as published by

the Free Software Foundation, either version 2 of the License, or

(at your option) any later version.

This program is distributed in the hope that it will be useful,

but WITHOUT ANY WARRANTY; without even the implied warranty of

MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the

GNU General Public License for more details.

You should have received a copy of the GNU General Public License

along with this program. If not, see http://www.gnu.org/licenses/.

Wait for Wattlog

microsleep 10000000

Load App

{{{timing}}} am start -n {{APP}}/.App microsleep 12000000

for page in 'black_on_white.html' 'white_on_black.html' ; do {{{timing}}} # Click on Adress Bar tapnswipe /dev/input/event1 tap 400 100 microsleep 2500000 # Make sure it's clicked! tapnswipe /dev/input/event1 tap 400 100 microsleep 2500000 tapnswipe /dev/input/event1 tap 400 100

# Erase the current url
for i in 1 2 3 4 ; do
    for j in 1 2 3 4 ; do
        input keyevent DEL
        input keyevent DEL
        input keyevent DEL
        input keyevent DEL
        input keyevent DEL
        tapnswipe /dev/input/event1 tap 400 100
    done
done

microsleep 1000000
# Load Idle Page
input text 'http://pizza.cs.ualberta.ca/gm/tests/'$page
input keyevent ENTER


# Tap in 5s to remove possible data sending to firefox
microsleep 5000000
tapnswipe /dev/input/event1 tap 553 376

# wait 11s for page to load
tapnswipe /dev/input/event1 tap 0 0
microsleep 11000000

{{{timing}}}
# wait 120 seconds
microsleep 120000000

done

"Exit" Process

{{{timing}}} microsleep 2000000 input keyevent HOME

hindle1@st-francis:~/projects/green-star$

[greenminer_kyudai]

We run test script with new firefox. The displayed screen looked like the below image. In Another browser apps, html page is displayed fitting smartphone. Is is OK?

[greenminer_kyudai]

Should we add new firefox apk to apks folder?

[greenminer_kyudai]

We have fixed the web page for mobile phone.

We are going to run /amoled_screen_test/firefox/script.sh.
However, new firefox apk which we'll add to apk's folder is firefox-nightly.

So, should we add firefox-nightly to firefox-nightly folder and add a test(same as /amoled_screen_test/), or add firefox-nightly to firefox folder?

[Abram Hindle]

I think they can go in the firefox folder. The firefox-nightly is unnecessary. There's no special power in the name firefox.

[greenminer_kyudai]

We add some new firefox apks, and the test as /tests/amoled_screen_test_2/. Please check them.

[Abram Hindle]

I don't see any test runs. Did you run them?

[greenminer_kyudai]

Sorry, we have added the test but not run it, so we will run test as soon as possible.

[greenminer_kyudai]

We tried to access the test web page on android by executing the test script, but a warning page was displayed due to a problem with the server certificate. Should I add code to the test script to skip the warning page?

[Abram Hindle]

Can you refresh and try again the SSL Cert did change but it should be legitimate.

[greenminer_kyudai]

We have done new Firefox test. The batch name is “kyudai_firefox”. Please check them.

[Abram Hindle]

I did check them but there were 3 tests. It looked like it works. Please run a bigger batch.

[greenminer_kyudai]

Sure.

[greenminer_kyudai]

We have run 40 times for each apks(fennec_aurora_62.0a1-2015566484_minAPI21.apk,fennec_aurora_63.0a1-2015580115_minAPI21.apk,fennec_aurora_64.0a1-2015589331_minAPI21.apk). The batch name is "kyudai_firefox". Please check them. Should we add more apks and run tests?

[Abram Hindle]

Yes they are working. Please add the extra APKs and run more tests. Good work.

We need to consider if we need to test anything new. Like a benchmark.