FirefoxOS/DeviceQA/2015-02-09Status

From New wiki
Jump to navigation Jump to search

V2.2 Highlight & Risk

  • Highlight
    • Will start smoke test(auto, manual) on Nexus 5 Lollipop once we have stable PVT builds, currently builds are not yet created for v2.2 and builds from master are without image files.
      • Bug 1111890 - [Nexus 5] Create Lollipop based pvtbuilds for 2.2

V2.2 Milestone

  • 2015/02/23 V2.2 FL
  • 2015/04/06 V2.2 FC
  • QA Shared calendar
    • You can add it to your Google Calendar view by clicking on this link and then clicking on the small blue "+ Google Calendar" button at the bottom, right hand of the screen.
    • If you are signed in with your @mozilla.com account, you can also access it this way:
      • In Google Calendar, you should go to Other calendars > Browse Interesting Calendars > More > Resources for mozilla.com > Public (9) > Public - FxOS QA Schedule > Subscribe

V2.2 Testing Scope

V2.2 Testing by Type

Smoke Testing

On Track

  • Existing Bugs Breaking the Smoketests:
    • [Disabled] test_setup_and_send_active_sync_email.py - Bug 1028192 - Problems with ActiveSync accounts
    • [Disabled] test_receive_active_sync_email.py - Bug 1028192 - Problems with ActiveSync accounts
    • [Disabled] test_cost_control_data_alert_mobile.py - Bug 1061698 - Need ability to work in the shadow root/shadow DOM
    • [Disabled] test_call_log_all_calls.py - Bug 1096385 - Investigate failure in test_call_log_all_calls.py, call log is displayed erroneously

Functional Testing

Yellow

  • Cut, Copy, and Paste (Gerry, Edward, Teri, Eric)
    • Health: Green
    • Test case coverage: 80%
    • Details: WIP
  • Search suggestion based on provider (Hermes)
    • Health: Green
    • Test case coverage: 90%
    • Details: WIP
  • App-grouping (Hermes)
    • Health: Green
    • Test case coverage: 99%
    • Details: WIP
  • CAF bugs (Eric)
    • Health: Green
    • Test case coverage: 100%
    • Details: Ready to test on regression
  • Bluetooth (Teri)
    • Health: Green
    • Test case coverage: 100%
    • Details: Prepare to start regression testing
  • Multicore performance (Edward)
    • Health:
    • Test case coverage:
    • Better performance on Multicore (App startup time for core apps is comparable to Android

Exploratory Testing

On Track

  • Regression

Performance Testing

  • Will get started asap

Stability Testing

V2.2 Test Case Creation

Test Case Creation WIP

On Track

  • [2.2-feature-qa+] & in-moztrap? (6 bugs) --> WORK IN PROCESS
  • feature-b2g=2.2+ & in-moztrap? (0 bugs) --> WORK DONE

Test Case Creation DONE

  • [2.2-feature-qa+] & in-moztrap+ (15 bugs) --> WORK DONE
  • feature-b2g=2.2+ & in-moztrap+ (56 bugs) --> WORK DONE

V2.2 Testing Verification Status

Overall Verification Summary

Need Verification <bugzilla> 

   {
       "cf_qa_whiteboard": "[2.2-feature-qa+]",
       "status": "RESOLVED",
       "include_fields": "id, qa_contact, status, resolution, component, assigned_to, summary"
   }

</bugzilla>

Verification Done <bugzilla> 

   {
       "cf_qa_whiteboard": "[2.2-feature-qa+]",
       "status": "VERIFIED",
       "include_fields": "id, qa_contact, status, resolution, component, assigned_to, summary"
   }

</bugzilla>

Retrieved from "https://mozilla.mediawiki.site/w/index.php?title=FirefoxOS/DeviceQA/2015-02-09Status&oldid=1055080"