Releases/Firefox 49/Test Plan/Beta/49.0.2

From New wiki
Jump to navigation Jump to search

«  Firefox 49.0.1 | Firefox 49.0.2 | Firefox 49.0.3 »

Firefox 49.0.2 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 DON'T SHIP IT
Build 2 SHIP IT

Manual Testing summary - Platform Coverage and Areas Tested

  • Build 1:
    • Testing performed around Web compatibility, Plug-in compatibility (Async Plug-in Rendering) and Graphics (DirectX compatibility).
    • Test Cases executed and results: report
  • Build 2:
    • Testing performed around Web compatibility.
    • Test Cases executed and results: report

Build 1

Platform Graphics Build architecture Assignee Results: report
Windows 7 x64 NVIDIA GeForce 210 32-bit Camelia Badau [DONE]
Windows 10 x64 Intel HD 4600 64-bit Iulia Cristescu [DONE]
Mac OS X 10.11.6 Intel Iris Pro (1536 MB) 64-bit Mihai Boldan [DONE]
Ubuntu 16.04 x64 Intel HD 520 64-bit Ciprian Georgiu [DONE]
Tested Area Testing Type Results
Web compatibility Smoke and Exploratory Testing PASSED
Plug-in compatibility (Async Plug-in Rendering) Smoke and Exploratory Testing FAILED
Graphics (DirectX compatibility) Smoke and Exploratory Testing FAILED

Build 2

Platform Graphics Build architecture Assignee Results: report
Windows 7 x64 NVIDIA GeForce 210 32-bit Camelia Badau [DONE]
Windows 10 x64 Intel HD 4600 64-bit Iulia Cristescu [DONE]
Mac OS X 10.11.6 Intel Iris Pro (1536 MB) 64-bit Mihai Boldan [DONE]
Ubuntu 16.04 x64 Intel HD 520 64-bit Ciprian Georgiu [DONE]
Tested Area Testing Type Results
Web compatibility Smoke and Exploratory Testing PASSED


Features

See the [1] gdoc for a general overview


Feature Owner Status Details Test Plan
Text to Speech on Desktop Camelia Badau [DONE] Feature set to release with Firefox 49. Pre-release sign off completed. Test Plan
Text to Speech in Reader View Camelia Badau [DONE] Feature set to release with Firefox 49. Pre-release sign off completed. Test Plan
Mac elevated updates Bogdan Maris [DONE] Feature set to release with Firefox 49. Pre-release sign off completed. Test Plan

Results

New bugs

  • Build 1:

<bugzilla> {

"id":"1311381,1311368,1311374",
"include_fields":"id,summary,status,resolution"

} </bugzilla>

  • Build 2:

<bugzilla> {

"id":"",
"include_fields":"id,summary,status,resolution"

} </bugzilla>

Known Issues - also seen in previous builds

Major issues also seen in previous builds

  • Build 1:

<bugzilla> {

"id":"",
"include_fields":"id,summary,status,resolution"

} </bugzilla>

  • Build 2:

<bugzilla> {

"id":"1311374",
"include_fields":"id,summary,status,resolution"

} </bugzilla>

Low impact issues also seen in previous builds

  • Build 1:

<bugzilla> {

"id":"1096357, 1192204, 1194214, 1207567, 1210769, 1230678, 1233073, 1233359, 1300411, 1305028",
"include_fields":"id,summary,status,resolution"

} </bugzilla>

  • Build 2:

<bugzilla> {

"id":"1616629, 1096357, 1191290, 1210769, 1233073, 1233359, 1305028, 1309534, 1311368",
"include_fields":"id,summary,status,resolution"

} </bugzilla>


Branch Bug Fix Verifications

<bugzilla> { "id":"1301518,1305436,1306472", "include_fields":"id,summary,status,resolution" } </bugzilla>

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed