Releases/Firefox 40/Test Plan/Beta/3

From New wiki
Jump to navigation Jump to search

«  Firefox 40 Beta 2 | Firefox 40 Beta 3 | Firefox 40 Beta 4  »

Firefox 40 Beta 3 (build 1) Test Plan

QE recommendation regarding the quality of the build

Recommendation based on results from manual testing CONDITIONAL SIGN OFF

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing is performed around areas most affected by fixes since the previous Beta (in cases when there are no Regression tests to cover these areas, or those tests have already been run as part of the Full Beta Regression set)
  • Test Cases executed and results: report

PLATFORM MATRIX

Platform Assignee Results: report
Windows 10 x86 (10158) (AMD Radeon HD 7700) Andrei Vaida [DONE]
Windows 8.1 x64 (Intel HD Graphics 2500) Camelia Badau [DONE]
Mac OS X 10.8.5 (AMD Radeon HD 6630M 256) Florin Mezei [DONE]
Ubuntu 14.04 x86 (NVIDIA GeForce 210) Alexandra Lucinet [DONE]

AREAS TESTED

Tested Area Testing Type Results
VIDEO COMPATIBILITY Regression Testing CONDITIONAL PASS
AUDIO COMPATIBILITY Regression Testing PASS
HELLO Regression Testing CONDITIONAL PASS

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
Async plugin init Catalin Varga [ON TRACK] Feature is in Beta 40, but still disabled by default - potential final QA sign-off at the end of Beta 40 -
First Run for 40 release Catalin Varga [NOT STARTED] New feature targeted for Firefox 40 (not yet implemented) - final QA sign-off at the end of Beta 40 -
Suggested tiles: Sponsored Cornel Ionce [ON TRACK] Feature dropped from Firefox 39 - final QA sign-off at the end of Beta 40 Test Plan
New Add-on Signing Vasilica Mihasca [ON TRACK] Feature dropped from Firefox 39 (not enough add-ons signed) - final QA sign-off at the end of Beta 40 -
OMTC by default on Linux Alexandra Lucinet [ON TRACK] New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 -
Hello - Context Bogdan Maris [ON TRACK] New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 -

Results

New bugs

<bugzilla> {

"id":"1182444,1182440,1182438",
"include_fields":"id,summary,status,resolution"

} </bugzilla>

Known Issues - also seen in previous builds

Major issues also seen in previous builds

<bugzilla> {

"id":"1151412,1170627,1171940,1172847,1174702,1175841,1180140,1182064",
"include_fields":"id,summary,status,resolution"

} </bugzilla>

Low impact issues also seen in previous builds

<bugzilla> {

"id":"962560,1010976,1089610,1122858,1142945,1143988,1159745,1168101",
"include_fields":"id,summary,status,resolution"

} </bugzilla>

Branch Bug Fix Verifications

<bugzilla> {

"id":"1177461,1178215,1180610",
"include_fields":"id,summary,status,resolution"

} </bugzilla>

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed