Releases/Firefox 40/Test Plan/Beta/RC

From New wiki
Jump to navigation Jump to search

«  Firefox 40 Beta 9 | Firefox 40 RC | Firefox 40 RC build 4  »

Firefox 40 RC (build 1 & build 2) Test Plan

QE recommendation regarding the quality of the build

  • Build 1
Recommendation based on results from manual testing PASS
  • Build 2
Recommendation based on results from manual testing PASS

Manual Testing summary - Platform Coverage and Areas Tested

  • Testing is performed around areas most affected by fixes since the previous Beta (in cases when there are no Regression tests to cover these areas, or those tests have already been run as part of the Full Beta Regression set)
  • Test Cases executed and results: report

PLATFORM MATRIX

Platform Assignee Results: report
Windows 7 x64 (Graphics: Intel HD 2500) Camelia Badau [DONE]
Windows 10 x64 (Graphics: nVIDIA GeForce 620) Cornel Ionce [DONE]
Mac OS X 10.10 (Graphics: Intel Iris Pro 1536 MB) Alexandra Lucinet [DONE]
Ubuntu 14.04 x86 (Graphics: AMD Radeon HD 6450) Bogdan Maris [DONE]

AREAS TESTED

Tested Area Testing Type Results
IMAGE SUPPORT Regression Testing PASS
WEB COMPATIBILITY Regression Testing PASS
WEBRTC Smoke Testing PASS
BUG 1190635 (build 2) Bug Fix Verification PASS
WEB COMPATIBILITY (build 2) Exploratory Testing PASS

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
Async plugin init Catalin Varga [DONE] SIGNED OFF -
First Run for 40 release Catalin Varga [AT RISK] NO sign-off (helping with testing) - issues found during testing -
Suggested tiles: Sponsored Cornel Ionce [DONE] SIGNED OFF Test Plan
Suggested tiles: Affiliate Cornel Ionce [DONE] SIGNED OFF Test Plan
New Add-on Signing Vasilica Mihasca DROPPED FROM 40 Feature dropped from Firefox 39 & 40 (not enough add-ons signed) -
Unified telemetry/FHR Stuart Philp DROPPED FROM 40 Testing performed is tracked in bug 1169037 -
OMTC by default on Linux Alexandra Lucinet [DONE] SIGNED OFF -
Hello - Context Bogdan Maris [DONE] SIGNED OFF Test Plan
Windows 10 support Andrei Vaida / Cornel Ionce [AT RISK] New feature targeted for Firefox 40 - weekly status reports (NO final sign-off) -

Results

New bugs

    NONE     

Known Issues - also seen in previous builds

Major issues also seen in previous builds

<bugzilla> {

"id":"1180140",
"include_fields":"id,summary,status,resolution"

} </bugzilla>

Low impact issues also seen in previous builds

<bugzilla> {

"id":"1096357,1122858,1142752,1142945,1144722,1147363,1163164,1168101,1176175,1176218,1182606",
"include_fields":"id,summary,status,resolution"

} </bugzilla>

Branch Bug Fix Verifications

<bugzilla> {

"id":"1182424",
"include_fields":"id,summary,status,resolution"

} </bugzilla>

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed