Releases/Firefox 50/Test Plan/Beta/11

From New wiki
Jump to navigation Jump to search

«  Firefox 50 Beta 1 | Firefox 50 Beta 11 | Firefox 50 RC1 »

Firefox 50.0 Beta 11 Test Plan

QE recommendation regarding the quality of the build

  • Recommendation based on results from manual testing:
Build 1 SHIP IT

Manual Testing summary - Platform Coverage and Areas Tested

Build 1

Platform Graphics Build architecture Assignee Results: report
Windows 8.1 x86 Intel HD 5500 32-bit Petruta Rasa [DONE]
Windows 7 x64 NVIDIA GeForce 210 64-bit Camelia Badau [DONE]
macOS 10.12 NVIDIA GeForce GT 640M 64-bit Alexandru Simonca [DONE]
Ubuntu 16.04 x64 Intel HD 520 64-bit Mihai Boldan [DONE]
Tested Area Testing Type [testrail_link Results]
SCROLL & ZOOM Smoke and Exploratory Testing FAILED (1313664)
PRINTING Smoke Testing PASS

Features

See the [1] gdoc for a general overview


Feature Owner Status Details Test Plan
Windows Child Mode Iulia Cristescu [ON TRACK] scheduled to release with Firefox 50; pre-release sign off is underway Test Plan
Pointer Lock API Alexandru Simonca [ON TRACK] scheduled to release with Firefox 50; pre-release sign off is underway Test Plan
WebM EME support for Widevine Ciprian Georgiu [INVESTIGATION NEEDED] scheduled to release with Firefox 50; at this point, our concerns revolve around the still unresolved bugs: 1298027, 1298030, 1301423 and the recent issue we noticed on the shaka player demo, under Ubuntu (the latter being currently investigated by Bryce Van Dyk); pre-release sign off is underway Test Plan
Simplify page Bogdan Maris [AT RISK] target milestone changed to Fx51, due to 1306294, 1306299, 1306295. Test Plan

Results

New bugs

<bugzilla> {

"id":"1313664",
"include_fields":"id,summary,status,resolution"

} </bugzilla>

Known Issues - also seen in previous builds

Major issues also seen in previous builds

<bugzilla> {

"id":"",
"include_fields":"id,summary,status,resolution"

} </bugzilla>

Low impact issues also seen in previous builds

<bugzilla> {

"id":"1012752, 1161952, 1176837, 1243385, 1256677, 1277327, 1308394",
"include_fields":"id,summary,status,resolution"

} </bugzilla>

Branch Bug Fix Verifications

<bugzilla> { "id":"1306645,1305163", "include_fields":"id,summary,status,resolution" } </bugzilla>

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed