Releases/Firefox 38/Test Plan/38.0.5/Beta/1

From New wiki
Jump to navigation Jump to search

«  Firefox 38 RC | Firefox 38.0.5 Beta 1 | Firefox 38.0.5 Beta 2  »

Firefox 38.0.5 Beta 1 (build 1) Test Plan

QE recommendation regarding the quality of the build

Recommendation based on results from manual testing CONDITIONAL SIGN OFF (many issues)

Risks with this Beta and ways to mitigate them through testing

Please list any risks related to the quality of this release.

  • 1. Reading List disabling
    • The Reading List feature is no longer a part of the 38.0.5 release
    • Testing to make sure that the feature is not enabled
    • Will be covered by Sanity testing
  • 2. Suggested Tiles disabling
    • The Suggested Tiles feature was backed out into Firefox 39
    • Testing to make sure that the feature is not enabled
    • Will be covered by Sanity testing
  • 3. Reader View
    • Important feature for the 38.0.5 Release
    • Testing to ensure that the Reader View feature is stable enough to be tested
    • Will be covered by Exploratory testing
  • 4. Pocket
    • Important feature for the 38.0.5 Release
    • Testing to ensure that the Pocket integration feature is stable enough to be tested
    • Will be covered by Exploratory testing
  • 5. Screensharing
    • Important feature for the 38.0.5 Release
    • Testing to ensure that the Hello Screensharing feature has no major issues
    • Will be covered by Exploratory testing

Features

See the Feature Release Tracking gdoc for a general overview


Feature Owner Status Details Test Plan
Reader View Andrei Vaida [AT RISK] New feature in Firefox 38.0.5 Test Plan
Pocket Integration Andrei Vaida [AT RISK] New feature in Firefox 38.0.5 Test Plan
Hello screensharing Bogdan Maris [AT RISK] New feature in Firefox 38.0.5 Test Plan

Results

New bugs

<bugzilla> { 

"id":"1163519,1163523,1163526,1163534,1163576,1163577,1163581,1163589,1163613,1163651,1163655,1163917,1163999,1164000,1164001",
"include_fields":"id,summary,status,resolution"

} </bugzilla>

New bugs to this Beta

<bugzilla> { 

"id":"1163519,1163523,1163526,1163534,1163576,1163577,1163581,1163589,1163613,1163651,1163655,1163917,1163999,1164000,1164001",
"include_fields":"id,summary,status,resolution"

} </bugzilla>

Known Issues

  • Major issues

<bugzilla> { 

"id":"1133623,1137602,1145106,1160577,1163931",
"include_fields":"id,summary,status,resolution"

} </bugzilla>

  • Low impact issues

<bugzilla> { 

"id":"1057757,1136265,1137598,1137606,1145106,1146882,1151415,1154271,1160401,1160407,1161018,1161022,1161023,1161057,1161518,1162014,1162750,1163498",
"include_fields":"id,summary,status,resolution"

} </bugzilla>

Regression Tests

  • There will be NO Regression Set for 38.0.5 BETA
  • Regression testing will be performed as needed for the new features in Firefox 38.0.5

Exploratory Testing

  • Testing is performed around areas most affected by fixes since the previous Beta (in cases when there are no Regression tests to cover these areas, or those tests have already been run as part of the Full Beta Regression set)
Platform Assignee Result: report
Windows 7 64-bit (GPU: AMD Radeon HD 6450) Bogdan Maris [DONE]
Windows 8.1 32-bit (GPU: nVIDIA GeForce 620) Cornel Ionce [DONE]
Mac OS X 10.9.5 (GPU: Intel Iris Pro 1024 MB) Alexandra Lucinet [DONE]
Ubuntu 14.04 64-bit (GPU: AMD Radeon 3000) Andrei Vaida [DONE]
Tested Area Testing Type Results (report)
Reading List disabling Sanity testing PASS
Suggested Tiles disabling Sanity testing PASS
Reader View Exploratory testing CONDITIONAL PASS
Pocket Exploratory testing CONDITIONAL PASS
Screensharing Exploratory testing CONDITIONAL PASS

Branch Bug Fix Verifications

  • Verified bugs

<bugzilla> { 

"id":"1157197,1157682,1158281,1158322,1160076,1160577,1160578,1161504,1161881,1162147,1163319,1163349",
"include_fields":"id,summary,status,resolution"

} </bugzilla>

Status tags

  • [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
  • [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
  • [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
  • [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
  • [IN PROGRESS] - {{mprog}} - actively being tested on
  • [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed
Retrieved from "https://mozilla.mediawiki.site/w/index.php?title=Releases/Firefox_38/Test_Plan/38.0.5/Beta/1&oldid=1074166"