Releases/Firefox 40/Test Plan/Beta/1
Jump to navigation
Jump to search
« Firefox 39.0 RC build 6 | Firefox 40 Beta 1 | Firefox 40 Beta 2 »
Firefox 40 Beta 1 (build 2) Test Plan
- Release Week: June 29th, 2015. Plan is to ship this build on Friday July 3rd 2015 - delayed due to late release of Firefox 39 on July 2nd (Release Calendar)
- QA Contacts: Robert Kaiser; Florin Mezei; Andrei Vaida
- IRC: irc://irc.mozilla.org#qa ping kairo; FlorinMezei; avaida
- Build 1: Firefox 40 Beta 1 build 2 | changeset | (ID: 20150702173756)
QE recommendation regarding the quality of the build
| Recommendation based on results from manual testing | CONDITIONAL SIGN-OFF |
|---|
Manual Testing summary - Platform Coverage and Areas Tested
- Testing is performed around new features that entered Beta 1, and areas most affected by fixes
- Test Cases executed and results:
| Platform | Assignee | Results: Regression, Exploratory |
| Windows 7 x64 (AMD Radeon HD6450, Intel HD 2500) | Bogdan Maris, Camelia Badau | [DONE] |
| Windows 10 x64 (nVIDIA GeForce 620, AMD Radeon HD 3000) | Cornel Ionce, Andrei Vaida | [DONE] |
| Mac OS X 10.9.5 (Intel Iris Pro 1024 MB) | Alexandra Lucinet | [DONE] |
| Ubuntu 14.04 x86 (Intel HD 2500) | Vasilica Mihasca | [DONE] |
| Tested Area | Testing Type | Results |
| HELLO | Regression Testing | CONDITIONAL PASS |
| HELLO - CONTEXT | Regression Testing | CONDITIONAL PASS |
| AV ADD-ON COMPATIBILITY | Exploratory testing | PASS |
Features
See the Feature Release Tracking gdoc for a general overview
| Feature | Owner | Status | Details | Test Plan |
|---|---|---|---|---|
| Async plugin init | Catalin Varga | [ON TRACK] | Feature is in Beta 40, but still disabled by default - potential final QA sign-off at the end of Beta 39 | - |
| First Run for 40 release | Catalin Varga | [NOT STARTED] | New feature targeted for Firefox 40 (not yet implemented) - final QA sign-off at the end of Beta 40 | - |
| Suggested tiles: Sponsored | Cornel Ionce | [ON TRACK] | Feature dropped from Firefox 39 - final QA sign-off at the end of Beta 40 | Test Plan |
| New Add-on Signing | Vasilica Mihasca | [ON TRACK] | Feature dropped from Firefox 39 (not enough add-ons signed) - final QA sign-off at the end of Beta 40 | - |
| Unified telemetry/FHR | - | [AT RISK] | New feature targeted for Firefox 40 (no testing details received yet) - potential final QA sign-off at the end of Beta 40 | - |
| OMTC by default on Linux | Alexandra Lucinet | [ON TRACK] | New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 | - |
| Hello - Context | Bogdan Maris | [ON TRACK] | New feature targeted for Firefox 40 - final QA sign-off at the end of Beta 40 | - |
Results
New bugs
<bugzilla> {
"id":"1180129,1180140,1180197,1180219,1180222", "include_fields":"id,summary,status,resolution"
} </bugzilla>
Known Issues - also seen in previous builds
Major issues also seen in previous builds
<bugzilla> {
"id":"1145106", "include_fields":"id,summary,status,resolution"
} </bugzilla>
Low impact issues also seen in previous builds
<bugzilla> {
"id":"1051834,1113673,1122858,1137598,1137602,1137611,1144722,1146882,1154271,1163999,1170627,1172847,1174702,1175090", "include_fields":"id,summary,status,resolution"
} </bugzilla>
Branch Bug Fix Verifications
<bugzilla> {
"id":"1149891,1162569", "include_fields":"id,summary,status,resolution"
} </bugzilla>
Status tags
- [NOT STARTED] - {{mnotstarted}} - little or no work has started on this task
- [ON TRACK] - {{mok}} - task is actively being worked on and those assigned feel comfortable and confident in the quality of the build.
- [DONE] - {{mdone}} - task is completed and those assigned feel comfortable and confident in the quality of the build.
- [AT RISK] - {{mrisk}}- blocking bug / high number of bugs / other confidence-shakers makes us feel not comfortable with the quality of the build.
- [IN PROGRESS] - {{mprog}} - actively being tested on
- [INVESTIGATION NEEDED] - {{minvest}} - more investigation needed