Armen Zambrano's battlefield: Usability improvements for Firefox automation initiative

Friday, October 28, 2016

Usability improvements for Firefox automation initiative - Status update #8

NEW:
* Debugging on remote workers is not a main priority for this quarter since it got completed

* We've added investigating hyper chunking

On this update we will look at the progress made in the last two weeks.

This quarter’s main focus is on improving end to end times on Try (Thunder Try project).

For all bugs and priorities you can check out:

https://wiki.mozilla.org/EngineeringProductivity/Projects/Debugging_UX_improvements

Thunder Try - Improve end to end times on try

---------------------------------------------

Project #1 - Artifact builds on automation

##########################################

Tracking bug: https://bugzilla.mozilla.org/show_bug.cgi?id=1284882

Accomplished recently:

All --artifact build jobs now provide crash-reporter symbols. This means test jobs scheduled against linux64 debug work with --artifact.

Upcoming:

Patch in review - debug artifact builds on try. (Right now --artifact always results in an opt artifact build.)

Project #2 - S3 Cloud Compiler Cache

####################################

Tracking bug: https://bugzilla.mozilla.org/show_bug.cgi?id=1280641

Accomplished recently:

Green builds on all platforms on Try, planning to compare build times vs. existing Python sccache now

Project #3 - Metrics

####################

Tracking bug: https://bugzilla.mozilla.org/show_bug.cgi?id=1286856

Accomplished recently:

Stabilized dashboard http://people.mozilla.org/~klahnakoski/MoBuildbotTimings/End-to-End.html
TaskCluster ingestion is Mozharness steps is now working, but not shown on charts yet.

Upcoming:

Still has the “small population” problem, where outliers make the 90th percentile look big.
Add a TaskCluster view of End-to-End times
Start knocking off bugs in the dashboard

Project #4 - Build automation improvements

##########################################

Nothing new for this edition

Project #5 - Hyper chunking

###########################

Tracking bug: https://bugzilla.mozilla.org/show_bug.cgi?id=1262834

Nothing new for this edition

Project #6 - Run Web platform tests from the source checkout

############################################################

Tracking bug: https://bugzilla.mozilla.org/show_bug.cgi?id=1286900

Feature blocked on misconfigured EBS volumes in AWS (bug 1305174)