Ben is away for the next few Fridays, so I’ll be covering this blog post for the next couple of weeks.
Major highlights:
- Aki fixed an issue which was causing the sheriffs grief because the specific version of an external repository was not specified in b2g manifests.
- Ben completed work on to support update balrog blob schema to support multiple partials. This is important because sometimes we need to have multiple partials in a beta or release.
- John is back for his second internship. He completed his work providing an easy setup of some of our releng applications in a local test environment using Docker and blogged about it here. This should reduce the barriers for new people to contribute.
- Jordan, wearing the buildduty shield this week, fixed backlogs on our AWS spot instances that were causing high pending counts.
Completed work (resolution is ‘FIXED’):
- Balrog: Backend
- Add tests for architecture detection in Balrog
- update balrog blob schema to support multiple partials
- Buildduty
- Clean up old release dirs on slaves
- Backlog of linux compile jobs (Amazon AWS instances not being launched)
- Intermittent “Unable to remove C:\slave\test\build!”
- Please upload a new tp5n.zip to get a manifest change (to disable the alipay.com test)
- Something wrong with b-2008-ix-002x slaves
- Windows inbound builds pending for 10 hours
- B2g-inbound tree closed due to pending B2G ICS Emulator Opt builds
- update cache_flusher in http://pypi.pub.build.mozilla.org/pub
- General Automation
- mozilla-central should contain a pointer to the revision of all external B2G repos, not just gaia
- use gzip compression for hg bundles
- pending l10n jobs should spin up aws slaves
- Self-serve should be able to request arbitrary builds on a push (not just retriggers or complete sets of dep/PGO/Nightly builds)
- nagios checks for stub installer bouncer entries
- move jacuzzi repo out of bhearsum’s account
- kill b2g26_v1_2 on june 9 merge day
- keep buildbot master twistd logs longer
- Add sendchange functionality to the mozharness library
- Missing hsb and dsb single-locale Aurora Fennec builds
- Proactively check test machines are ok
- create bouncer entries for nightly and aurora stub installers
- Perma-fail on Linux64 slaves – test_hosted.xul,test_packaged.xul,test_packaged_launch.xul | Error during test: [Exception… “Component returned failure code: 0x80520012 (NS_ERROR_FILE_NOT_FOUND) [nsIFileOutputStream.init]” nsresult: “0x80520012
- Remove useless –enable-privilege option from remotereftest.py
- turn off aurora localizer b2g desktop builds
- Generalize the sendchanges logic on mozharness
- Remove config for ubuntu64_hw-b2g-dt platform
- Disable nightly builds and updates for Fig project branch
- Don’t force *.chk in MARs
- [b2g] Request for hamachi/buri releng builds from larch twig
- Incorporate AWS slaves into nextSlave decisions
- TP5 Responsiveness is not being run on mozilla-inbound
- manage buildbot master buildbot.tac files
- Version bump from Gecko 32 to 33 has broken Gaia-try
- spot instances should make sure to have up-to-date git repositories
- try-bld-spot in us-west-2 are failing to init mock environment
- switch routing to hg.m.o to use public internet
- Make EC2 instances less susceptible to “abort: No space left on device”
- Intermittent command timed out: 3600 seconds without output, attempting to kill fetching b2g bits from gitmo
- Need automated B2G device builds on Mac (trunk and b2g18)
- consider using StartupItemContext to run mac signing servers
- Gaia related tests should run |git log -n 1| in it’s log output
- [tracking] automation support for B2G v1.1.0hd
- Remove spot instances from inventory
- aws masters are very slow to respond to simple http queries
- Build some jacuzzis
- make sure build slaves can continue to talk to aus3-staging and aus4-dev
- Start doing mulet builds on Fig
- Set MINIDUMP_SAVE_PATH environment var to a valid path for Talos runs
- Don’t require puppet or DNS to launch new instances
- Use different logic to adjust amount of instances to be started for jacuzzied slaves
- Device Builds Tests/Builds for mozilla-inbound
- Monitoring for AWS slaves
- [tracking bug] continuous integration for release engineering code
- Loan Requests
- Other
- Provide a Mozilla API key for desktop builds
- Linux builds on cedar failing to find build dependencies
- slavealloc: use SSL
- Intermittent pseudo-first-line.svg | image comparison (==), max difference: 32, number of differing pixels: 1
- test-masters should test that universal masters still work
- Run rev4 10.6 slaves concurrently with rev3 10.6 and have graph server results for both
- PGO talos is submitting to the Firefox-Non-PGO tree
- [Tracking bug] decommission tinderbox server
- Deprecate tinderbox-builds/old directories for desktop & mobile
- [tracking] move services from cruncher to production
- Platform Support
- Move p3 panda rack
- Add cloud-init to our base AMIs
- Add HD Panda chassis to android production pandas
- Release Automation
- release l10n repacks failed due to failed “rm”
- Move hosted partner bundles into place automatically
- Create a Vagrantfile for Ship It
- update and final verify are incompatible with balrog
- intermittent make_incremental_update.sh bustage
- Releases
- Show Australis whatsnew tour page upon update for all locales on Firefox 29 release builds
- tracking bug for build and release of Firefox and Fennec 30.0
- Link to latest version (30.0) of mobile Firefox on FTP is outdated
- Releases: Custom Builds
- Yandex partner builds for Turkey
- Partner repack changes for web.de, gmx, mail.com and 1&1 (Firefox 30)
- Repos and Hooks
- Tools
- Buildduty Report sorting should not error out (JS) if a section has no bugs
- vcs-sync needs to be able to publish git-hg mappings to mapper
- End-to-end reconfig should also update tools version on foopies
- build-tools: Can’t push /opt/vcs2vcs/vcs_sync/build/conversion/build-tools to build-tools-github!
- Setup docker apps for buildbot, buildapi and redis
- add more slave names to non jacuzzi builders
- end_to_end_reconfig.sh should store logs from manage_foopies.py
- Blobber upload files not served with correct content type
- Move buildduty report script into slave_health repo
- Strikethrough or don’t display closed dependencies in buildduty report
- Deploy relengapi 0.2.1 and mapper 0.2.1 into production https://api.pub.build.mozilla.org/
- db-based mapper on web cluster
- Deploy updated Buildapi to self-serve agents
- “‘NoneType’ object has no attribute ‘id_'” when slaveapi fails at rebooting unreachable slaves
- slave_health stopped updating after 13:40 Friday
- update_maintenance_wiki.sh is truncating text content
- buildfarm/maintenance/manage_foopies.py not executable
In progress work (unresolved and not assigned to nobody):
- Balrog: Backend
- Buildduty
- General Automation
- Make blobber uploads discoverable
- Figure out the correct path setup and mozconfigs for automation-driven MSVC2013 builds
- switch tst* EBS from magnetic to SSD
- Add signing for firefox and org.mozilla.updater binaries on OSX
- Schedule all Android 2.3 armv6 tests, except mochitest-gl, on all trunk trees and make them ride the trains
- manage_instance_storage.py should consider root volume size
- Move Firefox Desktop repacks to use mozharness
- Move emulator gaia-ui-tests on cedar from AWS to IX slaves
- Partial update generation service
- Clean up / redesign of configuration in buildbot-configs/mozilla
- Make b2g_emulator_unittest.py easier to run outside of automation
- Race condition between builders that push updates to in-tree files
- port buildapi to relengapi
- Investigate using distcc for builds (on as many platforms as possible) to reduce build wall clock time
- Increase Android 2.3 mochitest chunks, for aws
- Switch gaia-try to my mozharness again
- Monitor aws_stop_idle.py hungs
- all android single locale repacks broken
- Update Gu job to build Gaia with DESKTOP_SHIMS=0
- Please add non-unified builds to mozilla-central
- Use tooltool for l10n builds
- Don’t generate nightly builds on a tree if no new changes have landed since the previous nightly
- revamp b2g upload configs
- FlatFish: Integrate boot.img and recovery.img into the build system
- Schedule Mnw on cedar on emulator-jb and emulator-kk
- We should stop using setup.sh in tooltool
- reduce EBS writes by tweaking writeout
- Loan Requests
- Slave loan request for a talos-r4-snow machine
- Requesting a loaner machine b2g_ubuntu64_vm to diagnose bug 1017490
- Slave loan request for a bld-linux64-ec2 vm
- Other
- Platform Support
- Android nightly builds should download the previous.apk *before* uploading a new gecko-unsigned-unaligned.apk to the same URL
- Upload new version of xulrunner to tooltool
- slave pre-flight tasks
- Tegra Cleanup should delete some additional files on the sdcard
- Update version of pip installed on automation machines from 0.8.2 to 1.5.5
- scl1 Move Train D releng config Work
- address high pending count in in-house Linux64 test pool
- Cleanup org.mozilla.f3nn3c.PasswordsProvider in verify.py
- Release Automation
- cache MAR + installer downloads in update verify
- ‘ready to release’ emails not being sent for release
- Repos and Hooks
- Tools
- cut over gecko.git to the new vcs-sync system
- AWS Sanity Check lies about how long an instance was shut down for…
- port b2g branching script to mozharness, with revision locking
- more vcs-sync email tweaks
- tegra/panda health checks (verify.py) should not swallow exceptions
- tracker to retire legacy vcs2vcs
- slaveapi disable – comment in bug while disabling is in progress and add a reason dep bug option
- cut over l10n repos to the new vcs-sync system
- loan jgriffin an AWS linux64 test box, and then bump up the instance cpu/ram til tests pass
- Possible bug in end_to_end_reconfig.sh when using -p option?
- Make mozharness use structured logging for marionette tests
- permanent location for vcs-sync mapfiles, status json, logs
- Fix tools/update-packaging/common.sh for consistent behaviour across platforms
Built to Run 
0 comments on “This week in Mozilla Releng – June 20, 2014”