daily.sh is opaque to developers

Bug #712282 reported by Stuart Bishop
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Launchpad itself
Fix Released
Critical
William Grant

Bug Description

Developers have no way of seeing what daily.sh is doing until after the fact. This has contributed to the current problem where daily.sh is taking more than a day to complete.

Simple improvements:
 - it needs to echo "Running foo `date`" >> /srv/whatever/nightly.log so we can see what it is running
 - all the scripts need --log-file=DEBUG:/srv/whatever/foo.log added to the command line so we get detailed logs without email spam.
 - New logs need to be synced regularly to devpad.
 - Existing jobs taking 'too long' need to be moved out of nightly.sh and bugs opened. We could create a weekly.sh and run them once a week until performance improves, or install them as separate cron jobs to be run in parallel.

Related branches

Revision history for this message
Stuart Bishop (stub) wrote :

Logs should go in /srv/launchpad.net/production-logs/nightly/ , which has now been created on loganberry.

Changed in launchpad:
importance: Undecided → Critical
status: New → Triaged
William Grant (wgrant)
Changed in launchpad:
assignee: nobody → William Grant (wgrant)
status: Triaged → In Progress
Revision history for this message
Launchpad QA Bot (lpqabot) wrote :

Fixed in stable r12317 (http://bazaar.launchpad.net/~launchpad-pqm/launchpad/stable/revision/12317) by a commit, but not testable.

Changed in launchpad:
milestone: none → 11.02
tags: added: qa-untestable
Changed in launchpad:
status: In Progress → Fix Committed
William Grant (wgrant)
Changed in launchpad:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.