Thursday, April 18, 2013

Presentations

Slide presentations here: (more added all the time)

https://www.dropbox.com/sh/uwh7dgi2fz7ra4y/n_dNJpzlvc

Etherpad for discussion notes

Live minutes if anyone wants to:

https://etherpad.mozilla.org/XPLW1FPWkA

Schedule update (4/18)

Josh Hoblitt's talks on Puppet and GPFS swapped around following a request.
                AstDatCenTech Discussion Schedule v1.1
                ======================================

Thursday April 18th 
~~~~~~~~~~~~~~~~~~~~

09:30 morning session 
======================

Welcome 
--------

    - Aim of workshop (Frossie Economou, NOAO)

Round-table brief description of participants' facilities (10-15 min each) 
---------------------------------------------------------------------------

    - Data sources (telecopes etc)
    - Type of data (imaging, spectroscopy etc)
    - Size of holdings (volume, number of files)
    - Type of products (catalogues etc) 
    - Future plans and problems
    - User-facing services

10:30 break 
============

System configuration management 
--------------------------------

- Configuration & deployment with Puppet & Foreman (Josh Hoblitt, NOAO)
- Round table discussion: Managing large numbers of systems; bare
  metal or VMs? In-house or third party resources?
   

Data Storage (part I) 
----------------------

    - Serving data from geographically distributed stores (Severin Gaudet, CADC) 


12:00 lunch break (walk to UA Student Union) 
=============================================

13:30 afternoon session 
========================

Data Processing Infrastructure 
-------------------------------

   - Experiences with Condor and Xseed (Frank Valdes, NOAO)
   - Round table discussion: Processing workflows

VO Services 
------------

    - The CADC VOSpace Implementation (Pat Dowler, CADC)
    - Round table discussion: Popular VO services

15:00 break 
============

Source code control and testing (part I) 
-----------------------------------------

- Database test harness and system QA (Brian Thomas, NOAO)
- Round table discussion: Software and system testing and deployment processes

Source code control and testing (part II) 
------------------------------------------

- Software licensing: A cautionary tale (Tim Jenness, CCAT)
- Round table discussion: Who publishes their software? Is code re-use a pipe dream? 

16:00 end 
==========

18:30 Dinner at Old Pueblo Grille 
==================================

Friday April 19th 
~~~~~~~~~~~~~~~~~~

09:30 morning session 
======================

Data Transfer protocols and network tuning (part I) 
----------------------------------------------------

- The Data Transport System (Mike Fitzpatrick, NOAO)
- Optimizing Network Throughput for LSST (Mike Freemon, NCSA)

- Round table discussion: Shipping disks - is it ever worth it?
  User-friendly astronomer retrieval options.

10:30 break 
============

Data Storage (part II) 
-----------------------

    - A primer to GPFS (Josh Hoblitt, NOAO)

    - Round table discussion: Data holding "backups": is tape dead;
      Glacier pricing; Recovering from data loss; how to cost storage

12:00 lunch break (walk to UA Student Union) 
=============================================
   

13:30 afternoon session 
========================

Databases 
----------

- Temporal databases (Richard Snodgrass, University of Arizona) 

Authentication, Authorisation and Auxiliary Data Management 
------------------------------------------------------------

- Two different models of authentication & authorisation (Frossie Economou, NOAO)
- Round table discussion: User management; Proprietary data controls;
      auxiliary metadata; User support ticketing systems

Closing 
--------

- Round table discussion: What resources can data centers share? Is
  this type of meeting helpful?


15:00 End 
==========



Tuesday, April 16, 2013

Updated agenda (4/16)

Swap of two sessions to accomodate a speaker's early departure.


                AstDatCenTech Discussion Schedule v1.0
                ======================================

Author: frossie@noao.edu 
Date: 2013-04-16 14:41:07 MST


Thursday April 18th 
~~~~~~~~~~~~~~~~~~~~

09:30 morning session 
======================

Welcome 
--------

    - Aim of workshop (Frossie Economou, NOAO)

Round-table brief description of participants' facilities (10-15 min each) 
---------------------------------------------------------------------------

    - Data sources (telecopes etc)
    - Type of data (imaging, spectroscopy etc)
    - Size of holdings (volume, number of files)
    - Type of products (catalogues etc) 
    - Future plans and problems
    - User-facing services

10:30 break 
============

Data Storage 
-------------

    - A primer to GPFS (Josh Hoblitt, NOAO)
    - Serving data from geographically distributed stores (Severin Gaudet, CADC) 
    - Round table discussion: Data holding "backups": is tape dead;
      Glacier pricing; Recovering from data loss; how to cost storage

12:00 lunch break (walk to UA Student Union) 
=============================================

13:30 afternoon session 
========================

Data Processing Infrastructure 
-------------------------------

   - Experiences with Condor and Xseed (Frank Valdes, NOAO)
   - Round table discussion: Processing workflows

VO Services 
------------

    - The CADC VOSpace Implementation (Pat Dowler, CADC)
    - Round table discussion: Popular VO services

15:00 break 
============

Source code control and testing (part I) 
-----------------------------------------

- Database test harness and system QA (Brian Thomas, NOAO)
- Round table discussion: Software and system testing and deployment processes

Source code control and testing (part II) 
------------------------------------------

- Software licensing: A cautionary tale (Tim Jenness, CCAT)
- Round table discussion: Who publishes their software? Is code re-use a pipe dream? 

16:00 end 
==========

18:30 Dinner at Old Pueblo Grille 
==================================

Friday April 19th 
~~~~~~~~~~~~~~~~~~

09:30 morning session 
======================

Data Transfer protocols and network tuning (part I) 
----------------------------------------------------

- The Data Transport System (Mike Fitzpatrick, NOAO)
- Optimizing Network Throughput for LSST (Mike Freemon, NCSA)

10:30 break 
============

Data Transfer protocols and network tuning (part II) 
-----------------------------------------------------

- Round table discussion: Shipping disks - is it ever worth it?
  User-friendly astronomer retrieval options.

System configuration management 
--------------------------------

- Configuration & deployment with Puppet & Foreman (Josh Hoblitt, NOAO)

12:00 lunch break (walk to UA Student Union) 
=============================================
   

13:30 afternoon session 
========================

Databases 
----------

- Temporal databases (Richard Snodgrass, University of Arizona) 

Authentication, Authorisation and Auxiliary Data Management 
------------------------------------------------------------

- Two different models of authentication & authorisation (Frossie Economou, NOAO)
- Round table discussion: User management; Proprietary data controls;
      auxiliary metadata; User support ticketing systems

Closing 
--------

- Round table discussion: What resources can data centers share? Is
  this type of meeting helpful?


15:00 End 
==========




Friday, April 12, 2013

Latest Workshop agenda (as of 4/12)

                AstDatCenTech Discussion Schedule v0.9
                ======================================

Author: frossie@noao.edu <frossie@noao.edu>
Date: 2013-04-12 16:00:01 MST


Thursday April 18th
~~~~~~~~~~~~~~~~~~~~

09:30 morning session
======================

Welcome
--------

    - Aim of workshop (Frossie Economou, NOAO)

Round-table brief description of participants' facilities (10-15 min each)
---------------------------------------------------------------------------

    - Data sources (telecopes etc)
    - Type of data (imaging, spectroscopy etc)
    - Size of holdings (volume, number of files)
    - Type of products (catalogues etc)
    - Future plans and problems
    - User-facing services

10:30 break
============

Data Storage
-------------

    - A primer to GPFS (Josh Hoblitt, NOAO)

    - Serving data from geographically distributed stores (Severin Gaudet, CADC)

    - Round table discussion: Data holding "backups": is tape dead;
      Glacier pricing; Recovering from data loss; how to cost storage

12:00 lunch break (walk to UA Student Union)
=============================================

13:30 afternoon session
========================

Data Processing Infrastructure
-------------------------------

   - Experiences with Condor and Xseed (Frank Valdes, NOAO)

   - Round table discussion: Processing workflows

VO Services
------------

    - The CADC VOSpace Implementation (Pat Dowler, CADC)

    - Round table discussion: Popular VO services

15:00 break
============

Authentication, Authorisation and Auxiliary Data Management
------------------------------------------------------------

    - Two different models of authentication & authorisation (Frossie Economou, NOAO)

    - Round table discussion: User management; Proprietary data
      controls; auxiliary metadata; User support ticketing systems

16:00 end
==========

18:30 Dinner at Old Pueblo Grille
==================================

Friday April 19th
~~~~~~~~~~~~~~~~~~

09:30 morning session
======================

Data Transfer protocols and network tuning (part I)
----------------------------------------------------

- The Data Transport System (Mike Fitzpatrick, NOAO)

- Optimizing Network Throughput for LSST (Mike Freemon, NCSA)

10:30 break
============

Data Transfer protocols and network tuning (part II)
-----------------------------------------------------

- Round table discussion: Shipping disks - is it ever worth it?
  User-friendly astronomer retrieval options.

System configuration management
--------------------------------

- Configuration & deployment with Puppet & Foreman (Josh Hoblitt, NOAO)

Source code control and testing (part I)
-----------------------------------------

- Database test harness and system QA (Brian Thomas, NOAO)

12:00 lunch break (walk to UA Student Union)
=============================================
  

13:30 afternoon session
========================

Databases
----------

- Temporal databases (Richard Snodgrass, University of Arizona)

Source code control and testing (part II)
------------------------------------------

- Software licensing: A cautionary tale (Tim Jenness, CCAT)

- Round table discussion: What resources can data centers share? Is code
re-use a pipe dream?


15:00 End
==========


Thursday, March 7, 2013

Hotel rooms - book now

For the folks that need a hotel room, please go ahead and register now - the hotel is the DoubleTree at Reid park. Use this link to get the workshop rate - it will expire on March 25th.

Here is some more information about the hotel:


Guestroom (Hotel) Reservations
We have a block of guest rooms at the DoubleTree by Hilton Tucson - Reid Park. The group rate is $103 per room per night single/double/triple/quad occupancy. The rate is subject to prevailing state tax, currently at 7.05%, city bed tax of 6% and $2.00 per room per night. The room block will be held until 25 March 2013. Reservations received after 25 March 2013 are subject to availability at the DoubleTree’s prevailing rate. You may reserve a guest room in our block one of two ways:

1. Call the DoubleTree’s national reservations at 800-222-8733. You must identify yourself as being part of our group (AURA, Astronomical Data Center Technology) to obtain our special rate.

2. Use DoubleTree’s online reservation site at workshop rate. Enter the group code DCT if it is not prefilled (it should be if you followed the workshop rate link). Our group name is “Astronomical Data Center Technology.”

Each attendee will be responsible for their room, tax and incidental charges. Payment will be accepted in the form of a major credit card or cash. Failure to cancel a guaranteed reservation 48 hours prior to the day of arrival or to occupy the room will result in a charge of one night’s room and tax applied to the credit card or forfeiture of the deposit.

Hotel Parking
Free

Guest Room Internet Service
Included in room rate.

Shuttle Service to NOAO
DoubleTree will provide a complimentary shuttle between the hotel and NOAO the days of the meeting. Shuttle service times will be coordinated by NOAO/DoubleTree.

Parking at NOAO/UA Campus
AURA staff may park in the NOAO parking lots as space permits. Those from areas other than Tucson will need a temporary parking permit to park in the NOAO lots. Space in NOAO lots is on a first come, first served basis. Alternative parking, for a fee, may be found at the University of Arizona Second Street Parking Garage, near Mountain Avenue. This garage is within easy walking distance of NOAO. If you qualify for and will need a temporary parking permit, email Barbara Fraps at fraps@noao.edu no later than 10 April 2013.

Wednesday, March 6, 2013

Hotel update


We're just waiting for the final booking code from the hotel, but for those who need to plan their budgets, the rate is going to be $103+tax