Thursday, April 18, 2013

Presentations

Slide presentations here: (more added all the time)

https://www.dropbox.com/sh/uwh7dgi2fz7ra4y/n_dNJpzlvc

Etherpad for discussion notes

Live minutes if anyone wants to:

https://etherpad.mozilla.org/XPLW1FPWkA

Schedule update (4/18)

Josh Hoblitt's talks on Puppet and GPFS swapped around following a request.
                AstDatCenTech Discussion Schedule v1.1
                ======================================

Thursday April 18th 
~~~~~~~~~~~~~~~~~~~~

09:30 morning session 
======================

Welcome 
--------

    - Aim of workshop (Frossie Economou, NOAO)

Round-table brief description of participants' facilities (10-15 min each) 
---------------------------------------------------------------------------

    - Data sources (telecopes etc)
    - Type of data (imaging, spectroscopy etc)
    - Size of holdings (volume, number of files)
    - Type of products (catalogues etc) 
    - Future plans and problems
    - User-facing services

10:30 break 
============

System configuration management 
--------------------------------

- Configuration & deployment with Puppet & Foreman (Josh Hoblitt, NOAO)
- Round table discussion: Managing large numbers of systems; bare
  metal or VMs? In-house or third party resources?
   

Data Storage (part I) 
----------------------

    - Serving data from geographically distributed stores (Severin Gaudet, CADC) 


12:00 lunch break (walk to UA Student Union) 
=============================================

13:30 afternoon session 
========================

Data Processing Infrastructure 
-------------------------------

   - Experiences with Condor and Xseed (Frank Valdes, NOAO)
   - Round table discussion: Processing workflows

VO Services 
------------

    - The CADC VOSpace Implementation (Pat Dowler, CADC)
    - Round table discussion: Popular VO services

15:00 break 
============

Source code control and testing (part I) 
-----------------------------------------

- Database test harness and system QA (Brian Thomas, NOAO)
- Round table discussion: Software and system testing and deployment processes

Source code control and testing (part II) 
------------------------------------------

- Software licensing: A cautionary tale (Tim Jenness, CCAT)
- Round table discussion: Who publishes their software? Is code re-use a pipe dream? 

16:00 end 
==========

18:30 Dinner at Old Pueblo Grille 
==================================

Friday April 19th 
~~~~~~~~~~~~~~~~~~

09:30 morning session 
======================

Data Transfer protocols and network tuning (part I) 
----------------------------------------------------

- The Data Transport System (Mike Fitzpatrick, NOAO)
- Optimizing Network Throughput for LSST (Mike Freemon, NCSA)

- Round table discussion: Shipping disks - is it ever worth it?
  User-friendly astronomer retrieval options.

10:30 break 
============

Data Storage (part II) 
-----------------------

    - A primer to GPFS (Josh Hoblitt, NOAO)

    - Round table discussion: Data holding "backups": is tape dead;
      Glacier pricing; Recovering from data loss; how to cost storage

12:00 lunch break (walk to UA Student Union) 
=============================================
   

13:30 afternoon session 
========================

Databases 
----------

- Temporal databases (Richard Snodgrass, University of Arizona) 

Authentication, Authorisation and Auxiliary Data Management 
------------------------------------------------------------

- Two different models of authentication & authorisation (Frossie Economou, NOAO)
- Round table discussion: User management; Proprietary data controls;
      auxiliary metadata; User support ticketing systems

Closing 
--------

- Round table discussion: What resources can data centers share? Is
  this type of meeting helpful?


15:00 End 
==========



Tuesday, April 16, 2013

Updated agenda (4/16)

Swap of two sessions to accomodate a speaker's early departure.


                AstDatCenTech Discussion Schedule v1.0
                ======================================

Author: frossie@noao.edu 
Date: 2013-04-16 14:41:07 MST


Thursday April 18th 
~~~~~~~~~~~~~~~~~~~~

09:30 morning session 
======================

Welcome 
--------

    - Aim of workshop (Frossie Economou, NOAO)

Round-table brief description of participants' facilities (10-15 min each) 
---------------------------------------------------------------------------

    - Data sources (telecopes etc)
    - Type of data (imaging, spectroscopy etc)
    - Size of holdings (volume, number of files)
    - Type of products (catalogues etc) 
    - Future plans and problems
    - User-facing services

10:30 break 
============

Data Storage 
-------------

    - A primer to GPFS (Josh Hoblitt, NOAO)
    - Serving data from geographically distributed stores (Severin Gaudet, CADC) 
    - Round table discussion: Data holding "backups": is tape dead;
      Glacier pricing; Recovering from data loss; how to cost storage

12:00 lunch break (walk to UA Student Union) 
=============================================

13:30 afternoon session 
========================

Data Processing Infrastructure 
-------------------------------

   - Experiences with Condor and Xseed (Frank Valdes, NOAO)
   - Round table discussion: Processing workflows

VO Services 
------------

    - The CADC VOSpace Implementation (Pat Dowler, CADC)
    - Round table discussion: Popular VO services

15:00 break 
============

Source code control and testing (part I) 
-----------------------------------------

- Database test harness and system QA (Brian Thomas, NOAO)
- Round table discussion: Software and system testing and deployment processes

Source code control and testing (part II) 
------------------------------------------

- Software licensing: A cautionary tale (Tim Jenness, CCAT)
- Round table discussion: Who publishes their software? Is code re-use a pipe dream? 

16:00 end 
==========

18:30 Dinner at Old Pueblo Grille 
==================================

Friday April 19th 
~~~~~~~~~~~~~~~~~~

09:30 morning session 
======================

Data Transfer protocols and network tuning (part I) 
----------------------------------------------------

- The Data Transport System (Mike Fitzpatrick, NOAO)
- Optimizing Network Throughput for LSST (Mike Freemon, NCSA)

10:30 break 
============

Data Transfer protocols and network tuning (part II) 
-----------------------------------------------------

- Round table discussion: Shipping disks - is it ever worth it?
  User-friendly astronomer retrieval options.

System configuration management 
--------------------------------

- Configuration & deployment with Puppet & Foreman (Josh Hoblitt, NOAO)

12:00 lunch break (walk to UA Student Union) 
=============================================
   

13:30 afternoon session 
========================

Databases 
----------

- Temporal databases (Richard Snodgrass, University of Arizona) 

Authentication, Authorisation and Auxiliary Data Management 
------------------------------------------------------------

- Two different models of authentication & authorisation (Frossie Economou, NOAO)
- Round table discussion: User management; Proprietary data controls;
      auxiliary metadata; User support ticketing systems

Closing 
--------

- Round table discussion: What resources can data centers share? Is
  this type of meeting helpful?


15:00 End 
==========




Friday, April 12, 2013

Latest Workshop agenda (as of 4/12)

                AstDatCenTech Discussion Schedule v0.9
                ======================================

Author: frossie@noao.edu <frossie@noao.edu>
Date: 2013-04-12 16:00:01 MST


Thursday April 18th
~~~~~~~~~~~~~~~~~~~~

09:30 morning session
======================

Welcome
--------

    - Aim of workshop (Frossie Economou, NOAO)

Round-table brief description of participants' facilities (10-15 min each)
---------------------------------------------------------------------------

    - Data sources (telecopes etc)
    - Type of data (imaging, spectroscopy etc)
    - Size of holdings (volume, number of files)
    - Type of products (catalogues etc)
    - Future plans and problems
    - User-facing services

10:30 break
============

Data Storage
-------------

    - A primer to GPFS (Josh Hoblitt, NOAO)

    - Serving data from geographically distributed stores (Severin Gaudet, CADC)

    - Round table discussion: Data holding "backups": is tape dead;
      Glacier pricing; Recovering from data loss; how to cost storage

12:00 lunch break (walk to UA Student Union)
=============================================

13:30 afternoon session
========================

Data Processing Infrastructure
-------------------------------

   - Experiences with Condor and Xseed (Frank Valdes, NOAO)

   - Round table discussion: Processing workflows

VO Services
------------

    - The CADC VOSpace Implementation (Pat Dowler, CADC)

    - Round table discussion: Popular VO services

15:00 break
============

Authentication, Authorisation and Auxiliary Data Management
------------------------------------------------------------

    - Two different models of authentication & authorisation (Frossie Economou, NOAO)

    - Round table discussion: User management; Proprietary data
      controls; auxiliary metadata; User support ticketing systems

16:00 end
==========

18:30 Dinner at Old Pueblo Grille
==================================

Friday April 19th
~~~~~~~~~~~~~~~~~~

09:30 morning session
======================

Data Transfer protocols and network tuning (part I)
----------------------------------------------------

- The Data Transport System (Mike Fitzpatrick, NOAO)

- Optimizing Network Throughput for LSST (Mike Freemon, NCSA)

10:30 break
============

Data Transfer protocols and network tuning (part II)
-----------------------------------------------------

- Round table discussion: Shipping disks - is it ever worth it?
  User-friendly astronomer retrieval options.

System configuration management
--------------------------------

- Configuration & deployment with Puppet & Foreman (Josh Hoblitt, NOAO)

Source code control and testing (part I)
-----------------------------------------

- Database test harness and system QA (Brian Thomas, NOAO)

12:00 lunch break (walk to UA Student Union)
=============================================
  

13:30 afternoon session
========================

Databases
----------

- Temporal databases (Richard Snodgrass, University of Arizona)

Source code control and testing (part II)
------------------------------------------

- Software licensing: A cautionary tale (Tim Jenness, CCAT)

- Round table discussion: What resources can data centers share? Is code
re-use a pipe dream?


15:00 End
==========