[IPTA-DBPL] Welcome to the IPTA Database/Pipeline Mailing List

Tue Jul 9 08:08:42 EDT 2013

Hi all,

Welcome to the IPTA Database/Pipeline mailing list!

Based on the evolving recipient list of this thread I've compiled the
following list of individuals who are (likely) interested in an IPTA dialog
about reducing timing data, and storing/retrieving data products:

George Hobbs (george.hobbs at csiro.au)
Willem van Straten (vanstraten.willem at gmail.com)
Scott Ransom (sransom at nrao.edu)
Adam Brazier (abrazier at astro.cornell.edu)
Nate Garver-Daniels (nate.garverdaniels at gmail.com)
Rob Ferdman (rferdman at physics.mcgill.ca)
Glenn Jones (glenn.caltech at gmail.com)
Ryan Lynch (rlynch at physics.mcgill.ca)
Jason Hessels (j.w.t.hessels at uva.nl)
Cees Bassa (bassa at jb.man.ac.uk)
Joris Verbiest (joris.verbiest at gmail.com)
Paul Demorest (pdemores at nrao.edu)
Patrick Lazarus (plazarus at mpifr-bonn.mpg.de)

Everyone above has been added to the mailing list. Please be in touch with
me if you want your email address changed, or removed. If there's anyone
I've left off the list who you think would like to be involved in the
discussion please let him/her know and send me the contact info.

It would help jump-start discussions if each of the PTAs could send details
about their current pipelines and what output products are made and how
they are stored. Please highlight details on what aspects of your
databases/pipelines you think are good and which are bad. Please send
around a brief memo with the above info, preferably by July 15th. (Thanks
to Willem and George for already sending around information about their
pipelines).

Thanks,
Patrick

On 3 July 2013 23:33, Patrick Lazarus <plazarus at mpifr-bonn.mpg.de> wrote:

> Hi All,
>
> On a few occasions during the IPTA Meeting last week, the question of what
> data products and information (in addition to the current IPTA timfile
> format) are required/useful for creating combined IPTA data sets, and for
> data analysis projects. NANOGrav, the PPTA and the EPTA are each developing
> different solutions to this problem. Ultimately, the data produced by each
> of these consortia will be combined into a single IPTA data set. Thus it
> makes sense for database, data reduction, and data combination groups
> across the IPTA to discuss requirements and possible solutions.
>
> It is likely too late to collect all the information we'd like for the
> legacy data sets. However, now is probably the right time to start thinking
> about what is required for the next-generation data sets.
>
> Following a brief discussion, it was mentioned that at the very least, the
> pipeline/databases of each of the three PTA projects should produce/track
> some common set of basic meta-data and diagnostics. Also, having compatible
> database schemas would likely be beneficial.Seeing as most of us are likely
> more interested in doing science, and not donkey-work, it may make sense to
> jointly develop tools, where possible.
>
> With this in mind the following plan was proposed to stimulate discussion
> and collaboration:
>
> 0. (*By July 8th*) - Get a list of people involved in DB/Pipeline from
> NANOGrav, EPTA, PPTA. Create an exploder/mailing list.
> 1. (*By July 15th*) - Send details of current pipelines and what output
> products are made and how they are stored. Highlight details on what
> aspects of our databases/pipelines we think are good and which are bad.
> 2. (*By July 22nd*) - Comment on the information sent around to try and
> come up with a set of user-requirements for an IPTA pipeline/database.
> 3. (*Around July 22nd*) - Connect with IPTA data combination group to
> find out what would have found useful for the current IPTA data set.
> 4. (*At some point*) - Connect with the IPTA steering committee to let
> them know of our plans and ideas and to find out who else should be part of
> the process.
>
> Please share your comments, objections, concerns, etc.
>
> Looking forward to work together,
> Patrick
>
>
> On 2 July 2013 04:47, Robert Ferdman <rferdman at physics.mcgill.ca> wrote:
>
>> Hi Scott et al.,
>>
>> I'm not sure whetehr Ryan or Glenn are on the nano-time list, so I've
>> cc'd them here as well.
>>
>> For future reference, the NANOGrav DB group's exploder is
>> nano-db at nanograv.org.
>>
>> Cheers,
>>
>> Rob.
>>
>>
>>  -----------------------------------------------------------
>> *Dr. Robert Ferdman
>> *Research Associate
>>
>> Department of Physics
>> McGill University
>> Ernest Rutherford Physics Building, room 315
>> 3600 rue University
>> Montréal, QC
>> Canada H3A 2T8
>>
>>
>>
>> On 1 Jul 2013, at 09:50, Scott Ransom <sransom at nrao.edu> wrote:
>>
>> Hi Patrick,
>>
>> The relevant people are all (I think) on the nano-time mailing list. Plus
>> Nate and Adam, who I've cc'd.
>>
>> Scott
>>
>> On 07/01/2013 09:36 AM, Patrick Lazarus wrote:
>>
>> Hi George,
>>
>> I agree with your recap.
>>
>> I suggest we add
>>
>> 0. Get a list of people involved in DB/Pipeline from NANOGrav, EPTA,
>> PPTA. I'll create an exploder/mailing list.
>>
>> Scott, can you let us know who from NANOGrav we should be in touch with.
>> It would be good to get input from the DB group, as well as some of the
>> people responsible for the data reduction.
>>
>> Thanks,
>> Patrick
>>
>>
>> On 29 June 2013 09:22, <George.Hobbs at csiro.au
>> <mailto:George.Hobbs at csiro.au <George.Hobbs at csiro.au>>> wrote:
>>
>>    Hi Patrick,
>>
>>      Thanks for the organising the meeting with us on TOASTER.  It does
>>    look great and I'm sure that we can move forward with that (or
>>    similar) system and really improve the data sharing within the IPTA.
>>
>>    My understanding is that we were going to do something like the
>>    following.  Did I remember correctly?
>>
>>    1. We'd all send you details of our current pipelines and what
>>    output products are made and how they are stored
>>    2. We'll include details on what aspects of our databases/pipelines
>>    we think are good and which are bad
>>    3. We'll all comment on the information sent around to try and come
>>    up with a set of user-requirements for an IPTA pipeline/database
>>    4. We'll then see whether TOASTER meets this requirements, whether
>>    it could with some changes or whether we should start again and
>>    design a system from scrath
>>    5. At some point you'll connect with Joris and his group to find out
>>    what the "data putting together group" would have found useful for
>>    the current IPTA data set
>>    6. At some point we'll all connect with the IPTA steering committee
>>    to let them know of our plans and ideas and to find out who else
>>    should be part of the process
>>
>>    Is that okay?  To keep pushing this forward should we agree on
>>    getting you some comments on the current pipelines within 2 weeks?
>>
>>    Cheers,
>>      George
>>
>>
>>    *George Hobbs*
>>    Research Scientist
>>    Astronomy and Space Science
>>    CSIRO
>>
>>    Phone: +61 2 9372 4652 <tel:%2B61%202%209372%204652>
>>    george.hobbs at csiro.au <mailto:george.hobbs at csiro.au<george.hobbs at csiro.au>>
>> *|*
>>    www.csiro.au <http://www.csiro.au/>
>>    Address: PO Box 76, Epping NSW 1710
>>    Australia (Cnr Vimiera & Pembroke Roads, Marsfield NSW, 2122)
>>
>>
>>
>> --
>> Scott M. Ransom            Address:  NRAO
>> Phone:  (434) 296-0320               520 Edgemont Rd.
>> email:  sransom at nrao.edu             Charlottesville, VA 22903 USA
>> GPG Fingerprint: 06A9 9553 78BE 16DB 407B  FFCA 9BFA B6FF FFD3 2989
>>
>> --
>>
>>
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.pulsarastronomy.net/pipermail/ipta-dbpipeline_lists.pulsarastronomy.net/attachments/20130709/c35491b6/attachment-0002.html>