<div dir="ltr">Hi all,<br><div class="gmail_quote"><div dir="ltr"><div><br></div><div>Welcome to the IPTA Database/Pipeline mailing list!</div><div><br></div><div>Based on the evolving recipient list of this thread I've compiled the following list of individuals who are (likely) interested in an IPTA dialog about reducing timing data, and storing/retrieving data products:</div>
<div><br></div><div>George Hobbs (george.hobbs@csiro.au)</div><div>Willem van Straten (<a href="mailto:vanstraten.willem@gmail.com" target="_blank">vanstraten.willem@gmail.com</a>)</div><div>Scott Ransom (<a href="mailto:sransom@nrao.edu" target="_blank">sransom@nrao.edu</a>)</div>
<div>Adam Brazier (<a href="mailto:abrazier@astro.cornell.edu" target="_blank">abrazier@astro.cornell.edu</a>)</div><div>Nate Garver-Daniels (<a href="mailto:nate.garverdaniels@gmail.com" target="_blank">nate.garverdaniels@gmail.com</a>)</div>
<div>Rob Ferdman (<a href="mailto:rferdman@physics.mcgill.ca" target="_blank">rferdman@physics.mcgill.ca</a>)</div><div>Glenn Jones (<a href="mailto:glenn.caltech@gmail.com" target="_blank">glenn.caltech@gmail.com</a>)</div>
<div>Ryan Lynch (<a href="mailto:rlynch@physics.mcgill.ca" target="_blank">rlynch@physics.mcgill.ca</a>)</div>
<div>Jason Hessels (<a href="mailto:j.w.t.hessels@uva.nl" target="_blank">j.w.t.hessels@uva.nl</a>)</div><div>Cees Bassa (<a href="mailto:bassa@jb.man.ac.uk" target="_blank">bassa@jb.man.ac.uk</a>)</div><div>Joris Verbiest (<a href="mailto:joris.verbiest@gmail.com" target="_blank">joris.verbiest@gmail.com</a>)</div>
<div>Paul Demorest (<a href="mailto:pdemores@nrao.edu" target="_blank">pdemores@nrao.edu</a>)</div><div>Patrick Lazarus (<a href="mailto:plazarus@mpifr-bonn.mpg.de" target="_blank">plazarus@mpifr-bonn.mpg.de</a>)</div><div>
<br></div><div>
Everyone above has been added to the mailing list. Please be in touch with me if you want your email address changed, or removed. If there's anyone I've left off the list who you think would like to be involved in the discussion please let him/her know and send me the contact info.</div>
<div><br></div><div>It would help jump-start discussions if each of the PTAs could send details about their current pipelines and what output products are made and how they are stored. Please highlight details on what aspects of your databases/pipelines you think are good and which are bad. Please send around a brief memo with the above info, preferably by July 15th. (Thanks to Willem and George for already sending around information about their pipelines).</div>
<div><br></div><div>Thanks,</div><div>Patrick</div></div><div class="gmail_extra"><br><br><div class="gmail_quote"><div class="im">On 3 July 2013 23:33, Patrick Lazarus <span dir="ltr"><<a href="mailto:plazarus@mpifr-bonn.mpg.de" target="_blank">plazarus@mpifr-bonn.mpg.de</a>></span> wrote:<br>
</div><div><div class="h5"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi All,<div><br></div><div>On a few occasions during the IPTA Meeting last week, the question of what data products and information (in addition to the current IPTA timfile format) are required/useful for creating combined IPTA data sets, and for data analysis projects. NANOGrav, the PPTA and the EPTA are each developing different solutions to this problem. Ultimately, the data produced by each of these consortia will be combined into a single IPTA data set. Thus it makes sense for database, data reduction, and data combination groups across the IPTA to discuss requirements and possible solutions.</div>
<div><br></div><div>It is likely too late to collect all the information we'd like for the legacy data sets. However, now is probably the right time to start thinking about what is required for the next-generation data sets.<br>
</div><div><br></div><div>Following a brief discussion, it was mentioned that at the very least, the pipeline/databases of each of the three PTA projects should produce/track some common set of basic meta-data and diagnostics. Also, having compatible database schemas would likely be beneficial.Seeing as most of us are likely more interested in doing science, and not donkey-work, it may make sense to jointly develop tools, where possible.</div>
<div><br></div><div>With this in mind the following plan was proposed to stimulate discussion and collaboration:</div><div><br></div><div><div>0. (<i>By July 8th</i>) - Get a list of people involved in DB/Pipeline from NANOGrav, EPTA, PPTA. Create an exploder/mailing list.</div>
</div><div><div>1. (<i>By July 15th</i>) - Send details of current pipelines and what output products are made and how they are stored. Highlight details on what aspects of our databases/pipelines we think are good and which are bad.</div>
<div>2. (<i>By July 22nd</i>) - Comment on the information sent around to try and come up with a set of user-requirements for an IPTA pipeline/database.</div><div>3. (<i>Around July 22nd</i>) - Connect with IPTA data combination group to find out what would have found useful for the current IPTA data set.</div>
<div>4. (<i>At some point</i>) - Connect with the IPTA steering committee to let them know of our plans and ideas and to find out who else should be part of the process.</div><div><br></div><div>Please share your comments, objections, concerns, etc.</div>
<div><br></div><div>Looking forward to work together,</div><div>Patrick</div></div><div><div>
<div class="gmail_extra"><br><br><div class="gmail_quote">On 2 July 2013 04:47, Robert Ferdman <span dir="ltr"><<a href="mailto:rferdman@physics.mcgill.ca" target="_blank">rferdman@physics.mcgill.ca</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word">Hi Scott et al.,<div><br></div><div>I'm not sure whetehr Ryan or Glenn are on the nano-time list, so I've cc'd them here as well.</div>
<div><br></div><div>For future reference, the NANOGrav DB group's exploder is <a href="mailto:nano-db@nanograv.org" target="_blank">nano-db@nanograv.org</a>.</div><div><br></div><div>Cheers,</div><div><br></div><div>
Rob.</div>
<div><br></div><div><br><div>
<div><span style="border-collapse:separate;border-spacing:0px"><span style="border-collapse:separate;border-spacing:0px"><div style="word-wrap:break-word"><span style="border-collapse:separate;border-spacing:0px"><div style="word-wrap:break-word">
<span style="border-collapse:separate;border-spacing:0px"><div style="word-wrap:break-word"><div>-----------------------------------------------------------<br><b><font color="#005A22">Dr. Robert Ferdman<br></font></b>Research Associate<br>
<br></div><div>Department of Physics</div><div>McGill University<br>Ernest Rutherford Physics Building, room 315 <br>3600 rue University<br>Montréal, QC<br>Canada H3A 2T8 </div><div><br></div></div></span></div></span></div>
</span></span></div><br>
</div>
<br><div><div><div><div>On 1 Jul 2013, at 09:50, Scott Ransom <<a href="mailto:sransom@nrao.edu" target="_blank">sransom@nrao.edu</a>> wrote:</div><br></div></div><blockquote type="cite"><div><div>
Hi Patrick,<br><br>The relevant people are all (I think) on the nano-time mailing list. Plus Nate and Adam, who I've cc'd.<br><br>Scott<br><br>On 07/01/2013 09:36 AM, Patrick Lazarus wrote:<br><blockquote type="cite">
Hi George,<br><br>I agree with your recap.<br><br>I suggest we add<br><br>0. Get a list of people involved in DB/Pipeline from NANOGrav, EPTA,<br>PPTA. I'll create an exploder/mailing list.<br><br>Scott, can you let us know who from NANOGrav we should be in touch with.<br>
It would be good to get input from the DB group, as well as some of the<br>people responsible for the data reduction.<br><br>Thanks,<br>Patrick<br><br><br>On 29 June 2013 09:22, <<a href="mailto:George.Hobbs@csiro.au" target="_blank">George.Hobbs@csiro.au</a><br>
<<a href="mailto:George.Hobbs@csiro.au" target="_blank">mailto:George.Hobbs@csiro.au</a>>> wrote:<br><br> Hi Patrick,<br><br> Thanks for the organising the meeting with us on TOASTER. It does<br> look great and I'm sure that we can move forward with that (or<br>
similar) system and really improve the data sharing within the IPTA.<br><br> My understanding is that we were going to do something like the<br> following. Did I remember correctly?<br><br> 1. We'd all send you details of our current pipelines and what<br>
output products are made and how they are stored<br> 2. We'll include details on what aspects of our databases/pipelines<br> we think are good and which are bad<br> 3. We'll all comment on the information sent around to try and come<br>
up with a set of user-requirements for an IPTA pipeline/database<br> 4. We'll then see whether TOASTER meets this requirements, whether<br> it could with some changes or whether we should start again and<br>
design a system from scrath<br> 5. At some point you'll connect with Joris and his group to find out<br> what the "data putting together group" would have found useful for<br> the current IPTA data set<br>
6. At some point we'll all connect with the IPTA steering committee<br> to let them know of our plans and ideas and to find out who else<br> should be part of the process<br><br> Is that okay? To keep pushing this forward should we agree on<br>
getting you some comments on the current pipelines within 2 weeks?<br><br> Cheers,<br> George<br><br><br> *George Hobbs*<br> Research Scientist<br> Astronomy and Space Science<br> CSIRO<br><br> Phone: <a href="tel:%2B61%202%209372%204652" value="+61293724652" target="_blank">+61 2 9372 4652</a> <tel:%2B61%202%209372%204652><br>
<a href="mailto:george.hobbs@csiro.au" target="_blank">george.hobbs@csiro.au</a> <<a href="mailto:george.hobbs@csiro.au" target="_blank">mailto:george.hobbs@csiro.au</a>> *|*<br> <a href="http://www.csiro.au" target="_blank">www.csiro.au</a> <<a href="http://www.csiro.au/" target="_blank">http://www.csiro.au/</a>><br>
Address: PO Box 76, Epping NSW 1710<br> Australia (Cnr Vimiera & Pembroke Roads, Marsfield NSW, 2122)<br><br><br></blockquote><br>-- <br>Scott M. Ransom Address: NRAO<br>Phone: <a href="tel:%28434%29%20296-0320" value="+14342960320" target="_blank">(434) 296-0320</a> 520 Edgemont Rd.<br>
email: <a href="mailto:sransom@nrao.edu" target="_blank">sransom@nrao.edu</a> Charlottesville, VA 22903 USA<br>GPG Fingerprint: 06A9 9553 78BE 16DB 407B FFCA 9BFA B6FF FFD3 2989<br><br></div></div>-- <br><br>
<br></blockquote></div><br></div></div></blockquote></div><br></div></div></div></div>
</blockquote></div></div></div><br></div>
</div><br></div>