<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
</head>
<body>
<div style="word-wrap:break-word">
<div>
<blockquote type="cite"><br>
</blockquote>
Hi all,</div>
<div><br>
</div>
<div> This is the message that I sent around before to a small email distribution list about the PPTA pipeline.</div>
<div><br>
</div>
<div>Cheers,</div>
<div> George</div>
<div><br>
<div><br>
</div>
<br>
<blockquote type="cite">
<div>
<div style="word-wrap:break-word">Hi Patrick et al.,
<div><br>
</div>
<div> I have put together a document describing how the PPTA pipeline works and, at the end, given some notes on what I think is "good" and what is "bad" about our scripts (the document is attached to this email). Hopefully this will help if we try and use
a system similar to TOASTER for our pipelines and/or ToA access. Please let me know if anything isn't clear or if you'd like more information.</div>
<div><br>
</div>
<div>Cheers,</div>
<div> George</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
<div><span class="x_x_Apple-style-span" style="border-collapse:separate; font-family:Helvetica; font-style:normal; font-variant:normal; font-weight:normal; letter-spacing:normal; line-height:normal; orphans:2; text-indent:0px; text-transform:none; white-space:normal; widows:2; word-spacing:0px; font-size:medium">
<div style="word-wrap:break-word">
<div><span class="x_x_Apple-style-span" style="font-family:Calibri,sans-serif; font-size:15px"><b><span style="font-size:10pt; font-family:Arial,sans-serif; color:rgb(0,153,204)">George Hobbs</span></b></span><span class="x_x_Apple-style-span" style="font-family:Calibri,sans-serif; font-size:15px"><span style="font-size:9pt; font-family:Arial,sans-serif"><br>
Research Scientist</span></span></div>
<div><span class="x_x_Apple-style-span" style="font-family:Calibri,sans-serif; font-size:15px"><span style="font-size:9pt; font-family:Arial,sans-serif">Astronomy and Space Science<br>
CSIRO<br>
<br>
Phone: +61 2 9372 4652</span></span></div>
<div><span class="x_x_Apple-style-span" style="font-family:Calibri,sans-serif; font-size:15px"><span style="font-size:9pt; font-family:Arial,sans-serif"><span class="x_x_Apple-style-span" style="font-family:Helvetica; font-size:medium"><a href="mailto:george.hobbs@csiro.au"><span style="color:blue">george.hobbs@csiro.au</span></a></span> <b><span style="color:rgb(190,214,0)">|</span></b> <span style="color:rgb(0,153,204)"><a href="http://www.csiro.au/" style="color:blue; text-decoration:underline"><span style="color:blue">www.csiro.au</span></a></span><br>
Address: </span></span>PO Box 76, Epping NSW 1710</div>
Australia (Cnr Vimiera & Pembroke Roads, Marsfield NSW, 2122)</div>
</span></div>
<br>
<div>
<div>On 04/07/2013, at 7:33 AM, Patrick Lazarus <<a href="mailto:plazarus@mpifr-bonn.mpg.de">plazarus@mpifr-bonn.mpg.de</a>> wrote:</div>
<br class="x_x_Apple-interchange-newline">
<blockquote type="cite">
<div dir="ltr">Hi All,
<div><br>
</div>
<div>On a few occasions during the IPTA Meeting last week, the question of what data products and information (in addition to the current IPTA timfile format) are required/useful for creating combined IPTA data sets, and for data analysis projects. NANOGrav,
the PPTA and the EPTA are each developing different solutions to this problem. Ultimately, the data produced by each of these consortia will be combined into a single IPTA data set. Thus it makes sense for database, data reduction, and data combination groups
across the IPTA to discuss requirements and possible solutions.</div>
<div><br>
</div>
<div>It is likely too late to collect all the information we'd like for the legacy data sets. However, now is probably the right time to start thinking about what is required for the next-generation data sets.<br>
</div>
<div><br>
</div>
<div>Following a brief discussion, it was mentioned that at the very least, the pipeline/databases of each of the three PTA projects should produce/track some common set of basic meta-data and diagnostics. Also, having compatible database schemas would likely
be beneficial.Seeing as most of us are likely more interested in doing science, and not donkey-work, it may make sense to jointly develop tools, where possible.</div>
<div><br>
</div>
<div>With this in mind the following plan was proposed to stimulate discussion and collaboration:</div>
<div><br>
</div>
<div>
<div>0. (<i>By July 8th</i>) - Get a list of people involved in DB/Pipeline from NANOGrav, EPTA, PPTA. Create an exploder/mailing list.</div>
</div>
<div>
<div>1. (<i>By July 15th</i>) - Send details of current pipelines and what output products are made and how they are stored. Highlight details on what aspects of our databases/pipelines we think are good and which are bad.</div>
<div>2. (<i>By July 22nd</i>) - Comment on the information sent around to try and come up with a set of user-requirements for an IPTA pipeline/database.</div>
<div>3. (<i>Around July 22nd</i>) - Connect with IPTA data combination group to find out what would have found useful for the current IPTA data set.</div>
<div>4. (<i>At some point</i>) - Connect with the IPTA steering committee to let them know of our plans and ideas and to find out who else should be part of the process.</div>
<div><br>
</div>
<div>Please share your comments, objections, concerns, etc.</div>
<div><br>
</div>
<div>Looking forward to work together,</div>
<div>Patrick</div>
</div>
<div class="x_x_gmail_extra"><br>
<br>
<div class="x_x_gmail_quote">On 2 July 2013 04:47, Robert Ferdman <span dir="ltr">
<<a href="mailto:rferdman@physics.mcgill.ca" target="_blank">rferdman@physics.mcgill.ca</a>></span> wrote:<br>
<blockquote class="x_x_gmail_quote" style="margin:0 0 0 .8ex; border-left:1px #ccc solid; padding-left:1ex">
<div style="word-wrap:break-word">Hi Scott et al.,
<div><br>
</div>
<div>I'm not sure whetehr Ryan or Glenn are on the nano-time list, so I've cc'd them here as well.</div>
<div><br>
</div>
<div>For future reference, the NANOGrav DB group's exploder is <a href="mailto:nano-db@nanograv.org" target="_blank">
nano-db@nanograv.org</a>.</div>
<div><br>
</div>
<div>Cheers,</div>
<div><br>
</div>
<div>Rob.</div>
<div><br>
</div>
<div><br>
<div>
<div><span style="border-collapse:separate; border-spacing:0px">
<div style="word-wrap:break-word"><span style="border-collapse:separate; border-spacing:0px">
<div style="word-wrap:break-word"><span style="border-collapse:separate; border-spacing:0px">
<div style="word-wrap:break-word">
<div>-----------------------------------------------------------<br>
<b><font color="#005A22">Dr. Robert Ferdman<br>
</font></b>Research Associate<br>
<br>
</div>
<div>Department of Physics</div>
<div>McGill University<br>
Ernest Rutherford Physics Building, room 315 <br>
3600 rue University<br>
Montréal, QC<br>
Canada H3A 2T8 </div>
<div><br>
</div>
</div>
</span></div>
</span></div>
</span></div>
<br>
</div>
<br>
<div>
<div>
<div>On 1 Jul 2013, at 09:50, Scott Ransom <<a href="mailto:sransom@nrao.edu" target="_blank">sransom@nrao.edu</a>> wrote:</div>
<br>
</div>
<blockquote type="cite">
<div>Hi Patrick,<br>
<br>
The relevant people are all (I think) on the nano-time mailing list. Plus Nate and Adam, who I've cc'd.<br>
<br>
Scott<br>
<br>
On 07/01/2013 09:36 AM, Patrick Lazarus wrote:<br>
<blockquote type="cite">Hi George,<br>
<br>
I agree with your recap.<br>
<br>
I suggest we add<br>
<br>
0. Get a list of people involved in DB/Pipeline from NANOGrav, EPTA,<br>
PPTA. I'll create an exploder/mailing list.<br>
<br>
Scott, can you let us know who from NANOGrav we should be in touch with.<br>
It would be good to get input from the DB group, as well as some of the<br>
people responsible for the data reduction.<br>
<br>
Thanks,<br>
Patrick<br>
<br>
<br>
On 29 June 2013 09:22, <<a href="mailto:George.Hobbs@csiro.au" target="_blank">George.Hobbs@csiro.au</a><br>
<<a href="mailto:George.Hobbs@csiro.au" target="_blank">mailto:George.Hobbs@csiro.au</a>>> wrote:<br>
<br>
Hi Patrick,<br>
<br>
Thanks for the organising the meeting with us on TOASTER. It does<br>
look great and I'm sure that we can move forward with that (or<br>
similar) system and really improve the data sharing within the IPTA.<br>
<br>
My understanding is that we were going to do something like the<br>
following. Did I remember correctly?<br>
<br>
1. We'd all send you details of our current pipelines and what<br>
output products are made and how they are stored<br>
2. We'll include details on what aspects of our databases/pipelines<br>
we think are good and which are bad<br>
3. We'll all comment on the information sent around to try and come<br>
up with a set of user-requirements for an IPTA pipeline/database<br>
4. We'll then see whether TOASTER meets this requirements, whether<br>
it could with some changes or whether we should start again and<br>
design a system from scrath<br>
5. At some point you'll connect with Joris and his group to find out<br>
what the "data putting together group" would have found useful for<br>
the current IPTA data set<br>
6. At some point we'll all connect with the IPTA steering committee<br>
to let them know of our plans and ideas and to find out who else<br>
should be part of the process<br>
<br>
Is that okay? To keep pushing this forward should we agree on<br>
getting you some comments on the current pipelines within 2 weeks?<br>
<br>
Cheers,<br>
George<br>
<br>
<br>
*George Hobbs*<br>
Research Scientist<br>
Astronomy and Space Science<br>
CSIRO<br>
<br>
Phone: <a href="tel:%2B61%202%209372%204652" value="+61293724652" target="_blank">
+61 2 9372 4652</a> <tel:%2B61%202%209372%204652><br>
<a href="mailto:george.hobbs@csiro.au" target="_blank">george.hobbs@csiro.au</a> <<a href="mailto:george.hobbs@csiro.au" target="_blank">mailto:george.hobbs@csiro.au</a>> *|*<br>
<a href="http://www.csiro.au/" target="_blank">www.csiro.au</a> <<a href="http://www.csiro.au/" target="_blank">http://www.csiro.au/</a>><br>
Address: PO Box 76, Epping NSW 1710<br>
Australia (Cnr Vimiera & Pembroke Roads, Marsfield NSW, 2122)<br>
<br>
<br>
</blockquote>
<br>
-- <br>
Scott M. Ransom Address: NRAO<br>
Phone: <a href="tel:%28434%29%20296-0320" value="+14342960320" target="_blank">(434) 296-0320</a> 520 Edgemont Rd.<br>
email: <a href="mailto:sransom@nrao.edu" target="_blank">sransom@nrao.edu</a> Charlottesville, VA 22903 USA<br>
GPG Fingerprint: 06A9 9553 78BE 16DB 407B FFCA 9BFA B6FF FFD3 2989<br>
<br>
</div>
-- <br>
<br>
<br>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
</div>
</div>
</div>
<div style="word-wrap:break-word">
<div></div>
</div>
</div>
</blockquote>
</div>
</div>
<div style="word-wrap:break-word">
<div>
<blockquote type="cite"></blockquote>
</div>
<br>
</div>
</body>
</html>