<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none"><!-- p { margin-top: 0px; margin-bottom: 0px; }--></style>
</head>
<body dir="ltr" style="font-size:12pt;color:#000000;background-color:#FFFFFF;font-family:Calibri,Arial,Helvetica,sans-serif;">
<p>Hi everyone,<br>
</p>
<p><br>
</p>
<p>I am writing this email in the hope to consolidate feedback from your experiences with accessing large pulsar data collections from CSIRO's Data Access Portal (https://data.csiro.au/dap). Please forward this email on to others who may be accessing data in this
way.<br>
</p>
<p><br>
</p>
<p>Access of large data collections (in order of ~1.5 TB each) from the DAP present not only challenges to network infrastructure and logistics, but are likely to have the most impact on user experience.<br>
</p>
<p><br>
</p>
<p>However, given data volumes are already rising with the arrival of the UWL receiver (up to ~30 TB/day), accessing any data from the Parkes radio telescope will be a significant challenge, hence the importance of working on a better solutions. <br>
</p>
<p><br>
</p>
<p>We will need to begin to focus on the concept of 'bringing the user to the data', not the data to the user. With this in mind I am implementing a suite of virtual machines for cloud-based data access and/or pulsar data processing.<br>
</p>
<p><br>
</p>
<p>So in an effort to ensure that you gain access to your data in a timely manner, please send me as much feedback as you are able. For example, collating details such as the following would be extremely useful:<br>
</p>
<ul dir="" class="" style="">
<li>the <span style="font-size: 12pt;">ability to </span><span style="font-size: 12pt;">find</span><span style="font-size: 12pt;"> your data (e.g. whether you were able to search and find the data you needed)</span></li><li><span style="font-size: 12pt;">data availability timefra</span><span style="font-size: 12pt;">me (e.g. the time between requesting the data and retrieving the data)</span></li><li><span style="font-size: 12pt;"></span><span style="font-size: 12pt;">download speed (e.g. MB/s)</span><br>
</li><li><span style="font-size: 12pt;">download problems (e.g. timeouts, permissions)</span></li><li><span style="font-size: 12pt;">protocols used for downloading (e.g. wget, sftp, rsync)</span></li><li><span style="font-size: 12pt;">screenshots of errors</span></li></ul>
<p><br>
</p>
<p>Thanks for all your help with this. If you have problems accessing your data from DAP, please do not hesitate to ask me for help.<br>
</p>
<p><br>
</p>
<p>Documentation on DAP data access is also available at the following link:<br>
</p>
<p><a href="https://confluence.csiro.au/display/daphelp/Access+or+Download+Data">https://confluence.csiro.au/display/daphelp/Access+or+Download+Data</a><br>
</p>
<p><br>
</p>
<p><br>
</p>
<p><br>
</p>
<p>Regards,<br>
</p>
<p><br>
</p>
<p><br>
</p>
<p><br>
</p>
<div id="Signature">
<div style="font-family:Tahoma; font-size:13px">
<div style="font-family:Tahoma; font-size:13px">
<div style="font-family:Tahoma; font-size:13px">
<div style="font-family:Tahoma; font-size:13px">
<div style="font-family:Tahoma; font-size:13px">
<div style="font-family:Tahoma"><br>
<div class="BodyFragment"><font>
<div class="PlainText"><font color="#008000" size="3">Lawrence Toomey</font><br>
Research Technician: Pulsar data archives<br>
CSIRO Astronomy and Space Science (CASS)<br>
Marsfield, NSW 2122</div>
</font><br>
<font>
<div class="PlainText" style="font-size:13px">Office hours: Wed, Thurs, Fri <br>
10am - 2pm<br>
<br>
<font>Phone: +61293724572</font><br>
</div>
</font></div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>