tag:blogger.com,1999:blog-16700732870045319212024-03-19T08:32:22.230-04:00magicjavaA blog that's not about magic and not about coffee.Unknownnoreply@blogger.comBlogger134125tag:blogger.com,1999:blog-1670073287004531921.post-33726418622534327782010-12-10T09:07:00.000-05:002010-12-10T09:07:31.031-05:00Winding DownJust a short post to announce I'll be wrapping up this blog in the near future. This is mostly due to the complete collapse of the environmental movement's credibility. While the movement still exists and there are still battles to be fought, there are plenty of people capable of doing it without my help. This allows me to turn my attention to matters in my personal world.<br />
<br />
I hope to get the Climate Scientist version 2.0 out and check NASA numbers from the FOIA stuff, and wrap up any other loose ends that come to mind. But these updates will come only as time permits and once they're done, so too will this blog be done.Unknownnoreply@blogger.com4tag:blogger.com,1999:blog-1670073287004531921.post-73767871857169345232010-12-10T03:05:00.001-05:002010-12-10T03:22:35.883-05:00NASA Responds To FOIA Request<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiQ966cqXjsFHXfRFNzuhCqZOKREgO4AxE8IgblESC03SDbY3wRiCCDfp0B7vL9Gxgi5V6_sLg0v0vxVSn4dsdTu0XQBh5p1XdaL-IY1oOE3WY-WO8ZYEribowfTQ2tW-Q-B98kC7ZWw7w/s1600/foia.gif" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiQ966cqXjsFHXfRFNzuhCqZOKREgO4AxE8IgblESC03SDbY3wRiCCDfp0B7vL9Gxgi5V6_sLg0v0vxVSn4dsdTu0XQBh5p1XdaL-IY1oOE3WY-WO8ZYEribowfTQ2tW-Q-B98kC7ZWw7w/s1600/foia.gif" /></a></div>NASA has responded to my FOIA Request. To recap, I requested two items from NASA: 1) the height in the atmosphere scanned by each footprint for each scan of the Aqua satellite, and 2) the Ai and Theta Bar i used by NASA to calculate the synthetic values for Aqua's channel 4.<br />
<br />
Their response was that there are no records for the height of the footprint scans on the Aqua satellite and that the values for Ai and Theta Bar i are as follows:<br />
<br />
<code>A(i) = 0.38648412E-1, -0.13865858, 0.60949275, 0., 2.0037199, -0.95993573, 0., 0.28063577, -0.9307997E-1, 0.37032401E-1, -0.15795620E-2, -0.49943969E-2, -0.11815043E-1, 0.70557197E-1, -0.33432437E-1<br />
<br />
thetabar(i) = A_mean(i) * amsu_noise_tr(i) where:<br />
<br />
A_mean(i) = 1200.2806, 901.08093, 949.21509, 0., 1242.5841, 1382.2343, 0., 1359.1735, 1323.4860, 975.67328, 920.14246, 654.80048, 499.30478, 313.854318, 1955.0244<br />
<br />
amsu_noise_tr(i) = 0.17, 0.22, 0.25, 0.14, 0.20, 0.17, 0.14, 0.16, 0.16, 0.22, 0.24, 0.35, 0.48, 0.80, 0.12</code><br />
<br />
Notice that each of these collections of numbers contains 15 numbers. These correspond to the 15 channels on the Aqua satellite.<br />
<br />
I still need to check that the above values, when used in NASA's formula for creating synthetic channel 4 data, actually produce the published values for that channel.<br />
<br />
I'm out of ideas on how to obtain the height in the atmosphere each footprint scans.<br />
<br />
<b>Previous Posts In This Series</b><br />
<a href="http://magicjava.blogspot.com/2010/05/appealing-nasas-foia-decision.html">Appealing NASA's FOIA Decision</a><br />
<a href="http://magicjava.blogspot.com/2010/04/nasa-responds-to-foia-request.html">NASA Responds To FOIA Request</a><br />
<a href="http://magicjava.blogspot.com/2010/04/quick-foia-update.html">Quick FOIA Update</a><br />
<a href="http://magicjava.blogspot.com/2010/04/government-way.html">The Government Way</a><br />
<a href="http://magicjava.blogspot.com/2010/04/foia-request-filed-with-nasa.html">FOIA Request Filed With NASA</a>Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-1670073287004531921.post-29204753378107491162010-05-04T00:59:00.003-04:002010-05-04T02:00:55.192-04:00Appealing NASA's FOIA Decision<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiQ966cqXjsFHXfRFNzuhCqZOKREgO4AxE8IgblESC03SDbY3wRiCCDfp0B7vL9Gxgi5V6_sLg0v0vxVSn4dsdTu0XQBh5p1XdaL-IY1oOE3WY-WO8ZYEribowfTQ2tW-Q-B98kC7ZWw7w/s1600/foia.gif" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" height="175" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiQ966cqXjsFHXfRFNzuhCqZOKREgO4AxE8IgblESC03SDbY3wRiCCDfp0B7vL9Gxgi5V6_sLg0v0vxVSn4dsdTu0XQBh5p1XdaL-IY1oOE3WY-WO8ZYEribowfTQ2tW-Q-B98kC7ZWw7w/s200/foia.gif" width="200" /></a></div>I've decided to appeal the FOIA decision from NASA, JPL. To do this I have to write out a hard copy letter and snail mail it to the appeals office. Here's the copy of that letter:<br />
<br />
<blockquote>Dear Sirs,<br />
<br />
I'm writing this letter to appeal a FOIA decision involving NASA JPL. The decision involved 3 issues, the first of which has been resolved. For the second and third decision, I've included relevant background information as well as the reason I'm appealing.<br />
<br />
<b>Issue 1: Radiative Transfer Algorithm Used By AIRS.</b><br />
Status: Resolved.<br />
<br />
<b>Issue 2: Atmospheric Scan Depth Of Aqua Satellite AMSU Channel 5 Footprints.</b><br />
<br />
<i>Background</i><br />
The Aqua satellite has an AMSU instrument that scans the atmosphere at 15 different channels. Each of these channels scans 30 different locations in the atmosphere. These locations are sometimes referred to as "footprints". Each footprint scans at a different height in the atmosphere.<br />
<br />
<i>NASA Discussion On How This Data Is Used</i><br />
Where reliable sensor data is available, it is applied directly to the appropriate portion of the atmosphere, taking into account the angle of the observation.<br />
- Steven Friedman, NASA JPL, Personal Correspondance (Included)<br />
<br />
<i>My FOIA Request</i><br />
(2) Atmospheric scan depth for each footprint on channel 5 of the AQUA AMSU.<br />
<br />
<i>FOIA Response</i><br />
This is to advise that NASA has no responsive Government records at JPL for parts (2) and (3) of your request.<br />
<br />
<i>Why I'm Appealing This Decision</i><br />
NASA JPL has indicated that they apply each scan to the appropriate portion of the atmosphere. This is impossible to do if it is unknown at what depth of the atmosphere a given footprint is scanning.<br />
<br />
<b>Issue 3: The 230000 Scan Readings And/Or The Values Of Vectors Ai And Theta Bar i Used To Synthesis Aqua AMSU Channel 4 Data</b><br />
<br />
<i>Background</i><br />
Aqua's AMSU channel 4 failed in late 2007, as described in AMSU-A Channel 4 NeDT Update: 20 December 2007 at the document archive. The data for channel 4 is now artificially generated. The generation process uses two vectors, Ai and Theta Bar i. The values for these vectors is not available to the public. The data for the vectors was itself generated from 230000 scans taken from the AMSU. This data is also not available to the public.<br />
<br />
<i>NASA Discussion On How This Data Is Used</i><br />
See AIRS/AMSU/HSB Version 5 Modification of Algorithm to Account for Increased NeDT in AMSU Channel 4 at http://disc.sci.gsfc.nasa.gov/AIRS/documentation/v5_docs/AIRS_V5_Release_User_Docs/V5-Modification-for-AMSU-Ch-4-NeDT.pdf for a detailed discussion on this data. In particular, see equation (1) for the use of Ai and Theta Bar i.<br />
<br />
<i>My FOIA Request</i><br />
(3) In references to the creation of synthetic readings for the AQUA AMSU channel 4, the 230000 cases used to create the values for the vectors Ai and Theta Bar i, or the values of vectors Ai and Theta Bar i themselves if the 230000 readings are no longer available. These values and readings are referenced but not actually provided in the document AIRS/AMSU/HSB Version 5 Modification of Algorithm to Account for Increased NeDT in AMSU Channel 4 available online at http://disc.sci.gsfc.nasa.gov/AIRS/documentation/v5_docs/AIRS_V5_Release_User_Docs/V5-Modification-for-AMSU-Ch-4-NeDT.pdf..."<br />
<br />
<i>FOIA Response</i><br />
This is to advise that NASA has no responsive Government records at JPL for parts (2) and (3) of your request.<br />
<br />
<i>Why I'm Appealing This Decision</i><br />
NASA JPL has indicated that this data is used to generate the synthesized channel 4 data. This would be impossible to do if the values for vectors Ai and Theta Bar i were not known to them, as these values are two of the four values used to generate the synthesized data.<br />
<br />
Note that NASA JPL also indicated that NASA GSFC may have responsive records for issue 3. I am in contact with them to see if this is the case, but as my ability to appeal this decision is limited to 30 days, I am simultaneously appealing.<br />
<br />
Thank you for you time and help in this matter.</blockquote><br />
...and the e-mail sent to NASA, GSFC for the data used to generate synthetic channel 4 values:<br />
<br />
<blockquote>I was informed by Dennis B. Mahon of NASA, JPL that NASA GSFC may have information regarding data used to generate synthetic channel 4 data for Aqua's AMSU channel 4. Specifically, I am looking for he 230000 cases used to create the values for the vectors Ai and Theta Bar i, or the values of vectors Ai and Theta Bar i themselves if the 230000 readings are no longer available. These values and readings are referenced but not actually provided in the document AIRS/AMSU/HSB Version 5 Modification of Algorithm to Account for Increased NeDT in AMSU Channel 4 available online at http://disc.sci.gsfc.nasa.gov/AIRS/documentation/v5_docs/AIRS_V5_Release_User_Docs/V5-Modification-for-AMSU-Ch-4-NeDT.pdf..."<br />
<br />
See equation (1) of the referenced PDF for specific details.<br />
<br />
Please note that this request is associated with a FOIA involving NASA, JPL that is currently under appeal.</blockquote><br />
<b>Previous Posts In This Series</b><br />
<a href="http://magicjava.blogspot.com/2010/04/nasa-responds-to-foia-request.html">NASA Responds To FOIA Request</a><br />
<a href="http://magicjava.blogspot.com/2010/04/quick-foia-update.html">Quick FOIA Update</a><br />
<a href="http://magicjava.blogspot.com/2010/04/government-way.html">The Government Way</a><br />
<a href="http://magicjava.blogspot.com/2010/04/foia-request-filed-with-nasa.html">FOIA Request Filed With NASA</a>Unknownnoreply@blogger.com4tag:blogger.com,1999:blog-1670073287004531921.post-84474017100783016932010-05-02T22:32:00.003-04:002010-05-03T05:13:06.034-04:00Aqua Satellite Project, Update 10 Released.Update 10 for the Aqua Satellite Project is ready. You can download it <a href="https://sourceforge.net/projects/aquasatellite/files/Aqua%20Satellite.zip/download" style="color: #223344;">here</a>. This update is part 2 of a 2 part release that adds global griding of the data. <br />
<br />
This release adds the <code>ISCCPSummarize</code> program that summarizes ISCCP grid-style data generated by <code>AMSUToGrid</code> and the <code>ISCCPNormalize</code> program that normalizes output files from <code>ISCCPSummarize</code> on a scale of 0.0 to 1.0.<br />
<br />
This release also fixed a bug in the <code>AMSUToGrid</code> class DegreeGrid that was passing grid edge rather than grid center to weights, replaced custom code in DegreeGrid to calculate grid locations with code that uses official ISCCP values, and added mask images and generated grid data to MapToGrid folder. Masks are in the Masks subfolder, generated grid data is in the Generated Grid Data subfolder. There are Masks and generated data for Africa, Antarctica, Arctic Ocean, Asia, Atlantic Ocean, Australia, Europe, Indian Ocean, Land and Water, North America, Pacific Ocean, South America, Southern Ocean, and US Lower 48 States. Generated data is in text, XML, JavaScript, and C code formats.<br />
<br />
<b>Regional Data</b><br />
In addition to summarizing data for the entire globe, the <code>ISCCPSummarize</code> program provides summaries for the following regions:<br />
<br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhHFKEPgqQ0yhpPBFw-ES8-VcRBruCcyqZNMApUGAW1Wk1NQQRxYfCrDa76U2UdDg6Cd9jgHuXQT8uNLAikyaqCfAWe_g_EZQ2JN8jiXNqFuX6NxOP_KuMKMcQEc8KLeKvrwoAn45O4FD8/s1600/MaskAfrica.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="200" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhHFKEPgqQ0yhpPBFw-ES8-VcRBruCcyqZNMApUGAW1Wk1NQQRxYfCrDa76U2UdDg6Cd9jgHuXQT8uNLAikyaqCfAWe_g_EZQ2JN8jiXNqFuX6NxOP_KuMKMcQEc8KLeKvrwoAn45O4FD8/s400/MaskAfrica.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Africa</b></div><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhBIn5s_i9FclzUBy-SXG4P7m7md7PBSUW6uO3lkfYe_tZTlLOVjRVcliW5NT8TyXi_sbnpC5dvxXXU1AKmugP-StwzVR_37hRnFYRkLFwu-iwlWE8jvLN13OIFf8b26eRhoRfvxs8mUhQ/s1600/MaskAntarctica.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="200" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhBIn5s_i9FclzUBy-SXG4P7m7md7PBSUW6uO3lkfYe_tZTlLOVjRVcliW5NT8TyXi_sbnpC5dvxXXU1AKmugP-StwzVR_37hRnFYRkLFwu-iwlWE8jvLN13OIFf8b26eRhoRfvxs8mUhQ/s400/MaskAntarctica.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Antarctica</b></div><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhzvFRv9-36o87MyizgQNC9LMQvG4SBB0JVCw6nq2478HTttJ2HLYwDNFNQhMisLLjvslNGm7cvUBjHl4BmVGRd9OpbXimhCq_Hr3r1fVkgw312ODkEzMftYLYFQ6NX-qdFApdFSXQ2Zsk/s1600/MaskAsia.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="200" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhzvFRv9-36o87MyizgQNC9LMQvG4SBB0JVCw6nq2478HTttJ2HLYwDNFNQhMisLLjvslNGm7cvUBjHl4BmVGRd9OpbXimhCq_Hr3r1fVkgw312ODkEzMftYLYFQ6NX-qdFApdFSXQ2Zsk/s400/MaskAsia.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Asia</b></div><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiwA0Mr70zyLk8VbeW0tc-jTY9RGNxDVuCG8JvFNR-ur4xjVLXUCp7cVPcskV5AznbAoFZ1fCcLBh_FaqNSrZgkSUC-hPtvtOAILPcF3ZWhyYm5LYJ-llBxYL_eOsXGNSLrJXYqFiQgu8U/s1600/MaskAustralia.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="200" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiwA0Mr70zyLk8VbeW0tc-jTY9RGNxDVuCG8JvFNR-ur4xjVLXUCp7cVPcskV5AznbAoFZ1fCcLBh_FaqNSrZgkSUC-hPtvtOAILPcF3ZWhyYm5LYJ-llBxYL_eOsXGNSLrJXYqFiQgu8U/s400/MaskAustralia.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Australia</b></div><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiZ-o5zzIdkOzgMw_D0SUZENtgdJZfhA8rYkVzOyYrb84qVT5sre52Jan56DlYnH9tyJLC2t1Z3NEB9hC96bCk4G7QyTz3l0O5diA-pDOwSreu5wos8tyq1Cdt2Qx53jNHGX-i9gtUyM9E/s1600/MaskEurope.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="200" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiZ-o5zzIdkOzgMw_D0SUZENtgdJZfhA8rYkVzOyYrb84qVT5sre52Jan56DlYnH9tyJLC2t1Z3NEB9hC96bCk4G7QyTz3l0O5diA-pDOwSreu5wos8tyq1Cdt2Qx53jNHGX-i9gtUyM9E/s400/MaskEurope.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Europe</b></div><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgNoHglw0Vv7m6ezhwdStaG1O1T9yM9DdnZ_aTpRx5Sy6u1iZ_CB4CMcQVwEh2avkvdav6uAO9EjCi78RGzmm6ToivaoBrDJZbGbiIkNL19r3W733o2l-0wOrkRtIEehM1T_Bh0eBiTcyk/s1600/MaskNorthAmerica.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="200" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgNoHglw0Vv7m6ezhwdStaG1O1T9yM9DdnZ_aTpRx5Sy6u1iZ_CB4CMcQVwEh2avkvdav6uAO9EjCi78RGzmm6ToivaoBrDJZbGbiIkNL19r3W733o2l-0wOrkRtIEehM1T_Bh0eBiTcyk/s400/MaskNorthAmerica.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>North America</b></div><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjzahn2wyCMfA6bmC8d9O58oBqW4fEDddaE-eNAsmGSvELn3cSRyWbdCwCfwNVyUx4c0HfVeaNZuysY0xfpTMs87SLCSBLc-m3ZC5Fv5vWuhM7UG_zCEufF50Mt5lOSUa0S7CLPcO_AcUE/s1600/MaskSouthAmerica.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="200" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjzahn2wyCMfA6bmC8d9O58oBqW4fEDddaE-eNAsmGSvELn3cSRyWbdCwCfwNVyUx4c0HfVeaNZuysY0xfpTMs87SLCSBLc-m3ZC5Fv5vWuhM7UG_zCEufF50Mt5lOSUa0S7CLPcO_AcUE/s400/MaskSouthAmerica.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>South America</b></div><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi8iYK9lpmR820j0IlKAhQ7ClGkutg7aKEnfwAU3l59HLwX4PYv75Q6h6xyKkRnPxDQUxRuu2IHRe6kr-JCnDFjXH9nK4c5I0toIxgUV-tfHemDUKW1bX02aFPsAqKCwNvcACpkKA9yA5Y/s1600/MaskArcticOcean.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="200" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi8iYK9lpmR820j0IlKAhQ7ClGkutg7aKEnfwAU3l59HLwX4PYv75Q6h6xyKkRnPxDQUxRuu2IHRe6kr-JCnDFjXH9nK4c5I0toIxgUV-tfHemDUKW1bX02aFPsAqKCwNvcACpkKA9yA5Y/s400/MaskArcticOcean.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Arctic Ocean</b></div><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiLzvC14HHRQ4nkLy2V3BAO43q5HGmwWYdAVVVCs2iw5ePm8j_JMR9QLCqJT_Bm1dlRD5cdLn_wx1TCf-mjb6bbENEjsQBMlCNHlZ_vENYErds0MumfDjIMFQ_WaVVF-FJUkO9tSbpJUts/s1600/MaskAtlanticOcean.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="200" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiLzvC14HHRQ4nkLy2V3BAO43q5HGmwWYdAVVVCs2iw5ePm8j_JMR9QLCqJT_Bm1dlRD5cdLn_wx1TCf-mjb6bbENEjsQBMlCNHlZ_vENYErds0MumfDjIMFQ_WaVVF-FJUkO9tSbpJUts/s400/MaskAtlanticOcean.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Atlantic Ocean</b></div><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgbjuEEys0-EAML1rZfzMT0GywPu6rGpBxaitC9SSODx-26zL_zSnxTCeqlPCYPYKPKN4gV3ePgtV5goZpx6W9G9Kxiq5NiaxfsuLDWr5hyphenhyphen1cgs6FyGoNc5lHlSrNcKAOIkChMyVL4WTaI/s1600/MaskIndianOcean.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="200" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgbjuEEys0-EAML1rZfzMT0GywPu6rGpBxaitC9SSODx-26zL_zSnxTCeqlPCYPYKPKN4gV3ePgtV5goZpx6W9G9Kxiq5NiaxfsuLDWr5hyphenhyphen1cgs6FyGoNc5lHlSrNcKAOIkChMyVL4WTaI/s400/MaskIndianOcean.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Indian Ocean</b></div><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjuGTn8hRamcdVdiUsK4usD8_CE6KJNu0yMtxU2txxQ4dpPHYz9wxN97Uz7YgVSYgxOmePmPfcQoS544zfRJ6dwMaAOQDeAn-dHFsalNCXaU7nKFR6DT2eIZVo0mkceDaQ0b0BpoxXq8tk/s1600/MaskPacificOcean.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="200" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjuGTn8hRamcdVdiUsK4usD8_CE6KJNu0yMtxU2txxQ4dpPHYz9wxN97Uz7YgVSYgxOmePmPfcQoS544zfRJ6dwMaAOQDeAn-dHFsalNCXaU7nKFR6DT2eIZVo0mkceDaQ0b0BpoxXq8tk/s400/MaskPacificOcean.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Pacific Ocean</b></div><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi0RdxV2C9ktsPKeE4KAlwVUIo_9EWsIAVAWe1PvJ8hXd6JPRoLkegvdjIbvK-eDPNE_QWibaERc-yI28NQxFzLSX_hXkW-KNyCNqroXNShiCUC98bP9dTkiXYXfJxGshnc0Zy5gFsk8oY/s1600/MaskSouthernOcean.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="200" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi0RdxV2C9ktsPKeE4KAlwVUIo_9EWsIAVAWe1PvJ8hXd6JPRoLkegvdjIbvK-eDPNE_QWibaERc-yI28NQxFzLSX_hXkW-KNyCNqroXNShiCUC98bP9dTkiXYXfJxGshnc0Zy5gFsk8oY/s400/MaskSouthernOcean.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Southern Ocean</b></div><br />
...and the following UAH-like regions:<br />
<br />
● Global Land<br />
● Global Ocean<br />
● Northern Hemisphere<br />
● Northern Hemisphere Land<br />
● Northern Hemisphere Ocean<br />
● Southern Hemisphere<br />
● Southern Hemisphere Land<br />
● Southern Hemisphere Ocean<br />
● Northern Extra Tropics<br />
● Northern Extra Tropics Land<br />
● Northern Extra Tropics Ocean<br />
● Southern Extra Tropics<br />
● Southern Extra Tropics Land<br />
● Southern Extra Tropics Ocean<br />
● North Pole<br />
● North Pole Land<br />
● North Pole Ocean<br />
● South Pole<br />
● South Pole Land<br />
● South Pole Ocean<br />
● U.S.A. Lower 48 States<br />
<br />
These UAH regions use the same latitude boundaries as genuine UAH regions do. My thanks to Dr. Christy of UAH for providing me with the UAH region boundary information.Unknownnoreply@blogger.com1tag:blogger.com,1999:blog-1670073287004531921.post-10288228586821521412010-04-29T06:29:00.022-04:002010-05-01T19:34:22.301-04:00Three-Valued Logic And Irreproducible Results In Science, Part II<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEicrEAntAeVSm5p4P5mwiNRj2KAeJJC4w_DCjLTNcolNvLO48L0s5D9hXmt0GVy3ZPcz3MpdogOvCLKXmU7KivVKTLaE7RJahJwsA78bJEFGHkz_zLp_jc7LfTWP6djKIdifTd13RxPJFM/s1600/Db_null.png" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" height="200" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEicrEAntAeVSm5p4P5mwiNRj2KAeJJC4w_DCjLTNcolNvLO48L0s5D9hXmt0GVy3ZPcz3MpdogOvCLKXmU7KivVKTLaE7RJahJwsA78bJEFGHkz_zLp_jc7LfTWP6djKIdifTd13RxPJFM/s200/Db_null.png" width="200" /></a><b>Introduction</b><br />
In the <a href="http://magicjava.blogspot.com/2010/04/three-valued-logic-and-irreproducible.html">previous post for this series</a> we discussed how Two-Valued and Three-Valued Logic works. In this post we take a look at how Three-Valued Logic (3VL) interacts with the results of science. We'll be using the properties of 3VL's three truth values, True, False, and Unknown, to do this.<br />
<br />
In particular we'll be examining how the truth value Unknown of 3VL spreads through science like a virus. In fact, we'll make the claim that scientific results that have unverifiable claims that cannot be independently reproduced <i>are</i> viruses. Any further work that builds upon them is infected and becomes unverifiable and irreproducible itself.<br />
<br />
<b>Scientific Claims Must Be Verified</b><br />
<div class="separator" style="clear: both; text-align: center;"></div><div class="separator" style="clear: both; text-align: center;"><a href="http://mcmannes.files.wordpress.com/2009/03/coldfusion_time.jpg" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" height="200" src="http://mcmannes.files.wordpress.com/2009/03/coldfusion_time.jpg" width="151" /></a></div>In science, it's not enough to simply make a claim. Claims must be independently verifiable before they are accepted. <br />
<br />
When the procedures of the claim are followed and the results of the claim are reproduced, the claim is said to be True. When the procedures of the claim are followed and the results of the claim are not reproduced, the claim is said to be False. An example of a scientific claim being shown False is <a href="http://en.wikipedia.org/wiki/Cold_fusion">the original Cold Fusion hypothesis by Martin Fleischmann and Stanley Pons</a>.<br />
<br />
However, in situations where the procedures of the claim cannot be followed, we cannot show the claim to be True or False. It is in these cases that the need for 3VL arises, and the truth of the claim is Unknown.<br />
<br />
<span class="Apple-style-span" style="background-color: yellow;">Technical Aside: Cold fusion research has continued since the days of Fleischmann and Pons. Today it is funded by several governments around the world and many researchers in the field believe that the original claims of Fleischmann and Pons have been vindicated. However, several mainstream scientific organizations still disagree, most notably the U.S. Department of Energy and Science magazine. For more information on the ongoing cold fusion research, see the </span><a href="http://www.lenr-canr.org/"><span class="Apple-style-span" style="background-color: yellow;"><b>LENR-CANR website</b></span></a><span class="Apple-style-span" style="background-color: yellow;">.</span><br />
<br />
<b>Example: Aqua Satellite Channel 4 Virus</b><br />
It helps to have an example, so we'll be using channel 4 of the AMSU on the Aqua satellite. Channel 4 failed completely around December, 2007. In response to this, NASA created a new algorithm and has used it to synthetically create channel 4 data from October 1st, 2007 onward.<br />
<br />
While NASA publishes the algorithm used to create synthetic channel 4 values, that algorithm requires certain data that is not available to anyone outside of NASA. Even the folks at NASA's JPL, who are in charge of the Aqua satellite, <a href="http://magicjava.blogspot.com/2010/04/nasa-responds-to-foia-request.html">have said they don't have access to the data</a>.<br />
<br />
Without this data it's impossible to verify if the algorithm for synthesizing channel 4 data is correct, even though the algorithm itself is published. Similarly, we cannot demonstrate that the algorithm fails to correctly synthesis channel 4 data. Therefore, the ability of the algorithm to correctly synthesis data must be classified as Unknown because the statement that the algorithm is accurate cannot independently be shown to be True or False.<br />
<br />
<b>How The Virus Spreads</b><br />
To qualify as a virus, the Unknown values must be capable of spreading to other works. To see how this occurs, let's first take a look at how False research is capable of spreading.<br />
<br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh9V3R0c5rOkZjbpbc44d-7NPajca5fPfjZa19IC5tMy5TYE94bFelV5ssOQQGnlBQdCZc0qc7sVQZglwsY6wsrYmC2EFDpwCbfknQqhdzzDBN5yLk8nzwtgc4egzxqxktqE8nmDDz7pT4/s1600/ANDFalse.png" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" height="160" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh9V3R0c5rOkZjbpbc44d-7NPajca5fPfjZa19IC5tMy5TYE94bFelV5ssOQQGnlBQdCZc0qc7sVQZglwsY6wsrYmC2EFDpwCbfknQqhdzzDBN5yLk8nzwtgc4egzxqxktqE8nmDDz7pT4/s320/ANDFalse.png" width="320" /></a></div>We take the example of research attempting to build upon claims that have been demonstrated False, in this case Cold Fusion. The diagram above shows new research that is correct being combined with the results of Cold Fusion. Because Cold Fusion has been shown to be False, the overall conclusions of the research must be False because they require Cold Fusion.<br />
<br />
Logically, this situation is captured by a simple predicate: True AND False = False.<br />
<br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh78U1BRAu4xchr4IDfG0bzG0R76x5STRwVNWWYFqnkwMEirwemYI4h771GAvcrLpzJYAbzz114jwWN9KbQv4CDsaFRCGpgT-rZ3ti0qjD0Gq7nseET4FFjBi-LH9hzfUnTqqx3qO4Q0NE/s1600/ANDUnknown.png" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" height="155" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh78U1BRAu4xchr4IDfG0bzG0R76x5STRwVNWWYFqnkwMEirwemYI4h771GAvcrLpzJYAbzz114jwWN9KbQv4CDsaFRCGpgT-rZ3ti0qjD0Gq7nseET4FFjBi-LH9hzfUnTqqx3qO4Q0NE/s320/ANDUnknown.png" width="320" /></a></div>The same situation occurs in 3VL when using Unknown, rather than False, values. Because the creation of synthetic data for Aqua's AMSU Channel 4 cannot be shown to be True or False, it is Unknown. Any research combined with it, no matter how good it is, produces a final result that is also Unknown.<br />
<br />
This too is captured by a simple 3VL predicate: True AND Unknown = Unknown.<br />
<br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh6Y8M4k3VF12PfnalWYtfu6Vbzm4K0XfTEJDm6cO51khGCmCnHiyWnUna31Cm2jTd-Atu3LK_2MrTZh6bjeeHES2ZlETlr-Ki7JVnaSjnLa3PeDB4FM2Qg5kyeMetdmV9UZXsdbEO8a2M/s1600/Retrieval+Yield.png" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" height="312" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh6Y8M4k3VF12PfnalWYtfu6Vbzm4K0XfTEJDm6cO51khGCmCnHiyWnUna31Cm2jTd-Atu3LK_2MrTZh6bjeeHES2ZlETlr-Ki7JVnaSjnLa3PeDB4FM2Qg5kyeMetdmV9UZXsdbEO8a2M/s320/Retrieval+Yield.png" width="320" /></a></div>A concrete example of the spreading of Unknown results in published research is provided by <a href="http://disc.sci.gsfc.nasa.gov/AIRS/documentation/v5_docs/AIRS_V5_Release_User_Docs/V5-Modification-for-AMSU-Ch-4-NeDT.pdf">NASA's claims of increased yield due to synthetic channel 4 data</a>. We'll assume that these claims are True and that yields are in fact increasing. However, even with this assumption, we cannot demonstrate that yields <i>should be</i> increasing. Because it cannot be verified that the synthetic channel 4 data is valid, we cannot verify that the synthetic data causes bad data to pass QA or good data to fail QA. The quality of the data in these increased yields is Unknown. This is <i>because</i> the quality of the synthetic data is Unknown.<br />
<br />
This cascading of the Unknown value continues through anything that uses the data from these increased yields. In practice, it turns out that all processes referred to by NASA as "Level 2" or higher that use Aqua AMSU data will be infected by the Unknown values. That is, all such data sets have an Unknown truth value themselves due to their dependence upon the increased yield data. <a href="http://en.wikipedia.org/wiki/Advanced_Microwave_Sounding_Unit">These "Level 2" products include</a>:<br />
<br />
● Temperature profile from 3 mbar (45 km) to the surface.<br />
● Water vapor profiles.<br />
● Snow and ice coverage.<br />
● Cloud liquid water.<br />
● Cloud-cleared IR radiances.<br />
● Rain Rate.<br />
● Ozone.<br />
● <a href="http://disc.sci.gsfc.nasa.gov/AIRS/data-holdings/by-data-product/airsL2_Spc">Carbon Dioxide Support Products</a>.<br />
<br />
<b>Other Examples Of The Virus Spreading</b><br />
<b><span class="Apple-style-span" style="font-style: italic; font-weight: normal;">GHCN Data</span></b><br />
<div class="separator" style="clear: both; text-align: center;"><a href="http://scienceblogs.com/deltoid/upload/2009/12/fig_7-ghcn-averages.png" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" height="112" src="http://scienceblogs.com/deltoid/upload/2009/12/fig_7-ghcn-averages.png" width="200" /></a></div>A while back <a href="http://wattsupwiththat.com/2009/12/08/the-smoking-gun-at-darwin-zero/">Willis Eschenbach made the claim that GHCN data at Darwin station was being manipulated</a> to show a warming where none existed in the raw data. Pro-AGW bloggers <a href="http://scienceblogs.com/deltoid/2009/12/willis_eschenbach_caught_lying.php">jumped on this claiming the adjustments were valid</a>.<br />
<br />
The problem is the Australian CSIRO Atmospheric Research Center <a href="http://reg.bom.gov.au/amm/docs/2004/dellamarta.pdf">provided no reason why the adjustments were made</a>, stating only that Darwin is a urban site (which should make adjustments go down, not up).<br />
<br />
This is an illustrative example of the problem with GHCN adjustments. Even though GHCN <a href="ftp://ftp.ncdc.noaa.gov/pub/data/ghcn/v2">provides its raw data</a> and <a href="http://www.ncdc.noaa.gov/oa/climate/research/ushcn/ushcn.html#QUAL">describes its adjustment procedures</a>, it's adjustments cannot be replicated when reasons for the adjustments aren't given.<br />
<br />
For this reason, the validity of GHCN data must be classified as Unknown. This Unknown value spreads to anything using GHCN data. This includes <a href="http://www.ncdc.noaa.gov/oa/climate/ghcn-monthly/index.php">the Intergovernmental Panel on Climate Change 4th Assessment Report</a>.<br />
<br />
<i>Deep Impact</i><br />
<div class="separator" style="clear: both; text-align: center;"></div><div class="separator" style="clear: both; text-align: center;"></div><div class="separator" style="clear: both; text-align: center;"><a href="http://www.nasa.gov/images/content/142197main_tempel1_water_ice.jpg" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" height="166" src="http://www.nasa.gov/images/content/142197main_tempel1_water_ice.jpg" width="200" /></a></div>Deep Impact was a NASA mission to probe a comet by slamming a probe into the comet Tempel I and analyzing the impact. The Deep Impact team at NASA JPL released a photo of the comet with water photoshopped onto its surface (seen at left), a series of medium resolution images of the event, and a chart of the thermal emission spectra of the debris. The chart is shown below.<br />
<br />
<div class="separator" style="clear: both; text-align: center;"><a href="http://www.nasa.gov/images/content/159886main_di_313_635_f2_516.jpg" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="293" src="http://www.nasa.gov/images/content/159886main_di_313_635_f2_516.jpg" width="400" /></a></div><br />
However, the chart is made of data that's been modified by NASA and the raw data used to generate the Tempel I spectra has never been released. This makes it impossible to verify that the scanners actually produced the results shown in the chart. The resulting unverifiable claims are therefore Unknown.<br />
<br />
<b>Curing The Virus</b><br />
As far-reaching as the consequences of the examples provided here are, we've covered only a small handful of examples. Many more could be provided. Their flow through related work could be tracked and we'd discover that a significant portion of modern science rests upon unverifiable claims.<br />
<br />
I think most people wouldn't consider such science to be science at all, but as a problem that stands in the way of science. Fortunately, it's a problem that's easy to fix.<br />
<br />
Simply make the claims verifiable.<br />
<br />
By making the raw data and computer code used to generate the claims publicly available, and by noting why changes are made to raw data, claims that are currently unverifiable can be demonstrated to be True or False. <br />
<br />
And that is the whole reason science exists in the first place.<br />
<br />
<b>References</b><br />
<a href="http://magicjava.blogspot.com/2010/04/three-valued-logic-and-irreproducible.html">Three-Valued Logic And Irreproducible Results In Science, Part I</a><br />
<a href="http://en.wikipedia.org/wiki/Cold_fusion">Cold Fusion claims by Martin Fleischmann and Stanley Pons - Wikipedia Entry</a><br />
<a href="http://magicjava.blogspot.com/2010/04/nasa-responds-to-foia-request.html">NASA Responds To FOIA Request</a><br />
<a href="http://disc.sci.gsfc.nasa.gov/AIRS/documentation/v5_docs/AIRS_V5_Release_User_Docs/V5-Modification-for-AMSU-Ch-4-NeDT.pdf">AIRS/AMSU/HSB Version 5 Modification of Algorithm to Account for Increased NeDT in AMSU Channel 4</a><br />
<a href="http://en.wikipedia.org/wiki/Advanced_Microwave_Sounding_Unit">AMSU - Wikipedia Entry</a><br />
<a href="http://disc.sci.gsfc.nasa.gov/AIRS/data-holdings/by-data-product/airsL2_Spc">AIRS/Aqua Level 2 Carbon Dioxide Support Products</a><br />
<a href="http://wattsupwiththat.com/2009/12/08/the-smoking-gun-at-darwin-zero/">The Smoking Gun At Darwin Zero</a><br />
<a href="http://scienceblogs.com/deltoid/2009/12/willis_eschenbach_caught_lying.php">Willis Eschenbach caught lying about temperature trends</a><br />
<a href="http://reg.bom.gov.au/amm/docs/2004/dellamarta.pdf">Updating Australia’s high-quality annual temperature dataset</a><br />
<a href="ftp://ftp.ncdc.noaa.gov/pub/data/ghcn/v2">GHCN V.2 Raw Data</a><br />
<a href="http://www.ncdc.noaa.gov/oa/climate/research/ushcn/ushcn.html#QUAL">GHCN Quality Control, Homogeneity Testing, and Adjustment Procedures</a><br />
<a href="http://www.ncdc.noaa.gov/oa/climate/ghcn-monthly/index.php">GHCN-Monthly Version 2 Introduction</a><br />
<a href="http://www.nasa.gov/mission_pages/deepimpact/main/">Deep Impact</a><br />
<a href="http://www.lenr-canr.org/">LENR-CANR website</a>Unknownnoreply@blogger.com22tag:blogger.com,1999:blog-1670073287004531921.post-20371388507250058282010-04-25T22:21:00.003-04:002010-04-26T17:52:04.998-04:00Aqua Satellite Project, Update 9 Released.Update:<br />
According to stats at SourceForge, this is the most popular release of the Aqua Satellite Project yet. To the folks downloading the software: feel free to tell me of any bugs you may find or improvements you'd like to see.<br />
============<br />
<br />
<br />
Update 9 for the Aqua Satellite Project is ready. You can download it <a href="https://sourceforge.net/projects/aquasatellite/files/Aqua%20Satellite.zip/download">here</a>. This update is part 1 of a 2 part release that adds global griding of the data. This release adds the <code>AMSUToGrid</code> program for converting extracted csv files to a globally gridded format. The csv files must be extracted with longitude and latitude data. The output format is identical to the format used by the ISCCP project for 2.5 degree equal area grid data in ASCII format. The following weighting options are available as command line switches:<br />
<br />
● DropInTheBucket<br />
● InverseDistance<br />
● LinearInterpolation<br />
● SinXOverX<br />
● CubicConvolutionUnknownnoreply@blogger.com0tag:blogger.com,1999:blog-1670073287004531921.post-2526097609854273342010-04-24T07:11:00.005-04:002010-04-26T07:59:57.449-04:00Three-Valued Logic And Irreproducible Results In Science, Part I<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh01eazYgMxocLmkPAb4Ft1xy5zIbYbs7cn6IUiEjg3JLYoFa1dKL0XDvY2W0uewiZOsHB908ufREH0C55j9blxS-Uzrnf9KGGO2clB0lbZDvANTeQ02ol0O3nQI9bBCpRzfiRHpAsDIDo/s1600/Db_null.png" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" height="200" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh01eazYgMxocLmkPAb4Ft1xy5zIbYbs7cn6IUiEjg3JLYoFa1dKL0XDvY2W0uewiZOsHB908ufREH0C55j9blxS-Uzrnf9KGGO2clB0lbZDvANTeQ02ol0O3nQI9bBCpRzfiRHpAsDIDo/s200/Db_null.png" width="200" /></a></div><b>Introduction</b><br />
This is a short series of two posts that discusses Three-Valued Logic (3VL) and uses it to demonstrate how irreproducible results corrupt not only the scientific work in which they appear, but also spread that corruption to any related work.<br />
<br />
In short, this series of posts demonstrates that irreproducible results are viral. My current work on the Aqua satellite is used as an illustrative example in the second of these posts.<br />
<br />
In this post we look at Two-Valued Logic and Three-Valued Logic and briefly discuss how they work.<br />
<br />
<b>Two-Valued Logic</b><br />
To start off, let's take a quick look at the more common two valued logic system. This system gets its name from the fact that there are only two possible values for any statement: True or False. Two-Valued Logic is also called Boolean logic.<br />
<br />
In regards to this post, we're most concerned with how these logic values of True and False can move through a system of logical predicates. For example, if we have a True statement and a False statement and a logical predicate requiring at least one true statement, than that predicate transforms the one True statement and one False statement into a single statement that is True. This is because the requirement of at least one True statement has been met and the predicate is therefore True.<br />
<br />
Such a predicate is commonly referred to as an OR statement. For an OR statement to be True, either statement 1 or statement 2 must be True. There are several types of predicates in Boolean logic. The most common are OR, AND, and NOT. One way to define predicates is using a true table. A truth table shows all possible inputs to the predicate and what the output of the predicate is. The truth tables for OR, AND, and NOT in Boolean logic are shown below.<br />
<br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiSltREFxbqiAfZmEVvV9AfCugjIwHhByWtqqG-cbk5UtEb_vVEb6lFDgnb26NyT9f9PSwuVNXIoLY2dKbEHhSCpKo7ZVsNq3V3yXSkGEr-p4ADp3D-q3NBIUBPBi8f768t3LD10lxyRBs/s1600/OR.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiSltREFxbqiAfZmEVvV9AfCugjIwHhByWtqqG-cbk5UtEb_vVEb6lFDgnb26NyT9f9PSwuVNXIoLY2dKbEHhSCpKo7ZVsNq3V3yXSkGEr-p4ADp3D-q3NBIUBPBi8f768t3LD10lxyRBs/s320/OR.png" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>OR Truth Table.</b></div><div class="separator" style="clear: both; text-align: center;"><br />
</div><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhOn1VksQv8RqqHGt76uN9uQZFY7QGnycNEQfqWYJDX2BLiNIq1cDX2zz-R8NfaTbrbgU0q_zuZQlEwb7noqRuMPq9Q-qCWTV9gDaqqW9OBW0is5EM4U5jFOHPUT9d0P_Q9NWiAJfDRyfs/s1600/AND.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhOn1VksQv8RqqHGt76uN9uQZFY7QGnycNEQfqWYJDX2BLiNIq1cDX2zz-R8NfaTbrbgU0q_zuZQlEwb7noqRuMPq9Q-qCWTV9gDaqqW9OBW0is5EM4U5jFOHPUT9d0P_Q9NWiAJfDRyfs/s320/AND.png" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>AND Truth Table</b></div><div class="separator" style="clear: both; text-align: center;"><br />
</div><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjQfbfK6oWRVzjOSzPpwNuOgu8J_odVs3k9CDkaELZh1SDss2c7NUHidWD-aGp9Q6Tjc7NVZcJ7U9uepKOIuLgHboB-Lf6sTY-7J3KZ5pAcvFhnqsCGsvo5_GuW8dKviUGgUZW_G6PxSG4/s1600/NOT.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjQfbfK6oWRVzjOSzPpwNuOgu8J_odVs3k9CDkaELZh1SDss2c7NUHidWD-aGp9Q6Tjc7NVZcJ7U9uepKOIuLgHboB-Lf6sTY-7J3KZ5pAcvFhnqsCGsvo5_GuW8dKviUGgUZW_G6PxSG4/s320/NOT.png" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>NOT Truth Table.</b></div><br />
In a nutshell, the OR predicate accepts two inputs and converts them to a single output. That output will be True if either of its inputs are True, or False if both inputs are False.<br />
<br />
The AND predicate also accepts two inputs, but returns TRUE only if both inputs are True. In all other cases it returns False.<br />
<br />
The NOT predicate simply flips True inputs to False outputs and False inputs to True Outputs.<br />
<br />
<div class="separator" style="clear: both; text-align: center;"><a href="http://upload.wikimedia.org/wikipedia/commons/thumb/d/d9/Edsger_Wybe_Dijkstra.jpg/150px-Edsger_Wybe_Dijkstra.jpg" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" src="http://upload.wikimedia.org/wikipedia/commons/thumb/d/d9/Edsger_Wybe_Dijkstra.jpg/150px-Edsger_Wybe_Dijkstra.jpg" /></a></div><span class="Apple-style-span" style="background-color: yellow;">TECHNICAL ASIDE: Truth tables are one way to define logical predicates. They use "case analysis", a method of listing every possible case and the corresponding outcome. However, there are other, more elegant ways to define predicates. In his book <b><a href="http://www.amazon.com/Predicate-Calculus-Semantics-Monographs-Computer/dp/0387969578">Predicate Calculus And Programming Semantics</a></b>, the late Edsger Dijkstra defined the AND predicate using what is known as The Golden Rule, shown below, with the equivalence operator (==) having the lowest binding and meaning "Is The Same As":</span><br />
<br />
<span class="Apple-style-span" style="background-color: yellow;"> The Golden Rule: p AND q == p == q == p OR q</span><br />
<br />
<span class="Apple-style-span" style="background-color: yellow;">This type of definition is considered superior to case analysis. Once the properties of the various predicates are captured in this manner, they can be used as building blocks to far more sophisticated theorems. Case analysis, on the other hand, can never demonstrate anything more than what is provided by the cases themselves.</span><br />
<br />
<b>Three-Valued Logic</b><br />
Three-Valued Logic (3VL) builds upon Boolean Logic. There are several conventions for 3VL. We'll be looking at a particular convention, one in which the third truth value is Unknown. So 3VL, as discussed here, has three truth values: True, False, and Unknown.<br />
<br />
<a href="http://upload.wikimedia.org/wikipedia/en/thumb/5/58/Edgar_F_Codd.jpg/150px-Edgar_F_Codd.jpg" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" src="http://upload.wikimedia.org/wikipedia/en/thumb/5/58/Edgar_F_Codd.jpg/150px-Edgar_F_Codd.jpg" /></a><span class="Apple-style-span" style="background-color: yellow;">TECHNICAL ASIDE: Relational database products make heavy use of 3VL, and refer to the Unknown truth value as NULL. The late E.F. Codd invented relational databases while working for IBM, He introduced the convention of using the word NULL to represent Unknown, and assigned NULL the symbol of the Greek lowercase omega, shown in the image at the beginning of this post.</span><br />
<br />
<br />
Like Boolean Logic, 3VL has predicates that can be defined using truth tables. The truth tables for 3VL AND, OR, and NOT predicates are shown below.<br />
<br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjWBdphjLbdKGkA7ITDYZ8zKJ_PdJdxXTqkDY6T2m1jYkEms7A2fkk6jAQB5jIIl1GwXve8_FTVBdR2OvpZGUstSfimD6eHFMwWk9u0d9xwJAVoVyfqE-JDSxzsYhVJfuzvg9RAUa8T0ik/s1600/600px-3VL_Truth_Table.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="182" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjWBdphjLbdKGkA7ITDYZ8zKJ_PdJdxXTqkDY6T2m1jYkEms7A2fkk6jAQB5jIIl1GwXve8_FTVBdR2OvpZGUstSfimD6eHFMwWk9u0d9xwJAVoVyfqE-JDSxzsYhVJfuzvg9RAUa8T0ik/s400/600px-3VL_Truth_Table.png" width="400" /></a></div>When the only values in use are True and False, 3VL gives the exact same answers as Boolean logic. However, when an Unknown truth value is used as inputs it can also show up as the outputs for a predicate. The result of the predicate "False OR Unknown" is Unknown. The result of the predicate "NOT Unknown" is always Unknown. The result of an AND predicate with an Unknown input is always Unknown or False, never True.<br />
<br />
<b>The Point Of All This</b><br />
It is this last result that interests us here. The result of the predicate "X AND Unknown" can <i>never</i> be True, no matter what the value of X is.<br />
<br />
This is our stopping point for now. The next post in this series will discuss the relationship between Three-Valued Logic and science.<br />
<br />
<b>References</b><br />
<a href="http://en.wikipedia.org/wiki/Boolean_logic">Boolean Logic - Wikipedia Entry</a><br />
<a href="http://en.wikipedia.org/wiki/Ternary_logic">Ternary Logic - Wikipedia Entry</a><br />
<a href="http://en.wikipedia.org/wiki/Null_(SQL)">SQL NULL - Wikipedia Entry</a><br />
<a href="http://www.amazon.com/Predicate-Calculus-Semantics-Monographs-Computer/dp/0387969578">Predicate Calculus And Programming Semantics - Edsger Dijkstra</a><br />
<a href="http://www.seas.upenn.edu/~zives/03f/cis550/codd.pdf">A Relational Model of Data for Large Shared Data Banks - Edgar F. Codd</a>Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-1670073287004531921.post-56689348319694134032010-04-22T23:35:00.000-04:002010-04-22T23:35:33.663-04:00SEC Watched Porn As Economy Crashed<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhgs6Mq3L1bZDSxmRnB0sS5GUnc0dsn92K-epprfl49oRU2-xI7H9TxnDgXDpWNOwaIRoslF4M-ZBXLcxckIB5EnZCB7a3lkGIoriijSTLSlkPplkZbNaQHjxgOAb4LZGZwgMNqykqcADU/s1600/kitty_20porn.jpg" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" height="239" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhgs6Mq3L1bZDSxmRnB0sS5GUnc0dsn92K-epprfl49oRU2-xI7H9TxnDgXDpWNOwaIRoslF4M-ZBXLcxckIB5EnZCB7a3lkGIoriijSTLSlkPplkZbNaQHjxgOAb4LZGZwgMNqykqcADU/s320/kitty_20porn.jpg" width="320" /></a></div>I try to stay clear of politics on this blog, but every once in a while something happens that I just can't let slip by. This is one of those times.<br />
<br />
<a href="http://news.yahoo.com/s/ap/20100423/ap_on_bi_ge/us_sec_porn;_ylt=AggVOV98M4pd4XaTc9zmOKCs0NUE;_ylu=X3oDMTNiZW5zOGExBGFzc2V0A2FwLzIwMTAwNDIzL3VzX3NlY19wb3JuBGNjb2RlA21vc3Rwb3B1bGFyBGNwb3MDMwRwb3MDOQRwdANob21lX2Nva2UEc2VjA3luX3RvcF9zdG9yeQRzbGsDc2Vjc3RhZmZlcnN3">The AP is reporting</a> that the SEC's inspector general is conducting probes into 31 of its employee's charged with downloading and viewing porn on government time, using government equipment, while the economy crashed.<br />
<br />
Here are a few highlights from the report:<br />
<blockquote><span class="Apple-style-span" style="font-family: arial, helvetica, clean, sans-serif; font-size: 13px; line-height: 18px;">● A senior attorney at the SEC's Washington headquarters spent up to eight hours a day looking at and downloading pornography. When he ran out of hard drive space, he burned the files to CDs or DVDs, which he kept in boxes around his office. He agreed to resign, an earlier watchdog report said.</span></blockquote><blockquote><span class="Apple-style-span" style="font-family: arial, helvetica, clean, sans-serif; font-size: 13px; line-height: 18px;">● An accountant was blocked more than 16,000 times in a month from visiting websites classified as "Sex" or "Pornography." Yet he still managed to amass a collection of "very graphic" material on his hard drive by using Google images to bypass the SEC's internal filter, according to an earlier report from the inspector general.</span></blockquote><blockquote><span class="Apple-style-span" style="font-family: arial, helvetica, clean, sans-serif; font-size: 13px; line-height: 18px;">● Seventeen of the employees were "at a senior level," earning salaries of up to $222,418.</span></blockquote>For more details, see the original story <a href="http://news.yahoo.com/s/ap/20100423/ap_on_bi_ge/us_sec_porn;_ylt=AggVOV98M4pd4XaTc9zmOKCs0NUE;_ylu=X3oDMTNiZW5zOGExBGFzc2V0A2FwLzIwMTAwNDIzL3VzX3NlY19wb3JuBGNjb2RlA21vc3Rwb3B1bGFyBGNwb3MDMwRwb3MDOQRwdANob21lX2Nva2UEc2VjA3luX3RvcF9zdG9yeQRzbGsDc2Vjc3RhZmZlcnN3">here</a>.<br />
<blockquote> </blockquote>Unknownnoreply@blogger.com2tag:blogger.com,1999:blog-1670073287004531921.post-50034143064866354862010-04-18T21:40:00.004-04:002010-04-18T22:07:49.214-04:00Aqua Satellite Project, Update 8 Released. Now With More She-Hulk!<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhBEn2i_ROZfiQMUGV4NfnIYn38waWHYLHIM0yaQWvmkUAP-20eh32slgAKwsA8yy01w3BIU1iZS4C01u3lhqsIEy-0K_tDVYvSk4q_sn6Iai1vJFXdMVvUJCn7WjHgB7-zZXQE16DuKR8/s1600/Pic2.png" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" height="200" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhBEn2i_ROZfiQMUGV4NfnIYn38waWHYLHIM0yaQWvmkUAP-20eh32slgAKwsA8yy01w3BIU1iZS4C01u3lhqsIEy-0K_tDVYvSk4q_sn6Iai1vJFXdMVvUJCn7WjHgB7-zZXQE16DuKR8/s200/Pic2.png" width="131" /></a></div>Update 8 for the Aqua Satellite Project is ready. You can download it <a href="https://sourceforge.net/projects/aquasatellite/files/Aqua%20Satellite.zip/download" style="color: #445566;">here</a>. This update is part 2 of a 2 part release that adds some spit and polish to the graphics, charting, and platform-independant font engines. Highlights for this release include:<br />
<br />
● Added event handling to all shapes classes. These classes can now respond to mouse, keyboard, touch, and command events.<br />
● Added anti-aliasing capabilities to shapes and FontManager. Anti-aliasing is turned on by default. It can be turned off by setting a flag in the various graphics and text calls.<br />
● Added font scaling capabilities to the FontManager. The built-in fonts can now be used at any desired font size.<br />
● Added histogram, bi-linear interpolation, equalize, threshold, grayscale, edge detection, translation, rotation, scaling, and erosion filters for use with bitmaps. These filters are located in the new Filters.h and Filters.cpp files in the Graphics folder.<br />
● Made significant enhancements to the DrawingContext2D and Color classes.<br />
● Fixed several bugs in the Chart class.<br />
<br />
The code has been placed in the public domain.<br />
<br />
<b>Samples</b><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjaLWsqhq_lOkKZv5vlVJE31NBv2s-8WpYP7-fg8wqF5u0cpjmXoGWWy1fakF0r0xpfbWcaViEpT88CTwXNfvZU1MzjnkV5CQdWTpi7t7cPjo5GNKFWQq_IcPrmPn8yspQFWpfq0nTtIxc/s1600/TestPicDetectEdges.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="400" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjaLWsqhq_lOkKZv5vlVJE31NBv2s-8WpYP7-fg8wqF5u0cpjmXoGWWy1fakF0r0xpfbWcaViEpT88CTwXNfvZU1MzjnkV5CQdWTpi7t7cPjo5GNKFWQq_IcPrmPn8yspQFWpfq0nTtIxc/s400/TestPicDetectEdges.png" width="262" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Edge Detection</b></div><b><br />
</b><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhFzc1BqyVni7FlOFstqwvSJ8u_66hGOT2_o2Rxnuc7mejfT5T1FqOWXbiP-AzwgLu234kyz2Bahjmlw2TGvo3ODEhzASSBQbFiK2wW_vhnFvuWyXy__F0XlaL2PHfC_LM6sV8z_H9BqD0/s1600/TestPicEqualize.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="400" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhFzc1BqyVni7FlOFstqwvSJ8u_66hGOT2_o2Rxnuc7mejfT5T1FqOWXbiP-AzwgLu234kyz2Bahjmlw2TGvo3ODEhzASSBQbFiK2wW_vhnFvuWyXy__F0XlaL2PHfC_LM6sV8z_H9BqD0/s400/TestPicEqualize.png" width="262" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Equalize</b></div><b><br />
</b><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjCEV8KfqU7JuVK_QITKoQ5AOn-JX64j42BqNRcztSDZq0KHpl3EbaXhzTTqGd78iexHl7simRA-_Zc4p2lNrx9WYOPAskLvmxyPvCZWzjkzMeGSy1vBFIscBSoJ8dpz9yYK6ju6nYsh2o/s1600/TestPicGrayscale.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="400" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjCEV8KfqU7JuVK_QITKoQ5AOn-JX64j42BqNRcztSDZq0KHpl3EbaXhzTTqGd78iexHl7simRA-_Zc4p2lNrx9WYOPAskLvmxyPvCZWzjkzMeGSy1vBFIscBSoJ8dpz9yYK6ju6nYsh2o/s400/TestPicGrayscale.png" width="262" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Grayscale</b></div><b><br />
</b><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgEAxqdFhOrDMmzY5rMvotnCRxib_5-WcoBZxUKrV1eOsGsn63lcq_TRgeQHXU0eGU2k3x024fhsygzis8wRsINNJj0U-sUp5UFcODAW-k2MMQWuzD4JZU5OK4PAQmvX8C4lDMULTZj32s/s1600/TestPicThreshold.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="400" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgEAxqdFhOrDMmzY5rMvotnCRxib_5-WcoBZxUKrV1eOsGsn63lcq_TRgeQHXU0eGU2k3x024fhsygzis8wRsINNJj0U-sUp5UFcODAW-k2MMQWuzD4JZU5OK4PAQmvX8C4lDMULTZj32s/s400/TestPicThreshold.png" width="262" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Threshold</b></div><b><br />
</b><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg-nSXlFNSD0r2GgyXmYo7eGnMRAeb4RKJGwHdB2yD2tiiQshnzQddJHeXNwFfsfVUV5ESHiDTXQ8kC_SfVqme7N6kENCsAFNs76n4FVf2lviDxFNubFPX-niAZo1wsYhDYpDmLvR53tqk/s1600/TestPicRotate.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="400" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg-nSXlFNSD0r2GgyXmYo7eGnMRAeb4RKJGwHdB2yD2tiiQshnzQddJHeXNwFfsfVUV5ESHiDTXQ8kC_SfVqme7N6kENCsAFNs76n4FVf2lviDxFNubFPX-niAZo1wsYhDYpDmLvR53tqk/s400/TestPicRotate.png" width="262" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Rotate</b></div><b><br />
</b><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEijtixLPc3UChtRJrzjcelcpFg_yrgMZS97yKwQ82lf3aq-85gjKOSVSokVuH0DTHYIwTg167sPND0r17L7IJZk_ZnbhocmR86b30rqE_PKQIfxbXUMUknov6Aim0aeJC5Baqo-ANv2p28/s1600/TestPicTranslate.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="400" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEijtixLPc3UChtRJrzjcelcpFg_yrgMZS97yKwQ82lf3aq-85gjKOSVSokVuH0DTHYIwTg167sPND0r17L7IJZk_ZnbhocmR86b30rqE_PKQIfxbXUMUknov6Aim0aeJC5Baqo-ANv2p28/s400/TestPicTranslate.png" width="262" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Translate</b></div><b><br />
</b><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh9a8sA79QgrNskKxar-GfrD0MsVTUylzHEw3br7r-kwsSznTDTFcv09_XXlxeFxDMCC1-P8NVhokKe-Ir2_8DxzK5FU2ECJDcXU-v-I9FxyEp8EUUCNwnx4kLRSnpklwICpB5yFppyBcs/s1600/TestPicScale.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="152" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh9a8sA79QgrNskKxar-GfrD0MsVTUylzHEw3br7r-kwsSznTDTFcv09_XXlxeFxDMCC1-P8NVhokKe-Ir2_8DxzK5FU2ECJDcXU-v-I9FxyEp8EUUCNwnx4kLRSnpklwICpB5yFppyBcs/s400/TestPicScale.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Scale</b></div><b><br />
</b><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjK3Kxk4Mt4QQSogBPfH_5UEUQ1US02eFg2c156feYujD-g0MN5GkcuZjc3Up1t5ldrMXH_8aGua0KqkSL4aHntt3TVl_yMwJHfoGpyngCxr3NmpMBwow_Q-TCyjUQsr85lFJjCsdXJBkQ/s1600/TestPicText.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="400" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjK3Kxk4Mt4QQSogBPfH_5UEUQ1US02eFg2c156feYujD-g0MN5GkcuZjc3Up1t5ldrMXH_8aGua0KqkSL4aHntt3TVl_yMwJHfoGpyngCxr3NmpMBwow_Q-TCyjUQsr85lFJjCsdXJBkQ/s400/TestPicText.png" width="262" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Scaled, Anti-Aliased, Platform-Independant Text</b></div><b><br />
</b><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjk4t7MdkyOXBJXv7ubc9fdpVROuzkmevkxrw_kYV4Drz-TuDTiqV-r27vSYvAOf_w5fA8Hx6HbOqhwtzTdrDmFtIs9_yc4XuP6ugehQpZ4FDoa2NbrYjVcrKuduV8E9akpPVw93Gy0Jp8/s1600/TestPicErosion.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="400" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjk4t7MdkyOXBJXv7ubc9fdpVROuzkmevkxrw_kYV4Drz-TuDTiqV-r27vSYvAOf_w5fA8Hx6HbOqhwtzTdrDmFtIs9_yc4XuP6ugehQpZ4FDoa2NbrYjVcrKuduV8E9akpPVw93Gy0Jp8/s400/TestPicErosion.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Erosion</b></div><b><br />
</b><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhaXvrO-mJT41V4slAY72k9pabOCp2xljnFBPlsrYWP91AXkE2sxmC9ff7lrD5hb1sajFFdKE4Bx1jIW-LUE8VNPYi8mCyQp0i-X2wXmMHv_zYejLCuk_ZKVXnm7-LhkuwKqCcevREETbI/s1600/TestPicBilinearInterpolate.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="400" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhaXvrO-mJT41V4slAY72k9pabOCp2xljnFBPlsrYWP91AXkE2sxmC9ff7lrD5hb1sajFFdKE4Bx1jIW-LUE8VNPYi8mCyQp0i-X2wXmMHv_zYejLCuk_ZKVXnm7-LhkuwKqCcevREETbI/s400/TestPicBilinearInterpolate.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Bi-Linear Interpolation</b></div><b><br />
</b><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhqN-ws9UapXr1lLLGIwSMrcJpgM1CYgyfnhhDwcQS2UPLy6YZ3C9KyXa3K18Hb1A76NhJ_XcSEW6SIhwzTr7Q-ylEXeixjOVrip5ZIIOnjMnBGvunmKALzRF4vXs5mJc-BDz-6VqFZR_4/s1600/Pic3.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="400" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhqN-ws9UapXr1lLLGIwSMrcJpgM1CYgyfnhhDwcQS2UPLy6YZ3C9KyXa3K18Hb1A76NhJ_XcSEW6SIhwzTr7Q-ylEXeixjOVrip5ZIIOnjMnBGvunmKALzRF4vXs5mJc-BDz-6VqFZR_4/s400/Pic3.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Original Text Image (For Comparison)</b></div><b><br />
</b><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiV4UxHj02X6vj_0qzKV51vE3_GJDg8Q4Vhm82OYU1zrleV0NSI-MSaiqWcZnlhsxuTxJUPF5ZciUkz9Lj1BoB7C7w3Dxke_6WxjvHZkPD_1_dyG1ZqK6axorVD0WxQhI8Xhuo7ChP03co/s1600/TestCubicCurve.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="400" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiV4UxHj02X6vj_0qzKV51vE3_GJDg8Q4Vhm82OYU1zrleV0NSI-MSaiqWcZnlhsxuTxJUPF5ZciUkz9Lj1BoB7C7w3Dxke_6WxjvHZkPD_1_dyG1ZqK6axorVD0WxQhI8Xhuo7ChP03co/s400/TestCubicCurve.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Anti-Aliasing</b></div><b><br />
</b><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjel9OTwBQssvByLVEHMOopw_aJcj4Plq1-p-asrWhE0UHk8OzvIjMXUMWogTanFVmq6gCgrw1p_7Zo_44mXMNohLrpqrXjZLrR1i8t42-v_QvL_D2iG500uGtSpw95CSUBBOf593OKeEo/s1600/TestChartTypesArea.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="400" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjel9OTwBQssvByLVEHMOopw_aJcj4Plq1-p-asrWhE0UHk8OzvIjMXUMWogTanFVmq6gCgrw1p_7Zo_44mXMNohLrpqrXjZLrR1i8t42-v_QvL_D2iG500uGtSpw95CSUBBOf593OKeEo/s400/TestChartTypesArea.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Area Chart</b></div><b><br />
</b><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgafAZ5yMivmgZ0KL_HcLClYBsxot4bgjWB877TJ7j4u-n5-xI6L1-xhu4WAbjqPKPxIqs0tmT5LXQHBvfZRHa9UyTKWl4U4prKqmMANrolhBedGGXGM26xUPk1z2WJtX-pNZVoEDaOZvo/s1600/TestChartTypesBar.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="400" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgafAZ5yMivmgZ0KL_HcLClYBsxot4bgjWB877TJ7j4u-n5-xI6L1-xhu4WAbjqPKPxIqs0tmT5LXQHBvfZRHa9UyTKWl4U4prKqmMANrolhBedGGXGM26xUPk1z2WJtX-pNZVoEDaOZvo/s400/TestChartTypesBar.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Bar Chart</b></div><b><br />
</b><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj-B5iMYl_9iTCo4aVdrVcROKgfsAjWD-rVAibeFDhyphenhyphenGYe6wcWEVAeiFUdQ340leZsQlU_kd-ScHSlAZUy4OTfXHwzlnNM3gL4cfskKmL5wOswOpGLtKOfsOGSyxK7YIdYmILBTFEP9jc0/s1600/TestChartTypesLine.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="400" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj-B5iMYl_9iTCo4aVdrVcROKgfsAjWD-rVAibeFDhyphenhyphenGYe6wcWEVAeiFUdQ340leZsQlU_kd-ScHSlAZUy4OTfXHwzlnNM3gL4cfskKmL5wOswOpGLtKOfsOGSyxK7YIdYmILBTFEP9jc0/s400/TestChartTypesLine.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Line Chart</b></div><b><br />
</b><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhKk0IA_mfGJTWWb5vKNeMp5ALATmE66Zpl5ztL4xfrFURdp7ERYEcVpC8KjDzjbWqU0cN6TrVgd8zjdVGRGljZFZ3gY2Pw-eOiPEkKd3HLIGTcZe5hyphenhyphenLeCQPcnjEfs5tkyA35RSqsNGiA/s1600/TestChartTypesPie.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="400" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhKk0IA_mfGJTWWb5vKNeMp5ALATmE66Zpl5ztL4xfrFURdp7ERYEcVpC8KjDzjbWqU0cN6TrVgd8zjdVGRGljZFZ3gY2Pw-eOiPEkKd3HLIGTcZe5hyphenhyphenLeCQPcnjEfs5tkyA35RSqsNGiA/s400/TestChartTypesPie.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Pie Chart</b></div><b><br />
</b><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjLRL_8i0VboVQzGk7d5QI2fXsKCK9RWWmUADaamp5rXJfv9vdAbzxx1RxvrgLkMEDtMng5aHnvpyusCycT0MWkYO0JVUlGBWs89XpG3maz8HMkh5TAH2WkHpkStlThSvEjJ_n5SUh1QF4/s1600/TestChartTypesPoint.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="400" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjLRL_8i0VboVQzGk7d5QI2fXsKCK9RWWmUADaamp5rXJfv9vdAbzxx1RxvrgLkMEDtMng5aHnvpyusCycT0MWkYO0JVUlGBWs89XpG3maz8HMkh5TAH2WkHpkStlThSvEjJ_n5SUh1QF4/s400/TestChartTypesPoint.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Point Chart</b></div><b><br />
</b><br />
<b><br />
</b>Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-1670073287004531921.post-14268921025753836432010-04-16T08:06:00.002-04:002010-04-16T08:15:06.081-04:00NASA Responds To FOIA Request<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj9fGoLazZxWnOP5V-kHA12D8XuF2L5BRuq27ifZG9jhWoabQgMkicbmwsn1znoJKLHbtr4dNebZ9uzEdxxKMD833XfpTG-W3nG0WQxEKE3mUbOsgRHjJcN328LRsdXwC35Zz9Z2a-DjHg/s1600/foia.gif" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" height="175" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEj9fGoLazZxWnOP5V-kHA12D8XuF2L5BRuq27ifZG9jhWoabQgMkicbmwsn1znoJKLHbtr4dNebZ9uzEdxxKMD833XfpTG-W3nG0WQxEKE3mUbOsgRHjJcN328LRsdXwC35Zz9Z2a-DjHg/s200/foia.gif" width="200" /></a></div>NASA has responded to my FOIA request.<br />
<br />
In a nutshell, they provided me with a link to the AMSU-A Radiative Transfer Algorithm documentation and said they had no information on the scan depths for the footprints of channel 5 on the AMSU and didn't have the vector data they use to synthesis AMSU channel 4. <br />
<br />
Both of the claims of "no information" seem impossible to me, as they're needed to process AMSU data the way NASA JPL does.<br />
<br />
While I mull over my next move, here's their response.<br />
<br />
<blockquote>Your Freedom of Information Act (FOIA) request for release of information from the files of the National Aeronautics and Space Administration (NASA) received in FOIA processing at the NASA Management Office-Jet Propulsion Laboratory on April 8, 2010. You requested the following: <br />
<br />
"...(1) Documentation on how the AQUA AMSU-A Radiative Transfer Algorithm works. (2) Atmospheric scan depth for each footprint on channel 5 of the AQUA AMSU. (3) In references to the creation of synthetic readings for the AQUA AMSU channel 4, the 230000 cases used to create the values for the vectors Ai and Theta Bar i, or the values of vectors Ai and Theta Bar i themselves if the 230000 readings are no longer available. These values and readings are referenced but not actually provided in the document AIRS/AMSU/HSB Version 5 Modification of Algorithm to Account for Increased NeDT in AMSU Channel 4 available online at http://disc.sci.gsfc.nasa.gov/AIRS/documentation/v5_docs/AIRS_V5_Release_User_Docs/V5-Modification-for-AMSU-Ch-4-NeDT.pdf..."<br />
<br />
This is to advise you that responsive records to part (1) of your request may be found at the following web site:<br />
<br />
http://eospso.gsfc.nasa.gov/eos_homepage/for_scientists/atbd/docs/AIRS/atbd-airs-L2.pdf<br />
<br />
This is to advise that NASA has no responsive Government records at JPL for parts (2) and (3) of your request. Additionally, pertaining to part (3) of your request, we have no responsive records because the specific research and development was performed by the NASA Goddard Space Flight Center (GSFC). Therefore, it is possible that GSFC may have responsive records. <br />
<br />
You have appeal rights concerning these actions. </blockquote><br />
And I do want to thank them for not charging me for this request. :)<br />
<br />
<b>Previous Posts In This Series</b><br />
<a href="http://magicjava.blogspot.com/2010/04/quick-foia-update.html">Quick FOIA Update</a><br />
<a href="http://magicjava.blogspot.com/2010/04/government-way.html">The Government Way</a><br />
<a href="http://magicjava.blogspot.com/2010/04/foia-request-filed-with-nasa.html">FOIA Request Filed With NASA</a>Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-1670073287004531921.post-35485417362582344792010-04-11T17:14:00.001-04:002010-04-11T17:38:10.300-04:00Aqua Satellite Project, Update 7 ReleasedUpdate 7 for the Aqua Satellite Project is ready. You can download it <a href="https://sourceforge.net/projects/aquasatellite/files/Aqua%20Satellite.zip/download">here</a>. This update is part 1 of a 2 part release that adds some spit and polish to the graphics, charting, and platform-independant font engines.<br />
<br />
This release adds all the functionality that wasn't yet written for the Chart class and removes the need for external files from the font engine (although you can still use such files to add your own fonts, they are no longer required for the fonts shipped with the font engine). It adds a FontManger that manages the built-in fonts, using less memory, less disk space, and runs faster than the old method. As before, the built-in fonts are Arial, Courier, Helvetica, Times New Roman, TrebuchetMS, and Verdana in sizes of 10, 12, 18, 24, 36, 48, and 72. A bug in the Courier font bitmaps was also fixed.<br />
<br />
The <code>LiveGraph</code> application no longer has a -font parameter as it can now use the FontManager to produce the fonts it needs. <br />
<br />
All code has been placed in the public domain.Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-1670073287004531921.post-88938227337728179532010-04-08T16:59:00.001-04:002010-04-08T17:09:11.448-04:00Draw2D V1.1 JavaScript Graphics Engine Update ReleasedVersion 1.1 of the Draw2D JavaScript Graphics Engine has been released. This is a minor update that adds speed improvements to all the curve drawing classes (Quadradic Curves, Cubic Curves, Round Rectangles, Ovals And Arcs) and fixes a bug in the rendering of Cubic Curves.<br />
<br />
You can get the source code, several example HTML pages, and a Programmer's Manual <a href="https://sourceforge.net/projects/javascriptdraw2/files/Javascript2D.zip/download">here</a>.<br />
<br />
The code has been placed in the public domain.<br />
<br />
<b>Previous Posts In This Series</b><br />
<a href="http://magicjava.blogspot.com/search/label/Draw2D">Draw2D JavaScript Graphics Engine Released</a>Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-1670073287004531921.post-60581365330424021192010-04-08T15:46:00.001-04:002010-04-08T15:46:54.294-04:00Quick FOIA UpdateJust dropping a note to update the status of my FOIA. In the previous post I noted that NASA JPL wanted me to state up front how much I was willing to pay for the information.<br />
<br />
Having no idea what these fees are for, I figured the next step is to ask why they charge these fees. That way I can give some sort of reasonable answer on what I'd pay. Here's my resonse:<br />
<br />
<blockquote>Dear Mr. Mahon,<br />
<br />
As I mentioned in my previous e-mail, this is my first FOIA request, So, if I may, I'd like to ask the purpose of the fees. Are they to cover mailing costs? Will I be actually paying the salary of the person looking up the information? Are they arbitrary fees designed to prevent "fishing expeditions? The reason I ask is so that I can provide you with an answer that is sensible for the purpose of the fees. If possible, providing an "average fee" for obtaining one document would be useful.</blockquote><br />
<b>Previous Posts In This Series</b><br />
<a href="http://magicjava.blogspot.com/2010/04/government-way.html">The Government Way</a><br />
<a href="http://magicjava.blogspot.com/2010/04/foia-request-filed-with-nasa.html">FOIA Request Filed With NASA</a>Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-1670073287004531921.post-63303402065669909812010-04-07T23:15:00.000-04:002010-04-07T23:15:29.962-04:00The Government WayI got a response back from NASA JPL regarding my FOIA request. They want to know up front just how much I'm willing to pay for the information. Gotta love how our government operates. :) <br />
<br />
Here's the text (emphasis mine):<br />
<br />
<blockquote>Greetings:<br />
<br />
Please respond with your complete postal mailing address, phone and fax numbers. Also, you must state your willingness to pay fees that may be assessed in processing your request. Please reply stating your willingness to pay fees <b>and the amount you are willing to pay</b> so we may proceed with your request. Thank you.</blockquote><br />
So now I'll have to mull over just how much I'm willing to pay for information my taxes already paid for.Unknownnoreply@blogger.com1tag:blogger.com,1999:blog-1670073287004531921.post-51658987398438599232010-04-06T23:49:00.000-04:002010-04-06T23:49:16.325-04:00FOIA Request Filed With NASAAbout three weeks ago, as I noted in <a href="http://magicjava.blogspot.com/2010/03/request-sent-to-nasa-for-unpublished.html">this post</a>, I sent off a request to NASA JPL for information needed to reproduce their synthetic creation of AMSU channel 4 data and for the atmospheric scan depths of each footprint for channel 5 on the AMSU.<br />
<br />
I've not received a response back, and 3 weeks is one week longer than my usual waiting period of two weeks. So today I filed a FOIA with NASA JPL for the information. A copy of the request is shown below.<br />
<br />
<blockquote>Dear Mr. Mahon,<br />
<br />
This is my first FOIA request, so allow me to apologize in advance for any procedural mistakes I may make.<br />
<br />
About three weeks ago (on or about March, 13th, 2010) I requested several pieces of information from NASA JPL via the "Ask AIRS" web interface and have received no response. So I am now requesting that information via the FOIA. The requested information is:<br />
<br />
● Documentation on how the AQUA AMSU-A Radiative Transfer Algorithm works.<br />
<br />
● Atmospheric scan depth for each footprint on channel 5 of the AQUA AMSU.<br />
<br />
● In references to the creation of synthetic readings for the AQUA AMSU channel 4, the 230000 cases used to create the values for the vectors Ai and Theta Bar i, or the values of vectors Ai and Theta Bar i themselves if the 230000 readings are no longer available. These values and readings are referenced but not actually provided in the document AIRS/AMSU/HSB Version 5 Modification of Algorithm to Account for Increased NeDT in AMSU Channel 4 available online at<br />
http://disc.sci.gsfc.nasa.gov/AIRS/documentation/v5_docs/AIRS_V5_Release_User_Docs/V5-Modification-for-AMSU-Ch-4-NeDT.pdf<br />
<br />
Thank you for your time.<br />
</blockquote><br />
P.S.<br />
<br />
Just in case you're wondering where my normal two-week waiting period came from, two weeks is the amount of time it took Stephen Hawking to respond to a question I had regarding black holes and quantum physics. Given Dr. Hawking's well-known medical issues, this should be a reasonable time frame for any reply from anyone else.Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-1670073287004531921.post-35714807024193712502010-04-04T21:26:00.007-04:002010-04-09T14:44:40.883-04:00Aqua Satellite Project, Update 6 Released<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhw2DWRU4k0OTW63F-QAsruBKieiiC2-V-Jl5R1YI1Vc20s1OutoF-JF_t8VAlf8oE7CArbJ6i1p971ZpvkrJ4UZdM9EmMLBc-ggfI-VpGoo_mGlG8YvKJYE5rjNLCzchu4JX4mKyTJ68A/s1600/movie1631___200707.csv1631.png"><img style="float:left; margin:0 10px 10px 0;cursor:pointer; cursor:hand;width: 400px; height: 211px;" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhw2DWRU4k0OTW63F-QAsruBKieiiC2-V-Jl5R1YI1Vc20s1OutoF-JF_t8VAlf8oE7CArbJ6i1p971ZpvkrJ4UZdM9EmMLBc-ggfI-VpGoo_mGlG8YvKJYE5rjNLCzchu4JX4mKyTJ68A/s400/movie1631___200707.csv1631.png" border="0" alt="" id="BLOGGER_PHOTO_ID_5456457608744907810" /></a><br />
Update 6 for the Aqua Satellite Project is ready. You can download it <a href="https://sourceforge.net/projects/aquasatellite/files/Aqua%20Satellite.zip/download" style="color: #223344;">here</a>. The big item is the new <code>LiveGraph</code> program which creates a movie of a graph. This movie can be overlaid on top of <code>GridToMap</code> movies.<br />
<br />
A sample <code>LiveGraph</code> movie is shown below. It graphs cloud and surface temperature data over a map of clouds.<br />
<br />
<iframe allowfullscreen='allowfullscreen' webkitallowfullscreen='webkitallowfullscreen' mozallowfullscreen='mozallowfullscreen' width='320' height='266' src='https://www.blogger.com/video.g?token=AD6v5dxodNNEjOwYy21bdYmAiFzAQZUBpZKwGhdGfd9DvXs5-YYehsWkms1FXzi-8b02URrPykskbolsffPJGawfWA' class='b-hbp-video b-uploaded' frameborder='0'></iframe><div><b>Movie made from LiveGraph and GridToMap.</b></div><br />
<br />
In support to <code>LiveGraph</code>, a graphics engine, a charting engine, and a platform-independant font engine have been added to the code. There was also some reworking of the <code>MathUtils.h</code> file to make it a lot smaller. Most of the code was moved to a new Math folder.<br />
<br />
All code has been placed in the public domain.Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-1670073287004531921.post-16707635196126619712010-03-29T13:33:00.005-04:002010-03-29T13:46:39.672-04:00What Ozone Hole?<iframe allowfullscreen='allowfullscreen' webkitallowfullscreen='webkitallowfullscreen' mozallowfullscreen='mozallowfullscreen' width='320' height='266' src='https://www.blogger.com/video.g?token=AD6v5dwYRt_kK1FM8FrK8tc9m0uiY9n_HH63P9Qerq6NBzx5MLf1t1tJnUZ44-oUpMR-Yo-ghsIv0j2g2PTWxl8HUw' class='b-hbp-video b-uploaded' frameborder='0'></iframe><br />
As a result of now being able to make movies from gridded data, I've been going through the ISCCP data that comes with the Climate Scientist Starter Kit. A movie of the ozone data is provided above.<br />
<br />
What surprised me was the amount of ozone over Antarctica was equal to or greater than the amount of ozone over nearly the entire rest of the world. Only the Arctic consistently had more ozone (and it has quite a bit of ozone). This was true from the beginning of the movie (July, 1983) to the end (June, 2008).<br />
<br />
Which makes me wonder why we've never heard of of an ozone hole over Africa, or South America, or India, all of which always have less ozone than Antarctica.<br />
<br />
Now, I'm hardly an ozone expert. So if anyone out there would like to enlighten me on why this all makes sense, please feel free to do so. Because right now I'm wondering if the Ozone Hole is as big a hoax as Global Warming. Tips on why the Arctic has so much ozone are also welcome.<br />
<br />
P.S.<br />
If you watch the video all the way through, you get to see what happens when a satellite sensor goes batty.Unknownnoreply@blogger.com1tag:blogger.com,1999:blog-1670073287004531921.post-14641309866944711122010-03-28T18:41:00.007-04:002010-03-28T19:17:19.914-04:00Aqua Satellite Project, Update 5 Released<iframe allowfullscreen='allowfullscreen' webkitallowfullscreen='webkitallowfullscreen' mozallowfullscreen='mozallowfullscreen' width='320' height='266' src='https://www.blogger.com/video.g?token=AD6v5dzLyUpRBrKYm3nsEDopSmv1kr00AhlwyH2oiSAwge4x5Yo4OoCevCjxAH0fmnEI0XJtZ3V0PCRLKfOZ12vP' class='b-hbp-video b-uploaded' frameborder='0'></iframe><br />
<div style="text-align: left;"><b>Movie made from GridToMap images.</b></div><br />
Update 5 for the Aqua Satellite Project is ready. You can download it <a href="https://sourceforge.net/projects/aquasatellite/files/Aqua%20Satellite.zip/download">here</a>. The big item is the new <code>GridToMap</code> program which lets you create bitmap images from gridded data.<br />
<br />
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjee8KgBXNshYcTLiyfX0gB95osdnBW1eR9av_R97k-xnk_rTLuh4FuorVJSMSO7A1VhsFFG8oGfGDbGM9RMM9TSLYtV_D3Ay4D5j6SEB2eXOpmidZCdvikYYwVxkagGeRV7UL0lXoaVz0/s1600/MapToGrid.png" onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}"><img alt="" border="0" id="BLOGGER_PHOTO_ID_5453819778147611666" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjee8KgBXNshYcTLiyfX0gB95osdnBW1eR9av_R97k-xnk_rTLuh4FuorVJSMSO7A1VhsFFG8oGfGDbGM9RMM9TSLYtV_D3Ay4D5j6SEB2eXOpmidZCdvikYYwVxkagGeRV7UL0lXoaVz0/s400/MapToGrid.png" style="cursor: hand; cursor: pointer; display: block; height: 220px; margin: 0px auto 10px; text-align: center; width: 400px;" /></a><br />
<code>GridToMap</code> takes various pieces of input data and creates an output bitmap. The inputs are:<br />
<br />
• Climate data for the entire world in 2.5 by 2.5 degree gridded format. This is a .cvs file with 1 optional header row and 3 required header columns.<br />
• A text pallet file describing which colors get assigned to which ranges of data.<br />
• A legend bit map that can display whatever information you want, but is intended to show the image's legend. The legend bitmap must be 20 pixels high and the same width as the main map image.<br />
• An optional superimpose bitmap that will be laid over the map. The superimpose image must be the same width and height as the map (not counting the 20 pixels for the legend).<br />
• The map can begin at the Prime Meridian or the International Date Line.<br />
• Optionally, average, minimum, and maximum values for the map can be displayed as thumbnails in the left 60 pixels of the legend.<br />
<br />
There are three related scripts: <code>grid_to_map</code>, <code>grid_to_movie</code>, and <code>grid_to_movie_with_filename</code>. All three of these scripts scan immediate subdirectories looking for .csv files and run <code>GridToMap</code> against any they find. They differ only in how they name the output files. <code>grid_to_map</code> simply appends ".bmp" to the new filename. <code>grid_to_movie</code> uses "movie" with a sequence number and ".bmp". <code>grid_to_movie_with_filename</code> prepends "movie", a sequence number, three under-bars, the filename, the sequence number (again) and ".bmp".<br />
<br />
Sample grids, pallets, legends, and overlays are included with the download in the GridToMap folder. For additional details, see the version log that comes with the download.Unknownnoreply@blogger.com2tag:blogger.com,1999:blog-1670073287004531921.post-2613012623113509502010-03-26T20:01:00.003-04:002010-03-26T20:23:37.228-04:00Clouds<iframe allowfullscreen='allowfullscreen' webkitallowfullscreen='webkitallowfullscreen' mozallowfullscreen='mozallowfullscreen' width='320' height='266' src='https://www.blogger.com/video.g?token=AD6v5dwNBKEeONefrsgs-OhAjIpEDaKYn-blyPKy5Tl2jOa_pTrASc7JNW9H_Yr-ratkLpLDWo_Y6TSX-LhBjXq1zA' class='b-hbp-video b-uploaded' frameborder='0'></iframe>Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-1670073287004531921.post-795600914225890152010-03-23T18:30:00.000-04:002010-03-23T18:30:36.828-04:00Magicjava Climate Data AnnouncedThe first beta release of Magicjava Climate Data has been made available. The data is daily and monthly averages for AMSU channel 5 for January, 2009 through December, 2009 in .csv format. You can get the data <a href="http://magicjava.blogspot.com/p/magicjava-climate-data.html">here</a>.<br />
<br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjGDiqa943JPE2DtorynIp9AMmeZsjNcq53tMqHMiuQEk84wE6mcCAK9Osc6Cr_Ffpsxbs8sSkTQyN8-9qRP3Rnb_WgC5oCnHHT5Mo84imIENnmOo9STGoXckHC5zpHZzOrvbgAOm1uGO4/s1600-h/Lower3rd.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="300" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjGDiqa943JPE2DtorynIp9AMmeZsjNcq53tMqHMiuQEk84wE6mcCAK9Osc6Cr_Ffpsxbs8sSkTQyN8-9qRP3Rnb_WgC5oCnHHT5Mo84imIENnmOo9STGoXckHC5zpHZzOrvbgAOm1uGO4/s400/Lower3rd.png" width="400" /></a></div>Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-1670073287004531921.post-44497084286283873732010-03-21T13:31:00.012-04:002010-03-21T14:19:47.795-04:00Aqua Satellite Project, Update 4 ReleasedUpdate 4 for the Aqua Satellite Project is ready. You can <a href="https://sourceforge.net/projects/aquasatellite/files/Aqua%20Satellite.zip/download" style="color: #223344;">download it here</a>. I'd have to say the big item in this release is the QA. But another big item is the new <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">MapToGrid</span> program.<br />
<br />
<b>MapToGrid</b><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiIjNYDaPNkcutwWHpvziBHnoAMkE4pZk8OycYOXzFkVtRND2Ka2pzE9Y3QelzV4hpqHm42j-ndz3EuZuQQLzGXMYGy06mkNfDT4PcFa2I4-xbYkaPJ9LJgJZfmMuppfWN_Nycae79lKcc/s1600-h/MaskLandWaterSmall.png" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" height="100" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiIjNYDaPNkcutwWHpvziBHnoAMkE4pZk8OycYOXzFkVtRND2Ka2pzE9Y3QelzV4hpqHm42j-ndz3EuZuQQLzGXMYGy06mkNfDT4PcFa2I4-xbYkaPJ9LJgJZfmMuppfWN_Nycae79lKcc/s200/MaskLandWaterSmall.png" width="200" /></a></div>The <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">MapToGrid</span> program is for converting information in a black and white bitmap image to a 2.5 by 2.5 degree equal area grid that represents the Earth. An example image is shown to the left. It has water drawn in black and land draw in white. <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">MapToGrid</span> can take such information and transform it into C code, Javascript code, XML, or text. Other programs can then use this gridded information as a lookup table.<br />
<br />
A screen shoot of a Javascript program that reads grid information and draws the Earth's water and land on an HTML page is shown below.<br />
<br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi72nTFJDKASbVIFzzgIEOAI75Qb4dF0l-MCUTZD4hLe2XGchHRwULX3W1B_I8EmdcfILp_9GBTLLPgOGLLSO7g3_LMM3dgllnAuDzqJU8nZfw3P_6Jd_xP7iqHvr0Q4JiQ0S59yYZ5tBw/s1600-h/MapToGrid.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="208" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEi72nTFJDKASbVIFzzgIEOAI75Qb4dF0l-MCUTZD4hLe2XGchHRwULX3W1B_I8EmdcfILp_9GBTLLPgOGLLSO7g3_LMM3dgllnAuDzqJU8nZfw3P_6Jd_xP7iqHvr0Q4JiQ0S59yYZ5tBw/s400/MapToGrid.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Javascript HTML image created using Draw2D and MapToGrid</b></div><br />
<span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">MapToGrid</span> is the first of several programs that, together, will allow the creation and display of gridded satellite data.<br />
<br />
The command line help text for the <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">MapToGrid</span> program describes the details of using the program and is provided below.<br />
<br />
<code>MapToGrid converts a map image containing only the colors black and white into grid information. The map image must be a 32-bits-per-pixel, 720 by 360 pixel bitmap (.BMP) image. This image will be treated as a map of the entire world. The grid information will be a 2.5 by 2.5 degree equal area grid which indicates the percentage of white pixels in each grid. The output grid can be formatted as C code, JavaScript code, XML, or text. The default is text. Usage:<br />
MapToGrid [-h] -i Map_Bitmap -o Output_FileName [-f C | JavaScript | XML | text]<br />
h Displays this help text.<br />
i The location the bitmap (.BMP) input image.<br />
o The name of the output file that will store the grid information.<br />
f The output format. Valid format arguments are C, JavaScript, XML, or text.</code><br />
<br />
There are sample bitmaps suitable for using with <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">MapToGrid</span> in the MapToGrid folder.<br />
<br />
<b>QA</b><br />
A QA scrub was given to nearly all the existing programs (<span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">AMSUNormalize</span> still needs to be done). Several major bugs were fixed and some new features added.<br />
<br />
One of the new features is the the saving off of scans that don't pass NASA QA during an <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">AMSUExtract</span> run. You can take these rejected scans and run them through <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">AMSUSummary</span> just like the regular scans. A screen shot of a graph of rejected scans that has been summarized by <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">AMSUSummary</span> is shown below.<br />
<br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiIPV0ZkA2rEXOh944Y5Fkrs2UnLXe0sHdoae8GVcSYCgeL9h4MN2xWBu6kPAXwHO3Ye-hsvwN_TsFp3-HbKkTYShKFTwMLgB_BU8IsBzT2PdzNoat5ayy4vYDbso4a3shovtuVvHVL6UU/s1600-h/RejectedMonthly+1.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="300" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiIPV0ZkA2rEXOh944Y5Fkrs2UnLXe0sHdoae8GVcSYCgeL9h4MN2xWBu6kPAXwHO3Ye-hsvwN_TsFp3-HbKkTYShKFTwMLgB_BU8IsBzT2PdzNoat5ayy4vYDbso4a3shovtuVvHVL6UU/s400/RejectedMonthly+1.png" width="400" /></a></div><br />
Another new feature is the -FLOOR switch added to <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">AMSUExtract</span>. This option lets you specify a lower value for scans. Any value below the floor is rejected. When using the -FLOOR switch you don't need to specify a value. In this case the value defaults to 150 K (-123.15° C, -189.67° F). The -FLOOR switch replaces the -q switch, which has been removed.<br />
<br />
Yet another new feature added due to the QA was <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">AMSUSummary</span> printing out lower third and upper third averages for data rather than minimum and maximum values. This removes a lot of the noise that was created by the minimum and maximum feature. The maximum and minimum features have been removed.<br />
<br />
A previous post showed a graph of the lower and upper averages that looked rather blocky. This has been fixed and you can use these features with full confidence.<br />
<br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjyuNYQ77DE6BpEhzSS0skgYdEIIGslcJvpcWs2O8mGr4fwC1_QlcM0KxfriR0GD4xyQqK7QG-dzBOBlblPKwYFeKgzzjXB2SEdo8Gm4dPddEWfgm8t0SIxm9wzLXVgxKZK_rlv1U7egVY/s1600-h/Lower3rd.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="300" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjyuNYQ77DE6BpEhzSS0skgYdEIIGslcJvpcWs2O8mGr4fwC1_QlcM0KxfriR0GD4xyQqK7QG-dzBOBlblPKwYFeKgzzjXB2SEdo8Gm4dPddEWfgm8t0SIxm9wzLXVgxKZK_rlv1U7egVY/s400/Lower3rd.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Corrected Lower Third Averages Example</b></div><br />
<b>Change Log</b><br />
So those are the big items. Here's the text of the change log for full details:<br />
<br />
<br />
The following improvements were made for Update 4:<br />
<br />
*) Added MapToGrid program that converts a map image containing only the colors black and<br />
white into grid information.<br />
<br />
The map image must be a 32-bits-per-pixel, 720 by 360 pixel bitmap (.BMP) image. This image<br />
will be treated as a map of the entire world.<br />
<br />
The grid information will be a 2.5 by 2.5 degree equal area grid which indicates the<br />
percentage of white pixels in each grid.<br />
<br />
The output grid can be formatted as C code, JavaScript code, XML, or text. The default is<br />
text.<br />
<br />
Includes command line help text.<br />
<br />
*) Updated AMSUExtract program to send data that does not pass NASA's QA to stderr. Updated<br />
amsu_extract script to handle this option. It sends stderr files to a file with the same<br />
name as the regular file, but with the text "_Rejected" just before the file type suffix.<br />
<br />
*) Added -FLOOR switch to AMSUExtract. The switch takes an optional value for degrees Kelvin.<br />
Any scan below this value is sent to stderr rather than stdout. The value for -FLOOR defaults<br />
to 150 K (-123.15° C, -189.67° F)<br />
<br />
*) Removed -q switch from AMSUExtract. Limb adjustment checks are no longer done by this program.<br />
NASA QA checks are done automatically now, as described above.<br />
<br />
*) Default tolerance for Limb Check in AMSUQA raised from 0.5 to 1.0. Channels 12 and 19 added<br />
to the list of channels that no limb check is performed on. Miscellaneous bugs in limb check<br />
values fixed.<br />
<br />
*) Modified AMSUExtract to report daily and monthly lower and upper 1/3 averages rather than<br />
minimum and maximum values.<br />
<br />
*) QAed AMSUExtract and AMSUSummary, fixing several major bugs.<br />
<br />
*) MonthlyData and MonthlyDataMap have been refactored to a more generic ColumnData and<br />
RowDataMap. These new classes are templates. The number of columns, ID type, and data type<br />
are parameterized.<br />
<br />
*) Added the ability to retrieve upper and lower averages to ColumnData and RowDataMap<br />
classes.<br />
<br />
*) Added avg and sum scripts. These scripts take a file name and a column number and return<br />
the average or sum of that column. These are Unix scrips, requiring Unix utilities like cut,<br />
grep, and awk. These scripts are not and will never be part of the main workflow, they are<br />
intended as debugging aids. These new scripts are located in the Scripts folder. See the<br />
comments inside the scripts for details on using them.Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-1670073287004531921.post-20101630249809393562010-03-21T07:35:00.001-04:002010-03-21T07:40:07.378-04:00Results Of Aqua Satellite Project QA ChecksThe big QA session for the Aqua Satellite project is done. The results are there were some major bugs in the code. With these bugs fixed, the data from NASA looks they way you'd expect it to. The unusual readings occurring for each footprint mentioned in <a href="http://magicjava.blogspot.com/2010/03/qaing-amsuextract.html">this post</a> are still there, but they're not enough to throw off the averages.<br />
<br />
<b>Major Bug Fixes</b><br />
We'll take a look at all this data, but first, here's a list of the major bugs that were fixed:<br />
<br />
● The Limb Check had values that were too small for some of the footprints in its lookup table. This is what was causing entire footprints to be dropped from the old QA checks.<br />
<br />
● A subtle bug in the gnu C++ template generator was generating integers rather than floating point variables when working with floating point data. This was causing the decimal places to be chopped off, throwing off things like average values. This was fixed by getting rid of the offending templates and replacing them with a series of overloaded functions.<br />
<br />
● The order in which I was grabbing data for daily and monthly summaries was wrong, causing data for one footprint to be displayed as another footprint. This has been fixed.<br />
<br />
● The concept of daily and monthly minimum and maximum values produced by <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">AMSUSummary</span> was and is fundamentally flawed. For reasons why, see <a href="http://magicjava.blogspot.com/2010/03/noise.html">my post on Noise</a>. Therefore, the concept has been replaced with averages for the lower third of the data and the upper third of the data. There's enough data that goes into these calculations that noise shouldn't be a problem.<br />
<br />
<b>What The Data Looks Like Now</b><br />
The data displayed here covers the range of January, 2008, and January, 2009 through January, 2010. This is 14 months total of data. Letting the pictures speak for themselves:<br />
<br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiTtDiJ1I5oo0CJwRZ1Y4ameinDrrt3OhkFrQ73_vgTKk7Yodd3iL_tJUPFDvYWVzwVT3iv-FLzw0yiRSIza6yTk24Ceoo72AFL1qJqCq6sjsNK_ocUk7jafbZmYkDnyXcu2o2XnFaXJeE/s1600-h/Monthly+Averages1.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="317" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiTtDiJ1I5oo0CJwRZ1Y4ameinDrrt3OhkFrQ73_vgTKk7Yodd3iL_tJUPFDvYWVzwVT3iv-FLzw0yiRSIza6yTk24Ceoo72AFL1qJqCq6sjsNK_ocUk7jafbZmYkDnyXcu2o2XnFaXJeE/s400/Monthly+Averages1.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Monthly Averages, By Footprint</b></div><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiskEZClwoxMM1Trw8WjbpygpuALcQ8mGUNG18I9xR5zP7jPvQKbxXUDP_8DaRHwCIKV_dUBaVO0K_lwxxjymSnUXAZsccItJP691kQaO1mAftsOjunknP-AF5Ti8BTsknGnlPd9DCLj1Q/s1600-h/Monthly+Averages+2.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="243" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiskEZClwoxMM1Trw8WjbpygpuALcQ8mGUNG18I9xR5zP7jPvQKbxXUDP_8DaRHwCIKV_dUBaVO0K_lwxxjymSnUXAZsccItJP691kQaO1mAftsOjunknP-AF5Ti8BTsknGnlPd9DCLj1Q/s400/Monthly+Averages+2.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Monthly Averages, By Date</b></div><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjIJRE3uNh5h2q7_etzaC5F4bzrbeJtO5DYRdJqwFLkPdXNuC93lZbfQVbATYj_F_mKTR0nJwojfqVt-dXW4PI_GDN7VAWn2qSHBZIz00NGFzn5yHxJVXl9wXUUqhAUicELvH_ji_nPcWA/s1600-h/Monthly+Lower+Third+Averages1.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="297" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjIJRE3uNh5h2q7_etzaC5F4bzrbeJtO5DYRdJqwFLkPdXNuC93lZbfQVbATYj_F_mKTR0nJwojfqVt-dXW4PI_GDN7VAWn2qSHBZIz00NGFzn5yHxJVXl9wXUUqhAUicELvH_ji_nPcWA/s400/Monthly+Lower+Third+Averages1.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Monthly Lower Third Averages, By Footprint</b></div><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhvZK1jduD7QiN4FaCU8J-XwKkiG8DgSndgTr1iOObOe1JQ3-YEwJqeEyBwe_yY4l8T6VBiMWSWtUBYAAp3jDZg0mid4HqqTUoU7I1vwAlY04sR6U6LpkekSb-DTSS372DuwGN1xu8e-DA/s1600-h/Monthly+Lower+Third+Averages2.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="187" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhvZK1jduD7QiN4FaCU8J-XwKkiG8DgSndgTr1iOObOe1JQ3-YEwJqeEyBwe_yY4l8T6VBiMWSWtUBYAAp3jDZg0mid4HqqTUoU7I1vwAlY04sR6U6LpkekSb-DTSS372DuwGN1xu8e-DA/s400/Monthly+Lower+Third+Averages2.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Monthly Lower Third Averages, By Date</b></div><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiQcu5h38pF6R6f1IJwdOUTw92oYmXIWprmIURiZgjFGRhVZPNAzkVrsd3zqyzmpWZ2qmUuc0B3tYir8awQNISkjT-kYcVsHFvId6Fm99s9gCHMHnPkmJ7Q1M1PwWxsyCiaVElsWKyYMOw/s1600-h/Monthly+Upper+Third+Averages1.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="318" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEiQcu5h38pF6R6f1IJwdOUTw92oYmXIWprmIURiZgjFGRhVZPNAzkVrsd3zqyzmpWZ2qmUuc0B3tYir8awQNISkjT-kYcVsHFvId6Fm99s9gCHMHnPkmJ7Q1M1PwWxsyCiaVElsWKyYMOw/s400/Monthly+Upper+Third+Averages1.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Monthly Upper Third Averages, By Footprint</b></div><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg4H7TLxF4MgiDkveX0nVjmocwP6TfydvuiTPU0fhGUx6kINhZFHZF01FHCtSJOz9NqW8ejjJ3DGd2UtyNvKqtHFsZdgrPXFOJTn45wvSo8RbbBPMjnsp0xHE9VLKZJ5o_qTa7vTv_3oqo/s1600-h/Monthly+Upper+Third+Averages2.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="193" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg4H7TLxF4MgiDkveX0nVjmocwP6TfydvuiTPU0fhGUx6kINhZFHZF01FHCtSJOz9NqW8ejjJ3DGd2UtyNvKqtHFsZdgrPXFOJTn45wvSo8RbbBPMjnsp0xHE9VLKZJ5o_qTa7vTv_3oqo/s400/Monthly+Upper+Third+Averages2.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Monthly Upper Third Averages, By Date</b></div><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjR1Cae4Vk6EVfw3FT6oCO9lE_1i1g2oDreb9AUiaF5ZahhmhOs-lyvqN5OD5xnApGotvIjROZmz_Ag7HcCnV5k4olVDSBcPiVt8eCqzi-jx41kFwQhBQJ22REFe3Pwu6Dl5mg-PE3ePxo/s1600-h/Daily+Averages1.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="400" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjR1Cae4Vk6EVfw3FT6oCO9lE_1i1g2oDreb9AUiaF5ZahhmhOs-lyvqN5OD5xnApGotvIjROZmz_Ag7HcCnV5k4olVDSBcPiVt8eCqzi-jx41kFwQhBQJ22REFe3Pwu6Dl5mg-PE3ePxo/s400/Daily+Averages1.png" width="377" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Daily Averages, By Footprint</b></div><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg1vr-6iJ6_Iqd4C1FXqIKGmy0EMfmLRd9g-EqsG8olDzsXgg6v_jf3gewid8YetKHDpJ894HBYuRrpntTSnthf0HpbkHxkbOh9uFImXoY6_dLiKFSF4nrigxqhicbW-gjldwvzzr912r4/s1600-h/Daily+Averages2.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="335" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEg1vr-6iJ6_Iqd4C1FXqIKGmy0EMfmLRd9g-EqsG8olDzsXgg6v_jf3gewid8YetKHDpJ894HBYuRrpntTSnthf0HpbkHxkbOh9uFImXoY6_dLiKFSF4nrigxqhicbW-gjldwvzzr912r4/s400/Daily+Averages2.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Daily Averages, By Date</b></div><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhNMElGjK05esvSxtskmXdvmhoXNM94pDM-3dlyCTn62KlJ0a_qAq3odhB26nN0F8kvCFTO-jB6BNVg90GcNntzpZlkKCtXrrvvrV9qU2uK0E5Qs8pl7vdSbUv8fj2QoY9sEJI6G3fK734/s1600-h/Daily+Lower+Third+Averages1.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="316" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhNMElGjK05esvSxtskmXdvmhoXNM94pDM-3dlyCTn62KlJ0a_qAq3odhB26nN0F8kvCFTO-jB6BNVg90GcNntzpZlkKCtXrrvvrV9qU2uK0E5Qs8pl7vdSbUv8fj2QoY9sEJI6G3fK734/s400/Daily+Lower+Third+Averages1.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Daily Lower Third Averages, By Footprint</b></div><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjqf42HeD3yOns0y8D-kUcf8Cv1gE-NgsoWEB5tzjl_K2XeMGE1rYhTLbovDbs-6Av0SZw0tQo2mR0UTrQFpPQ70ASFuevU3czm0OK6zR-35xfvDPMFHjf7M_Eq1f_xA0qlBXO6Dl1H5to/s1600-h/Daily+Lower+Third+Averages2.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="222" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjqf42HeD3yOns0y8D-kUcf8Cv1gE-NgsoWEB5tzjl_K2XeMGE1rYhTLbovDbs-6Av0SZw0tQo2mR0UTrQFpPQ70ASFuevU3czm0OK6zR-35xfvDPMFHjf7M_Eq1f_xA0qlBXO6Dl1H5to/s400/Daily+Lower+Third+Averages2.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Daily Lower Third Averages, By Date</b></div><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgjIKuMBYX65aHXV8N4lKklwDKJW-XKk8BYK7VLMXi-hyp8ePGHGc6byxhyphenhyphen7KFFmQM0tM3CG62acdbRIVdmGshBdQbDsK6qmoEMg-SILFenUF0E6rNyL8Dej9QSyJaN0RhHD0Q7zB-ZMAY/s1600-h/Daily+Upper+Third+Averages1.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="315" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgjIKuMBYX65aHXV8N4lKklwDKJW-XKk8BYK7VLMXi-hyp8ePGHGc6byxhyphenhyphen7KFFmQM0tM3CG62acdbRIVdmGshBdQbDsK6qmoEMg-SILFenUF0E6rNyL8Dej9QSyJaN0RhHD0Q7zB-ZMAY/s400/Daily+Upper+Third+Averages1.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Daily Upper Third Averages, By Footprint</b></div><br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgSPvu-FMuljZA5tK9YW8c5MgdzM5GdQDLZ7dhXt-Hrx-aG1oOewI4Fawd7uv_ZR8rGVQttTu49fCcaCqW31creU7PcxxEfwLD68KyIWwG8T1qvZseUjlYV42kvVSBF9yyB-t-Imxuwh8A/s1600-h/Daily+Upper+Third+Averages2.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="247" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgSPvu-FMuljZA5tK9YW8c5MgdzM5GdQDLZ7dhXt-Hrx-aG1oOewI4Fawd7uv_ZR8rGVQttTu49fCcaCqW31creU7PcxxEfwLD68KyIWwG8T1qvZseUjlYV42kvVSBF9yyB-t-Imxuwh8A/s400/Daily+Upper+Third+Averages2.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Daily Upper Third Averages, By Date</b></div><br />
The upper and lower values look a little blocky. So I'll do some more QA on those. I also still need to QA <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">AMSUNormalize</span>. However, none of those things are enough to prevent this code from being released as part of Update 4. Update 4 will be released later today.<br />
<br />
<b>Previous Posts In This Series</b><br />
<a href="http://magicjava.blogspot.com/2010/03/qaing-amsuextract.html">QAing AMSUExtract</a><br />
<a href="http://magicjava.blogspot.com/2010/03/whats-wrong-with-this-picture.html">What's Wrong With This Picture?</a><br />
<span id="goog_1269163629453"></span><span id="goog_1269163629454"></span>Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-1670073287004531921.post-38941748610269474772010-03-20T05:41:00.001-04:002010-03-20T06:30:29.470-04:00One Month Of AMSU Channel 5 Data<iframe allowfullscreen='allowfullscreen' webkitallowfullscreen='webkitallowfullscreen' mozallowfullscreen='mozallowfullscreen' width='320' height='266' src='https://www.blogger.com/video.g?token=AD6v5dwKpegGQGs2dQ_rFtDSfyMP-zuAGIquu1FtemOm5-UekLi4167h2xXkXizr74Pe2VzrQMg617tDt7E0-HncPg' class='b-hbp-video b-uploaded' frameborder='0'></iframe><br />
This video shows 1 month of Aqua AMSU Channel 5 data as it was displayed during one of my debugging sessions. The video is kinda blurry due to low resolution, but don't worry, you wouldn't be able to read all the data scrolling by even at HD resolution. Enjoy :)<br />
<br />
Update:<br />
Here's a screen shot of the end of the video in better resolution so you can see the data is nothing but the numeric readings from the channel.<br />
<br />
<a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjkgryNTkTqQSrwde3aV2lf1zgA6JK9ebEDaxw9Vu-p0RnroI9nkivXI3FSqt75gZsi09OlP1f1UFwT-Nwymelq2hhs5ED7fUr-KwDq3GDQun2c12OwQmup72lGF3qQOdtMs1vjNtkTGYE/s1600-h/datadump.png" onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}"><img alt="" border="0" id="BLOGGER_PHOTO_ID_5450597368599788610" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEjkgryNTkTqQSrwde3aV2lf1zgA6JK9ebEDaxw9Vu-p0RnroI9nkivXI3FSqt75gZsi09OlP1f1UFwT-Nwymelq2hhs5ED7fUr-KwDq3GDQun2c12OwQmup72lGF3qQOdtMs1vjNtkTGYE/s400/datadump.png" style="cursor: hand; cursor: pointer; float: left; height: 300px; margin: 0 10px 10px 0; width: 400px;" /></a>Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-1670073287004531921.post-64107156801540780142010-03-19T09:26:00.002-04:002010-03-19T14:35:59.377-04:00National Snow And Ice Data Center Releases AMSR-E Satellite Surface Temperature Data<div class="separator" style="clear: both; text-align: center;"><a href="http://www.unfpa.org/swp/2007/presskit/images/urban_hwy.jpg" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" height="200" src="http://www.unfpa.org/swp/2007/presskit/images/urban_hwy.jpg" width="137" /></a></div>I just got this in the mail late yesterday. The National Snow And Ice Data Center (NSIDC) has just released several new climate products, including minimum and maximum air surface temperatures.<br /><br />Here's the e-mail:<br /><blockquote>NSIDC is pleased to announce the release of the Daily Global Land Surface Parameters Derived from AMSR-E data set. This data set contains satellite-retrieved geophysical parameters generated from the Advanced Microwave Scanning Radiometer - Earth Observing System (AMSR-E) instrument on the National Aeronautics and Space Administration (NASA) Aqua satellite. Parameters include:</blockquote><blockquote>-Air temperature minima and maxima at approximately 2 meters in height</blockquote><blockquote>-Fractional cover of open water on land</blockquote><blockquote>-Vegetation canopy microwave transmittance</blockquote><blockquote>-Surface soil moisture at less than or equal to 2 centimeters soil depth</blockquote><blockquote>-Integrated water vapor content of the intervening atmosphere for the total column</blockquote><blockquote>The daily parameter retrievals extend from 19 June 2002 through 31 December 2008. The global retrievals were derived over land for non-precipitating, non-snow, and non-ice covered conditions. The primary input data were daily AMSR-E dual polarized multi-frequency, ascending and descending overpass brightness temperature data.</blockquote><blockquote>For more information regarding this data set, please see http://nsidc.org/data/nsidc-0451.html.</blockquote>This is pretty timely. There's several simultaneous attempts going on right now to better understand Urban Heat Islands (UHI). The minima/maxima temperatures at 6 meters should be particularly relevant to these studies. A signature of UHI is the night time temperatures go up, while the day time temperatures stay about the same. This new data will give us the tools we need to look for UHI directly on a global scale.<br /><br />And since the AMSR-E used to gather this data is part of the Aqua satellite, I can fold in studying the new data with the work on the satellite.<br /><br />So expect to hear more about this in the near future.Unknownnoreply@blogger.com0tag:blogger.com,1999:blog-1670073287004531921.post-74968346359716515542010-03-18T20:21:00.018-04:002010-03-19T01:24:35.212-04:00QAing AMSUExtract<b><span class="Apple-style-span" style="font-size: x-large;">In A NutShell</span></b><br />
So, I've been QAing <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">AMSUExtract</span> the last couple days. The end results is that several bugs were found and fixed in my code. But even with these fixes, a lot of data was still failing limb validation. Even after increasing the limb validation tolerance from the original 0.5 to 10.0 (giving over 100 degrees tolerance in some cases), there were still more failures than I would consider acceptable.<br />
<br />
This told me that having a limb validation in <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">AMSUExtract</span> was pointless. To get a decent number of records to pass this QA check, I'd need to make the check so loose that nearly any imaginable value would pass.<br />
<br />
So limb validation, the -q switch of <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">AMSUExtract</span>, has been taken out. It's been replaced with a -FLOOR switch that lets you set a lower bound for a valid temperature. The default lower bound when you use -FLOOR is 150 degrees K (-123.15° C, -189.67° F), but you can pass any numeric value you want. Scans that are marked as bad by NASA or that fail the optional -FLOOR check are the only ones that will now fail in <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">AMSUExtract</span>.<br />
<br />
Limb vaidation is still available as an option for the <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">AMSUQA</span> program.<br />
<br />
I want to thank Malaga View for suggesting the feature to save not only scans that pass QA, but also scans that fail QA. This feature is now part of <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">AMSUExtract</span> and was very useful for this QA check. BTW, should anyone else have ideas for features, please feel free to suggest them. If I have the time, I'll add them.<br />
<br />
The end result of all this is <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">AMSUExtract</span> is now working and has new features to boot. This will be released in Update 4. Now I move on to QAing <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">AMSUSummary</span>. <br />
<div class="separator" style="clear: both; text-align: center;"><br />
</div><br />
<br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh54ZJtee4dqCa5VLlK6LO7NgBdnlWI7aAQn-D3b59Ej_1n4qEYtnOuWWx9s5sYNxVZQeKR59S4rpF1AiBX6n7TK9PcyZ4UNPJ3NXQG4-qh1QCtPHRwNK7uA7pbAZvR9xqOHj11fT7QaxA/s1600-h/BadDataFile3.png" imageanchor="1" style="margin-left: 1em; margin-right: 1em;"><img border="0" height="281" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEh54ZJtee4dqCa5VLlK6LO7NgBdnlWI7aAQn-D3b59Ej_1n4qEYtnOuWWx9s5sYNxVZQeKR59S4rpF1AiBX6n7TK9PcyZ4UNPJ3NXQG4-qh1QCtPHRwNK7uA7pbAZvR9xqOHj11fT7QaxA/s400/BadDataFile3.png" width="400" /></a></div><div class="separator" style="clear: both; text-align: center;"><b>Final Results With -FLOOR switch. </b></div><div class="separator" style="clear: both; text-align: center;"><b>The file is clean like this all the way through.</b></div><br />
<span class="Apple-style-span" style="font-size: x-large; font-weight: bold;">The Painful Details</span><br />
<br />
<div style="margin-bottom: 0px; margin-left: 0px; margin-right: 0px; margin-top: 0px;">The part of this post can be skipped. It's the details on how the QA was carried out. It's here for people who just love to read about QA procedures on blogs or who may need to know the details for something they're doing on their own.</div><div style="margin-bottom: 0px; margin-left: 0px; margin-right: 0px; margin-top: 0px;"><br />
</div><div style="margin-bottom: 0px; margin-left: 0px; margin-right: 0px; margin-top: 0px;"><b>Setup For QA</b></div><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgop7vMlE8khE8Ly8gf8fZZDSloFJNNpXULmJ4CI6Scup2_YLTbVYnwX5sLyChilMrKoyvf6hmi6yh4TlRumw6hEPE8qsGZ-PwQAm8bk-FyrH68vgIRPzDdFsY7s0ewdH59Pn7gLpkrafg/s1600-h/QASetup.png" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" height="159" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgop7vMlE8khE8Ly8gf8fZZDSloFJNNpXULmJ4CI6Scup2_YLTbVYnwX5sLyChilMrKoyvf6hmi6yh4TlRumw6hEPE8qsGZ-PwQAm8bk-FyrH68vgIRPzDdFsY7s0ewdH59Pn7gLpkrafg/s320/QASetup.png" width="320" /></a></div><div>I setup the QA runs by removing all but one folder for the directory I was working in. That folder contained .hdf files for a single month. That folder, in turn, contained a text folder that contained the text extract files created by <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">ncdump</span> from the .hdf files.</div><div><br />
</div><div>As always, <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">ncdump</span> was run with no command line arguments, just the file name of the file being converted.</div><div><br />
</div><div>You can download <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">ncdump</span> from <a href="http://nsidc.org/data/hdfeos/hdf_to_ascii.html">here</a>.</div><div><b><br />
</b></div><br />
<div style="margin-bottom: 0px; margin-left: 0px; margin-right: 0px; margin-top: 0px;"><b>Running Release 3 Version Of AMSUExtract</b></div>The <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">amsu_extract</span> script was used to extract data from all the files for the month. The exact command line was:<br />
<br />
<span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">amsu_extract -extension C5F1-30_QA_TEST -c 5 -f 1-30 -q</span><br />
<br />
This extracts channel 5, footprints 1 through 30 and performs QA checks on them. The -extension argument tells the script how to name the output file. In this case the output extract file will be named 200912_extract_C5F1-30_QA_TEST.csv, where 200912 is the name of the folder storing the monthly data. This file is created in the same directory from which the script is run.<br />
<br />
The version of <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;"><span class="Apple-style-span" style="font-family: Times;"><span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">AMSUExtract</span> called by the <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">amsu_extract<span class="Apple-style-span" style="font-family: Times, Courier, monospace;"> script was the same as the one in Update 3 with one exception: scans that fail QA are sent to stderr. The <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">amsu_extract<span class="Apple-style-span" style="font-family: Times, Courier, monospace;"> script, in turn, saves stderr to a separate file.</span></span></span></span></span></span><br />
<br />
<br />
<div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgRl9nYnHR3gwPZnR-61fO9zZf3rJIQNr9qWXEro095Yvc5mPnSX7sLS3YwbtLwnnwqnJV4LnpOeOvuXh4UXHp4b-rlqvfSSHW6ubd_h3eYJrXDa6Bz_BhkDeZNRRKQHJ633sCjsJNZiuQ/s1600-h/HDFView1.png" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" height="258" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgRl9nYnHR3gwPZnR-61fO9zZf3rJIQNr9qWXEro095Yvc5mPnSX7sLS3YwbtLwnnwqnJV4LnpOeOvuXh4UXHp4b-rlqvfSSHW6ubd_h3eYJrXDa6Bz_BhkDeZNRRKQHJ633sCjsJNZiuQ/s320/HDFView1.png" width="320" /></a></div><div style="margin-bottom: 0px; margin-left: 0px; margin-right: 0px; margin-top: 0px;"><b>Results Of Running Release 3 Version Of AMSUExtract</b></div><div style="margin-bottom: 0px; margin-left: 0px; margin-right: 0px; margin-top: 0px;"><b><span class="Apple-style-span" style="font-weight: normal;"><i>Step 1: Check Values Being Extracted</i></span></b></div><div style="margin-bottom: 0px; margin-left: 0px; margin-right: 0px; margin-top: 0px;"><b><span class="Apple-style-span" style="font-weight: normal;">The first thing to do is verify that <span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;"><span class="Apple-style-span" style="font-family: Times;"><span class="Apple-style-span" style="font-family: 'Courier New', Courier, monospace;">AMSUExtract</span> is pulling the correct data. To do this, use </span>HDFView<span class="Apple-style-span" style="font-family: Times;"> and open up the original .hdf files downloaded from NASA. You can download </span>HDFView<span class="Apple-style-span" style="font-family: Times;"> from <a href="http://www.hdfgroup.org/hdf-java-html/hdfview/">here</a>.</span></span></span></b></div><div style="margin-bottom: 0px; margin-left: 0px; margin-right: 0px; margin-top: 0px;"><span class="Apple-style-span" style="font-family: inherit;"><br />
</span></div><div style="margin-bottom: 0px; margin-left: 0px; margin-right: 0px; margin-top: 0px;"><span class="Apple-style-span" style="font-family: inherit;">Use the <b>File/Open</b> command to open the .hdf files you want to look at. Use the tree control on the left to navigate to brightness_temp. Double click on brightness_temp. At the to of the grid window that opens up, use the page scroller to move to page 4. Page 4 is the data for channel 5, the numbering starts at zero. </span></div><div style="margin-bottom: 0px; margin-left: 0px; margin-right: 0px; margin-top: 0px;"><br />
</div><div style="margin-bottom: 0px; margin-left: 0px; margin-right: 0px; margin-top: 0px;">You'll notice the rows in the window are numbered 0-44. These are the scan lines. The columns are numbered 0-29. These are the footprints. </div><div style="margin-bottom: 0px; margin-left: 0px; margin-right: 0px; margin-top: 0px;"><br />
</div><div style="margin-bottom: 0px; margin-left: 0px; margin-right: 0px; margin-top: 0px;">Open up the extract file (200912_extract_C5F1-30_QA_TEST.csv in my case) in a text editor. Visually compare the values in the extract file to the values in HDFView. You don't have to check every value, but you want to check enough cases to convince yourself the correct values are being pulled.</div><div><br />
</div><div><i>Step 2: Compare File Sizes Of Passed And Failed Data Files</i></div><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhPelnuKw9RLb7BqzrlXXsJO37W7gQCofM2JM0h92tNS5TOSHeAUqmqUhNUHACw6O_epzaAIGCxbUvMKInciCt_6LNaLAsDq9nJERZ8ph356L2iwsTXe0N9KdvVE-2HHsHaNGW1gAvxp8Q/s1600-h/QA_TEST_FileSizes.png" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhPelnuKw9RLb7BqzrlXXsJO37W7gQCofM2JM0h92tNS5TOSHeAUqmqUhNUHACw6O_epzaAIGCxbUvMKInciCt_6LNaLAsDq9nJERZ8ph356L2iwsTXe0N9KdvVE-2HHsHaNGW1gAvxp8Q/s320/QA_TEST_FileSizes.png" /></a></div><div>Checking the file sizes of the passed and failed data shows that the failed file is about 2/3s the size of the passed file. Now, a fair portion of that is header information, but most of it is actually failed data. This means a <i>lot</i> of data is failing QA.</div><div><br />
</div><div><i>Step 3: Look At Failed Data:</i></div><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgjTm1HIWNKPq0uPX9t-HRLCJnoa3jKbPnrgoKZS6F-Whet6FvxpOlBdWXj7B2Gu0pE7WHI2SY5Yx2YitVyhte1lvgqq-cmkzoP6kJC-XFtig2ZStawh-JlMI4746rnFiEjTYPfMeXYMd4/s1600-h/BadDataFile.png" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" height="312" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgjTm1HIWNKPq0uPX9t-HRLCJnoa3jKbPnrgoKZS6F-Whet6FvxpOlBdWXj7B2Gu0pE7WHI2SY5Yx2YitVyhte1lvgqq-cmkzoP6kJC-XFtig2ZStawh-JlMI4746rnFiEjTYPfMeXYMd4/s400/BadDataFile.png" width="400" /></a></div><div>Opening up the failed data file, I saw a lot of data that looked reasonable to me. So I was failing data that should have passed. </div><div><br />
</div><div>To fix this problem, I tracked down a couple of bugs in the QA checks, expanded the number of footprints that don't get a limb validation check, and increased the tolerance of the limb validation from 0.5 to 10.0.</div><div><br />
</div><div>Even with these changes, a lot of data was still failing. I'll talk about that in the next section.</div><div><br />
</div><div><span class="Apple-style-span" style="font-weight: bold;">Results Of Running Modified Version Of AMSUExtract</span></div><div>To try to cut down on the number of scans failing, I gradually increased the tolerance. Eventually, I had it all the way up to 10.0 and still had more records failing than I expected. Screen shots of running with a 10.0 tolerance are below.</div><div><br />
</div><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhza27cl1h4kk3TMBfeqVv-Z0nwhB3_U4Zf8_uzihJ43eXGhG26Kr6d_cS3SXqWhE1XlGKGH0jfmCtuc8jQ243e6UwvMEKVdxld_l3FU8fEqLW_wAVSf5ANAyLFk5r__X4RMXe4YPmCj9E/s1600-h/QA_TEST_FileSizes2.png" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" height="26" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhza27cl1h4kk3TMBfeqVv-Z0nwhB3_U4Zf8_uzihJ43eXGhG26Kr6d_cS3SXqWhE1XlGKGH0jfmCtuc8jQ243e6UwvMEKVdxld_l3FU8fEqLW_wAVSf5ANAyLFk5r__X4RMXe4YPmCj9E/s320/QA_TEST_FileSizes2.png" width="320" /></a></div><div>The error file looks a lot better, but further down the file there are still quite a few scans listed as failing.</div><div>At this point I realized it was hopeless to try and salvage the concept of running a limb validation in the extract. So I took it out and replaced it with the -FLOOR option.</div><div><br />
</div><div class="separator" style="clear: both; text-align: center;"><a href="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEixJ5DBn_wZLFreDPkm5SQDYy2vaeU6hDbbWBm7nZ3kwNlFD8EsumXqVUUjrAbm_xc7rKcEfWbYOQpeJy9uMtaiPtBNYm7ZaVMV1vM3UqSHPMa7ynCdUwLt23t8PVPbAjtGeT-JAcZorS4/s1600-h/BadDataFile2.png" imageanchor="1" style="clear: left; float: left; margin-bottom: 1em; margin-right: 1em;"><img border="0" height="250" src="https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEixJ5DBn_wZLFreDPkm5SQDYy2vaeU6hDbbWBm7nZ3kwNlFD8EsumXqVUUjrAbm_xc7rKcEfWbYOQpeJy9uMtaiPtBNYm7ZaVMV1vM3UqSHPMa7ynCdUwLt23t8PVPbAjtGeT-JAcZorS4/s320/BadDataFile2.png" width="320" /></a></div><div><br />
</div><br />
<b>References:</b><br />
<a href="http://nsidc.org/data/hdfeos/hdf_to_ascii.html">Download ncdump</a><br />
<a href="http://www.hdfgroup.org/hdf-java-html/hdfview/">Download HDFView</a>Unknownnoreply@blogger.com0