2MAPPS Software Interface Specification QUA07 1.0 (000202; D. Kirkpatrick) Interface Name: QA Scan Information Table (SIT) Type of Interface: ASCII text Written By: SCANSCI + customized software ___________ R. Hurt/G. Kopan Read By: offline analysis program ________________ R. Stiening [ DBMAN ___________________________________ T. Evans ] File Name: qasit.{yymmdd}, where {yymmdd} is the file creation date. This file lives at lugosi:/2massd/ops/sitdb and can be accessed from wolfman. Description: The QA Scan Information Table (SIT) contains a record of every science scan observed by either of the 2MASS observing facilities. Only scans that have passed OPS processing are included here -- no failed scans. Each entry contains basic information on the scan (tile number, date, hemisphere, scan number, RA and Dec centers, etc.) and each of the quality assessments that went into deriving the scan's final quality score (including components for photometry, untracked seeing, background residuals, banding, and quadrant jumps). Also given for each scan are the quality factors derived from each of the quality assessment values above, flags to indicate when those factors were overridden, and the final quality score of the scan. Additional columns are provided at the end to indicate the scan's quality score if the overrides were ignored, the score based on any to-be-determined changes in the scoring algorithm (column to be filled in later by another offline analysis program), and the score as it is actually entered in the Survey Master Data Base (column to be filled in later by UMass). The file is sorted by increasing tile number. In the event of multiple tile numbers, the more recent scans of that tile are listed first. After a new night has been processed through OPS, a {yymmddh}.sit file is created and deposited into the lugosi:/2massd/ops/sitdb/nsit/ directory. This file contains an XSIT-type entry for every science scan processed on that night (see qua05). Once a week, on Wednesday, the accumulated nightly files will be concatenated, checked, and sorted into an updated table by running the makesit script, producing a new XSIT output file -- lugosi:/2massd/ops/sitdb/qaxsit.{yymmdd} -- where {yymmdd} reflects the new creation date. The current /home/roc/obslogs/info/sci.info file will then be read in by [give the name of Gene's new script here] and joined with the XSIT output file to create the master QA Scan Information Table (SIT) described below. File header: The header is in standard IPAC table header format. The first line gives the version number, run date, and run time for the program (the customized software) creating the file. The second and third header lines give the date and time that the file was last modified by IPAC or by UMass, respectively. The fourth header line lists the number of actual entries in the table, not counting the header lines. Each of the first four header lines is in A60 format. The 5th-8th header lines (in A650 format) give the field identifier, data type, and units for each column in the file. An example header line is shown below: \ YYYYMMDD HHMMSS Date last run by customized software VX.X 99XXXX. \ YYYYMMDD HHMMSS Date last modified at IPAC. \ YYYYMMDD HHMMSS Date last modified at UMass. \ NNNNN data rows in this file. | Tile | Date |H|Scn| Ra | Dec | Glat | Glon |A|D|C| ... | int | int |c|int| real | real | real | real |i|i|i| ... | | | | | | | | | | | | ... | | | | | deg | deg | deg | deg | | | | ... Specification of Output Variables --------------------------------- Basic Scan Info: cols Name Description Units Type Format Null Range Source ------- ------ ------------------------------------- ------- ---- -------- ---- ----- ------ 001-007 Tile Tile number -- int I7 n 0-89000, 100000-189000 log/{yymmddh}.lgo 200000-289000, or 300000-389000 008-014 Date Observation date -- int I7 n 000101 to 030101 or log/{yymmddh}.lgo 970521 to 991231 015-016 H Hemisphere -- int I2 n 0 or 1 log/{yymmddh}.lgo 017-020 Scn Nightly scan number -- int I4 n 1 to 999 log/{yymmddh}.lgo 021-030 Ra Approximate RA of scan center deg r*4 F10.4 n 0. to 360. computed by SCANSCI 031-040 Dec Approximate DEC of scan center deg r*4 F10.4 n -90. to 90. computed by SCANSCI 041-050 Glat Approx. galactic lat. of scan center deg r*4 F10.4 n 0. to 360. computed by SCANSCI 051-060 Glon Approx. galactic long. of scan center deg r*4 F10.4 n -90. to 90. computed by SCANSCI 061-062 A Array configuration (original/modified) -- int I2 n 0 or 1 computed by SCANSCI 063-064 D Dithering pattern (non-optimal/optimal) -- int I2 n 0 or 1 computed by SCANSCI 065-066 C Calibration strategy (old/new) -- int I2 n 0 or 1 computed by SCANSCI 067-073 NJ Number of J band detections -- int I7 n 0 to 999999 s{nnn}/qual/sq{nnn}.bmg 074-080 NH Number of H band detections -- int I7 n 0 to 999999 s{nnn}/qual/sq{nnn}.bmg 081-087 NK Number of Ks band detections -- int I7 n 0 to 999999 s{nnn}/qual/sq{nnn}.bmg 088-094 Jdens (not computed; placeholder for now) -- r*4 F7.3 -9.9 0. to 6. (not yet computed) 095-101 Hdens (not computed; placeholder for now) -- r*4 F7.3 -9.9 0. to 6. (not yet computed) 102-108 Kdens Log of Ks max. src density (Ks<14.0 mag) -- r*4 F7.3 n 0. to 6. s{nnn}/qual/galworks.tbl 109-115 Nbmg Number of detections after bandmerging -- int I7 n 0 to 999999 s{nnn}/qual/sq{nnn}.bmg 116-122 Jsh Average J seeing shape in scan -- r*4 F7.3 -9.9 0. to 9. datequal/q{yymmddh}.psf.see 123-129 Hsh Average H seeing shape in scan -- r*4 F7.3 -9.9 0. to 9. datequal/q{yymmddh}.psf.see 130-136 Ksh Average Ks seeing shape in scan -- r*4 F7.3 -9.9 0. to 9. datequal/q{yymmddh}.psf.see 137-143 MxJsh Maximum J seeing shape in scan -- r*4 F7.3 -9.9 0. to 9. datequal/{yymmddh}.cnoise 144-150 MxHsh Maximum H seeing shape in scan -- r*4 F7.3 -9.9 0. to 9. datequal/{yymmddh}.cnoise 151-157 MxKsh Maximum Ks seeing shape in scan -- r*4 F7.3 -9.9 0. to 9. datequal/{yymmddh}.cnoise 158-167 Jbg Average J frame background DN r*4 F10.3 -9.9 0. to 99999. datequal/q{yymmddh}.bgrnd 168-177 Hbg Average H frame background DN r*4 F10.3 -9.9 0. to 99999. datequal/q{yymmddh}.bgrnd 178-187 Kbg Average Ks frame background DN r*4 F10.3 -9.9 0. to 99999. datequal/q{yymmddh}.bgrnd 188-194 Jrat J image aspect ratio -- r*4 F7.3 -9.9 0. to 1. datequal/q{yymmddh}.psf.see 195-201 Hrat H image aspect ratio -- r*4 F7.3 -9.9 0. to 1. datequal/q{yymmddh}.psf.see 202-208 Krat Ks image aspect ratio -- r*4 F7.3 -9.9 0. to 1. datequal/q{yymmddh}.psf.see (Notes: H - 0=south (observed from CTIO); 1=north (observed from Mt. Hopkins) RA - Approximate RA of scan center as computed from the eastern equatormost corner from the four corners file (this is computed from the actual reconstructed corner points, not from the expected position of the tile this scan is meant to cover) Dec - Approximate Dec of scan center as computed from the eastern equatormost corner from the four corners file (this is computed from the actual reconstructed corner points, not from the expected position of the tile this scan is meant to cover) Glat - Approximate galactic latitude as computed from RA and Dec above Glong - Approximate galactic longitude as computed from RA and Dec above A - for north: 0 for <990913n, 1 for >=990913n for south: always 0 D - for north: 0 for <970607n, 1 for >=970607n for south: always 1 C - for north: 0 for <971011n, 1 for >=971011n for south: always 1 ) Photometric Components: cols Name Description Units Type Format Null Range Source ------- ------ ------------------------------------- ------- ---- -------- ---- ----- ------ 209-215 Jpsp J photometric sensitivity parameter -- r*4 F7.3 -9.9 0. to 30. computed by SCANSCI 216-222 Hpsp H photometric sensitivity parameter -- r*4 F7.3 -9.9 0. to 30. computed by SCANSCI 223-229 Kpsp Ks photometric sensitivity parameter -- r*4 F7.3 -9.9 0. to 30. computed by SCANSCI 230-238 Jzp J phot. zero point, extinction corrected mag r*4 F9.4 -9.9 -1. to 1. datequal/q{yymmddh}.cal 239-247 Hzp H phot. zero point, extinction corrected mag r*4 F9.4 -9.9 -1. to 1. datequal/q{yymmddh}.cal 248-256 Kzp Ks phot. zero point, extinction corrected mag r*4 F9.4 -9.9 -1. to 1. datequal/q{yymmddh}.cal 257-265 Jrzp J photometric zero point RMS mag r*4 F9.4 -9.9 -1. to 1. datequal/q{yymmddh}.cal 266-274 Hrzp H photometric zero point RMS mag r*4 F9.4 -9.9 -1. to 1. datequal/q{yymmddh}.cal 275-283 Krzp Ks photometric zero point RMS mag r*4 F9.4 -9.9 -1. to 1. datequal/q{yymmddh}.cal 284-290 Jovlp Maximum J overlap diff. in scan block mag r*4 F7.3 -9.9 -1. to 1. datequal/q{yymmddh}.cumtab 291-297 Hovlp Maximum H overlap diff. in scan block mag r*4 F7.3 -9.9 -1. to 1. datequal/q{yymmddh}.cumtab 298-304 Kovlp Maximum Ks overlap diff. in scan block mag r*4 F7.3 -9.9 -1. to 1. datequal/q{yymmddh}.cumtab (Notes: Jpsp - this is Jsh*(Jbg^0.29) Hpsp - this is Hsh*(Hbg^0.29) Kpsp - this is Ksh*(Kbg^0.29) ) Untracked Seeing Components: cols Name Description Units Type Format Null Range Source ------- ------ ------------------------------------- ------- ---- -------- ---- ----- ------ 305-311 Jsee J Seetracker score -- r*4 F7.3 -9.9 -1. to 99. {yymmddh}.seetrack 312-318 Hsee H Seetracker score -- r*4 F7.3 -9.9 -1. to 99. {yymmddh}.seetrack 319-325 Ksee Ks Seetracker score -- r*4 F7.3 -9.9 -1. to 99. {yymmddh}.seetrack 326-331 Jlen J Untracked length arcsec int I6 -9 0 to 21600 {yymmddh}.seetrack 332-337 Hlen H Untracked length arcsec int I6 -9 0 to 21600 {yymmddh}.seetrack 338-343 Klen Ks Untracked length arcsec int I6 -9 0 to 21600 {yymmddh}.seetrack Background Residual Components: cols Name Description Units Type Format Null Range Source ------- ------ ------------------------------------- ------- ---- -------- ---- ----- ------ 344-348 Jn3s J coadd noise 3 sigma counter -- int I5 -9 0 to 9999 datequal/{yymmddh}.cnoise 349-353 Hn3s H coadd noise 3 sigma counter -- int I5 -9 0 to 9999 datequal/{yymmddh}.cnoise 354-358 Kn3s Ks coadd noise 3 sigma counter -- int I5 -9 0 to 9999 datequal/{yymmddh}.cnoise 359-363 Jcn4 J coadd noise (4th worst) -- r*4 F5.1 -9.9 -9.8 to 99. datequal/{yymmddh}.cnoise 364-368 Hcn4 H coadd noise (4th worst) -- r*4 F5.1 -9.9 -9.8 to 99. datequal/{yymmddh}.cnoise 369-373 Kcn4 Ks coadd noise (4th worst) -- r*4 F5.1 -9.9 -9.8 to 99. datequal/{yymmddh}.cnoise Banding Diagnostics: cols Name Description Units Type Format Null Range Source ------- ------ ------------------------------------- ------- ---- -------- ---- ----- ------ 374-377 Jbl J band. count, left (0.1 DN/Hi-SNR amp) -- int I4 -9 0 to 274 datequal/q{yymmddh}.bandaid 378-381 Hbl H band. count, left (0.1 DN/Hi-SNR amp) -- int I4 -9 0 to 274 datequal/q{yymmddh}.bandaid 382-385 Kbl Ks band. count, left (0.1 DN/Hi-SNR amp) -- int I4 -9 0 to 274 datequal/q{yymmddh}.bandaid 386-389 Jbr J band. count, right (0.1 DN/Hi-SNR amp) -- int I4 -9 0 to 274 datequal/q{yymmddh}.bandaid 390-393 Hbr H band. count, right (0.1 DN/Hi-SNR amp) -- int I4 -9 0 to 274 datequal/q{yymmddh}.bandaid 394-397 Kbr Ks band. count, right (0.1 DN/Hi-SNR amp) -- int I4 -9 0 to 274 datequal/q{yymmddh}.bandaid Quadrant Jumps: cols Name Description Units Type Format Null Range Source ------- ------ ------------------------------------- ------- ---- -------- ---- ----- ------ 398-401 Jjp J jump counter -- int I4 -9 0 to 274 datequal/q.backjump.sum 402-405 Hjp H jump counter -- int I4 -9 0 to 274 datequal/q.backjump.sum 406-409 Kjp K jump counter -- int I4 -9 0 to 274 datequal/q.backjump.sum Default Quality Factor Summaries: cols Name Description Units Type Format Null Range Source ------- ------ ------------------------------------- ------- ---- -------- ---- ----- ------ 410-414 DF1 Nightly phot. calibration factor -- r*4 F5.1 -9.9 0.0 to 1.0 computed by SCANSCI 415-419 DF2 Sensitivity factor -- r*4 F5.1 -9.9 0.0 to 1.0 computed by SCANSCI 420-424 DF3 Ave. and max. seeing shape factor -- r*4 F5.1 -9.9 0.0 to 1.0 computed by SCANSCI 425-429 DF4 Untracked seeing *factor* -- r*4 F5.1 -9.9 0.0 to 1.0 computed by SCANSCI 430-434 DF5 Airglow background residual factor -- r*4 F5.1 -9.9 0.0 to 1.0 computed by SCANSCI 435-439 DF6 (placeholder; not used currently) -- r*4 F5.1 -9.9 0.0 to 1.0 computed by SCANSCI 440-444 DF7 Untracked seeing *flag* -- r*4 F5.1 -9.9 0.0 or 1.0 computed by SCANSCI (Notes: For nights run in OPS processing before SCANSCI was updated to include all of these factors, null values are listed for any factors not acutally calculated. DF1 - This is the same as fct1 in SIS qua02. DF2 - This is the same as fct2 in SIS qua02. DF7 - This is the same as fct7 in SIS qua02. ) Actual Quality Factor Summaries: cols Name Description Units Type Format Null Range Source ------- ------ ------------------------------------- ------- ---- -------- ---- ----- ------ 445-449 AF1 Nightly phot. calibration factor -- r*4 F5.1 -9.9 0.0 to 1.0 ~davy/QUA/q{yymmddh}.qua for scans w/Qo>=3* 450-454 AF2 Sensitivity factor -- r*4 F5.1 -9.9 0.0 to 1.0 ~davy/QUA/q{yymmddh}.qua for scans w/Qo>=3* 455-459 AF3 Ave. and max. seeing shape factor -- r*4 F5.1 -9.9 0.0 to 1.0 default to DF3 above 460-464 AF4 Untracked seeing *factor* -- r*4 F5.1 -9.9 0.0 to 1.0 default to DF4 above 465-469 AF5 Airglow background residual factor -- r*4 F5.1 -9.9 0.0 to 1.0 default to DF5 above 470-474 AF6 (placeholder; not used currently) -- r*4 F5.1 -9.9 0.0 to 1.0 default to DF6 above 475-479 AF7 Untracked seeing *flag* -- r*4 F5.1 -9.9 0.0 or 1.0 ~davy/QUA/q{yymmddh}.qua for scans w/Qo>=3* *This applies for older nights not having {yymmddh}.qagrade files. For more recent nights the AF1, AF2, and AF7 values are taken from {yymmddh}.qagrade. (Note: In cases where the quality factor has been overridden, the actual value used to compute the final quality score is given by the AF column. DF factors that have not been changed will have a "-9.9" in the corresponding AF column. Specifically used are -- AF1 - If not null (-9.9), this is the override value for DF1. AF4 - If not null (-9.9), this is the override value for DF4. AF5 - If not null (-9.9), this is the override value for DF5. AF7 - If not null (-9.9), this is the override value for DF7. For example, untracked seeing length downgrades based on Jlen, Hlen, or Klen should be ignored if AF4=1.0. Likewise, downgrades due to the Hcn4 factor should be ignored if AF=5.0. In both cases, by-eye inspection by the QA reviewer has shown that a downgrade is unwarranted.) Quality Override Scores: cols Name Description Units Type Format Null Range Source ------- ------ ------------------------------------- ------- ---- -------- ---- ----- ------ 480-482 O1 Maximum allowable score -- int I3 -9 0 to 10 see Notes 483-485 O2 Mandated score -- int I3 -9 0 to 10 {yymmddh}.qagrade (Notes: These scores are for scans where the final quality score itself is overridden, independent of the individual quality factors. O1 - This is a ceiling score for special-case scans: O1 = 0 for anomalies like bright airplane trails, RA <-------------------filled in by offline analysis slippages, bug fly-bys, quadrant jumps, etc. O1 = 1 for severe image elongation <-------------------calculated by SCANSCI O1 = 2 for untracked seeing (under the old algorithm) <-------------------calculated by SCANSCI O1 = 10 for all other cases <-------------------filled in by offline analysis O2 - This is the score as mandated during the QA review. This includes cases such as those where uniformity in scoring is forced on a sci block. O2 can also be set to zero to fail a scan because of a bug fly-by, bad airplane trail, etc. In this case O1=0 and O2=0 are identical so either can be used. ) Final Quality Scores: cols Name Description Units Type Format Null Range Source ------- ------ ------------------------------------- ------- ---- -------- ---- ----- ------ 486-488 Qc Score computed from default factors -- int I3 -9 0 to 10 computed by SCANSCI** 489-491 Qo Old scan quality score actually assigned -- int I3 -9 0 to 10 ~davy/QAtrans/QAtrans.{yymmddh}** 492-494 Qn New scan quality score -- int I3 -9 0 to 10 offline analysis program from UMass 495-497 Qs Quality score of tile in survey master DB -- int I3 -9 0 to 10 offline analysis program from UMass 498-500 S Flag for Qs -- int I3 -9 0 or 1 offline analysis program from UMass **For production nights having {yymmddh}.qagrade files, Qc will be identical to Qo. (Notes: Qc - computed using the algorithm Qc = QB*fct1*fct2*fct3*fct4*fct5, where QB=10 when dither D=1 and QB=5 when dither D=0. The calculated Qc value can be overridden by either the O1 or O2 overrides above. Qn - field will be filled in by offline analysis programs; initialized to 0 here. Qs - field will be filled in by UMass; initialized to 0 here. In the case of scans covering tiles already covered by higher-quality scans (see S=0 below), the Qs value will be set to that of the highest-quality scan observed for that tile. S - flag denoting whether or not this scan was in the survey master database: 0 = scan not in survey master database 1 = scan in survey master database ) Blank Fields: cols Name Description Units Type Format Null Range Source ------- ------ ------------------------------------- ------- ---- -------- ---- ----- ------ 501-508 Bla0 (blank) -- int I8 0 (unknown) may be used by offline analysis program 509-516 Bla1 (blank) -- int I8 0 (unknown) may be used by offline analysis program 517-524 Bla2 (blank) -- int I8 0 (unknown) may be used by offline analysis program 525-532 Bla3 (blank) -- int I8 0 (unknown) may be used by offline analysis program 533-540 Bla4 (blank) -- int I8 0 (unknown) may be used by offline analysis program 541-548 Bla5 (blank) -- int I8 0 (unknown) may be used by offline analysis program 549-556 Bla6 (blank) -- int I8 0 (unknown) may be used by offline analysis program 557-564 Bla7 (blank) -- int I8 0 (unknown) may be used by offline analysis program 565-572 Bla8 (blank) -- int I8 0 (unknown) may be used by offline analysis program 573-580 Bla9 (blank) -- int I8 0 (unknown) may be used by offline analysis program (Notes: These fields are placeholders and may be used later.) Telemetry Fields: cols Name Description Units Type Format Null Range Source ------- ------ ------------------------------------- ------- ---- -------- ---- ----- ------ 581-587 Focus Focus setting -- int I7 -99999 -30000 to 30000 /home/roc/obslogs/info/sci.info 588-597 sr_UT Universal Time at start of scan hr r*4 F10.6 -9.9 0. to 24. /home/roc/obslogs/info/sci.info 598-607 sr_LST Local Sidereal Time at start of scan hr r*4 F10.6 -9.9 0. to 24. /home/roc/obslogs/info/sci.info 608-617 sr_HA Hour Angle at start of scan hr r*4 F10.6 -9.9 -6. to 6. /home/roc/obslogs/info/sci.info 618-622 ZD Zenith Distance deg r*4 F5.1 -9.9 0. to 90. /home/roc/obslogs/info/sci.info 623-629 Air_M Airmass -- r*4 F7.3 -9.9 1. to 5.0 /home/roc/obslogs/info/sci.info 630-632 RH Relative Humidity % int I3 -9 0 to 99 /home/roc/obslogs/info/sci.info 633-637 Baro Barometric reading in Hg r*4 F5.1 -9.9 25. to 35. /home/roc/obslogs/info/sci.info 638-643 Tel_T Telescope temperature deg C r*4 F6.1 -99.9 -20. to 40. /home/roc/obslogs/info/sci.info 644-649 Rng_T Head ring temperature deg C r*4 F6.1 -99.9 -20. to 40. /home/roc/obslogs/info/sci.info