DB_MAPCOR Point Source Results

DB_MAPCOR Point Source Results


  1. Introduction
  2. MAPCOR, working on one band of one scan at a time, can find bright star artifacts that are limited to the scan in which the star appears, namely persistence and filter and dichroic glints; DB_MAPCOR deals with the artifacts that are not limited to the same scan and thus require a database search. For 2MAPPS version 3, DB_MAPCOR searched for point sources photometrically contaminated by flux from other nearby stars (photometric confusion), artifacts caused by very bright stars (artifact confusion), point sources contaminated by diffraction spikes, and artifacts caused by diffraction spikes. (For more information on the search algorithms, see the  Artifact Identification Algorithms and Parameters page.)

  3. Parent Source Lists
  4. The parent source list was drawn from the working database point source table, selecting sources brighter than 10 mag in at least one band which passed the  catalog generation working point source database criteria. These are, essentially, reliable point sources found in the release scan set, located at least 10 arcsec from the scan edges and not already identified as artifacts by MAPCOR. Since the artifact identification parameters are different for the northern and southern telescopes, the parent list was split into two lists to search each hemisphere separately for artifacts and contamination. Note, though, that many parents were used for both hemispheres because many tiles were observed from both hemispheres; the northern hemisphere list includes all parents with Dec > -14.5°, and the southern hemisphere list includes all parents with Dec < 38.16°. The histograms of the magnitudes of these parent sources are below; they include each apparition of duplicate sources (sources found on more than one scan).

    J Band Magnitudes

    H Band Magnitudes

    Ks Band Magnitudes

    Northern Hemisphere
    Southern Hemisphere


    Because of time constraints, DB_MAPCOR was only run on the parent sources with J, H, or Ks magnitudes <= 5.0. This includes a total of 35720 parents for the northern hemisphere and 56413 for the southern hemisphere, not counting duplicate source apparitions. Since 23882 parents were used in both hemispheres, there are 68249 total distinct parents with some magnitude <= 5.0. However, DB_MAPCOR skips parents without valid detections in at least two bands. (For details, see  Single-Band Parents Skipped.) This removed 18 parents from consideration, 13 for the north and 16 for the south, leaving 35707 parents for the north and 56397 for the south. For reference, it took about three weeks of wall-clock time to run these sets of parents on two 4-processor machines, with about five jobs running on each machine at a time. Of these parents, 39992 caused new artifact flags in the J band, 35008 in the H band, and 49247 in the Ks band.

    For analysis purposes, we are currently running DB_MAPCOR on the parent sources with J, H, or Ks magnitudes between 5.0 and 6.0. There are 69544 of these parents for the north and 102062 for the south, approximately twice the numbers of parents with magnitudes <= 5.0. However, the wall-clock runtime will be approximately the same for both sets, since the fainter parent sources require smaller search areas.

  5. Possible Artifact Flag Values
  6. DB_MAPCOR can update four 3-character artifact flags, but it will never lessen the severity of a flag already set by MAPCOR. Since artifacts already found by MAPCOR were excluded by the  catalog generation working point source database criteria, DB_MAPCOR didn't waste time searching through known artifacts.

    One 3-character flag for each band, called j_prg_flg, h_prg_flg, and k_prg_flg, contains complete artifact flag information for each band in numerical codes. DB_MAPCOR can update these flags with the following values (``?'' means any single character, as in csh wildcards):

    After the [jhk]_prg_flg flags are set by both MAPCOR and DB_MAPCOR, the fourth 3-character flag, cc_flg, combines all the possible artifact and contamination values into a one-character code for each band. To set this flag, the [jhk]_prg_flg and persistence probability values for each band are checked in the order given below until a value is applied. This means that possible flag values further down this list will not be applied if a flag found above it is already set; in other words, the order indicates the flag hierarchy.

    The cc_flg characters for each band can be:

    The capital letters indicate that MAPCOR or DB_MAPCOR determined that the source was an artifact in that particular band; lower case letters indicate that the source is likely real but contaminated by an artifact in that band. Before the DB_MAPCOR processing, cc_flg values found in the catalog generation working point source database would have had only the lower case letters or '0' in all bands because of the selection criteria. DB_MAPCOR could only change a flag from a less-severe value, i. e. one lower in the list, to a value of 'd', 'c', 'D', or 'C'.

  7. Artifact Flag Results
  8. After DB_MAPCOR sets new artifact flag values, another program merges those values with those already found in the working tables so that no information is overwritten unnecessarily. The full lists of new artifact flag values set by DB_MAPCOR and of all of the values found in the catalog generation working point source database after this merge can be found in  this page. Summary tables of the new values set by DB_MAPCOR, affecting 527063 point sources, are below.
     

    Source Counts
    ?_prg_flg J band H band Ks band
    [null] 297351 330329 210808
    001 158981 123775 239367
    002 40654 26608 13554
    050 358 314 681
    051 13 2 10
    052 5 1 5
    060 12149 20231 31500
    061 11179 19692 29050
    062 6373 6111 2088

     
    Source Counts
    cc_flg J band H band Ks band Any band
    C 47032 32720 15647 67167
    D 23328 39923 60550 100935
    c 158994 123777 239377 358038
    d 358 314 681 923

    Summary tables of the post-merge values of all sources in the catalog generation working point source database are below.
     

    Source Counts
    ?_prg_flg J band H band Ks band
    000 419092692 414269338 360151089
    001 104479790 84819073 60506201
    002 40027 26058 12943
    010 3145409 3571776 4431937
    011 1252030 1300302 1586190
    012 456 398 361
    050 154898 650869 810100
    051 542261 1401265 1731334
    052 176 153 255
    060 697 3656 4589
    061 22631 36267 55961
    062 6373 6111 2088
    fil 17817374 37934911 109950984
    upl 7176152 9710789 14486934

     
    Source Counts
    cc_flg J band H band Ks band Any band
    C 47032 32720 15647 67167
    D 23328 39923 60550 100935
    p 2778928 4564728 1804726 6199361
    c 105265545 85999931 63272044 131857094
    d 154814 646291 807257 1148681
    s 3127781 3532471 4404088 6662090
    b 17564 21373 27353 42210

  9. Analysis Results
  10. Analysis of the DB_MAPCOR results in the test fields by Raymond Tam can be found in  this page. The results indicate that some of the adjusted spike lengths in high source density regions were actually a bit too short, causing DB_MAPCOR to miss eight spike artifacts and one source contaminated by a spike in the test fields. On the other hand, 11 sources were flagged as confusion or spike artifacts by DB_MAPCOR that are most likely real sources. For this analysis, sources found around 17 very bright stars in the test field catalog generation DB were examined by eye.
     


    T. Evans - IPAC
    Last Update - 6 Sep 2002