Differences
This shows you the differences between two versions of the page.
projects:kids:atlas [2015/04/16 10:38] jdejong |
projects:kids:atlas [2016/06/17 14:37] (current) gverdoes |
||
---|---|---|---|
Line 7: | Line 7: | ||
== Status (last update 14 Apr 2015) | == Status (last update 14 Apr 2015) | ||
+ | |||
+ | See [[https://docs.google.com/presentation/d/1_LWxm17k6fAFb2w3nbjMmksYNXCNXp3Ed-yVlmD3cF8/edit?usp=sharing | ATLAS slides]] | ||
We are producing u,g,r,i (not z!) ATLAS coadds re-using/adapting the KiDS pipeline. | We are producing u,g,r,i (not z!) ATLAS coadds re-using/adapting the KiDS pipeline. | ||
+ | |||
+ | == Gaps in coadded data | ||
+ | |||
+ | Gaps between CCDs; in the release notes of ATLAS {{:projects:kids:atlas_dr1.pdf|}}: is written that in data observed before November 2011 the vertical gaps between the CCDs are not always filled in well because of the way the observations were executed. I suppose this is what you are seeing. | ||
+ | |||
+ | == South-West secondary star diagnosis | ||
+ | |||
+ | Matt Owers notes: | ||
+ | - The issue I noted earlier with the small secondary star ~2" to the | ||
+ | southwest of brighter stars only appears in one g-band image. It is odd | ||
+ | that the secondary star is not the same brightness as the standard and I | ||
+ | can't really think what might cause this. | ||
+ | |||
+ | [[http://quality.astro-wise.org/QualityWISE?object_str=CoaddedRegriddedFrame&object_id=1360ba421d1f42f1e053c016a9c3851e&project=ATLAS | example case, g-band ATLAS data with rawfitsdata with DATE-OBS=set([datetime.datetime(2011, 9, 25, 1, 9, 10), datetime.datetime(2011, 9, 25, 1, 7, 35)]) | ||
+ | ]]: | ||
+ | |||
+ | |||
+ | **Diagnosis**: poor image quality in raw science exposures. 3 Figures below show a zoom in on an area in the example case: | ||
+ | |||
+ | {{:projects:kids:coaddatlas.png?800|Coadded calibrated image}} | ||
+ | {{:projects:kids:rawfits1.png?800|RawFitsData exposure 1}} | ||
+ | {{:projects:kids:rawfits2.png?800|RawFitsData, exposure 2}} | ||
+ | |||
+ | The RawFitsData with the "secondary star" has DATE-OBS=2011-09-25T01:09:10.066. | ||
+ | |||
+ | **DETECTION**: most direct on RawScience. Probably using PSF anisotropy (high ellipticity with fixed PA) information. In absence of PSF anisotropy information of RawScienceFrames on can look at it for a [[http://quality.astro-wise.org/QualityWISE?object_str=ReducedScienceFrame&object_id=12D50F3E66484BB3E053C016A9C3FF8A&project=ATLAS&progenitors=1#progenitors | ReducedScienceFrame with | ||
+ | DATE-OBS=2011-09-25T01:09:10.066]]. | ||
+ | |||
+ | {{http://ds.astro.rug.astro-wise.org:8000/QC-JMCFARLAND-OMEGACAM-------OCAM_g_SDSS-ESO_CCD_%2396---PSF_Anisotropy-ReducedScienceFrame-57115.6735075-04b68968a6ed53483c0909d1c30538bcb0d3753e.png?800}} | ||
+ | |||
+ | **ASTROMETRY NOTE**: this appears as one reason for bad astrometric residuals. See the correlated global astrometric parameters in the [[http://quality.astro-wise.org/QualityWISE?object_str=CoaddedRegriddedFrame&object_id=1360ba421d1f42f1e053c016a9c3851e&project=ATLAS | example case, g-band ATLAS data with rawfitsdata with DATE-OBS=set([datetime.datetime(2011, 9, 25, 1, 9, 10), datetime.datetime(2011, 9, 25, 1, 7, 35)])]]. | ||
== ATLAS tiles mapping onto Astro-WISE classes | == ATLAS tiles mapping onto Astro-WISE classes | ||
+ | |||
+ | (work in progress by Gijs) | ||
+ | |||
+ | Goal: define units of data for ATLAS in the same way as for KiDS. This ensures that whatever script/approach we develop that works on one will work for the other. | ||
First the ATLAS observing strategy: | First the ATLAS observing strategy: | ||
Line 20: | Line 57: | ||
* Observations before 2011-10-31: more a mess. We are considering to clean it by creating manually same mapping as >2011-10-31 | * Observations before 2011-10-31: more a mess. We are considering to clean it by creating manually same mapping as >2011-10-31 | ||
+ | KiDS survey operations handle on units of data: | ||
+ | * survey tile: data from all bands with a tile as defined by the survey. Example is the handling of multi-band productions (mult-band catalogs) and analysis (stellar locus, QSO/galaxy selection in color-color space) | ||
+ | * ObservingBlock: all exposures that go into data from a single band. Example is the creation of coadded images and source extraction of those. | ||
+ | * Template? | ||
+ | * Exposure: a single exposure. | ||
+ | |||
+ | For KiDS the mapping from survey tile to observing blocks to templates and exposures is straightforward: | ||
+ | * survey tile->observing blocks: the tilename can be inferred from the observingblock name | ||
+ | * observingblock->exposures: all exposures have as observingblock dependency the observing block. NB: there exist no additional exposures with that observingblock as dependency. | ||
+ | |||
+ | For ATLAS>2011-10-31 | ||
+ | * survey tile -> observing blocks: the tilename can be inferred from the observingblock name | ||
+ | * observingblock->exposures: all exposures have as observingblock dependency the observing block. NB: there exist no additional exposures with that observingblock as dependency. | ||
== Validation set: tile overlapping with SDSS | == Validation set: tile overlapping with SDSS | ||
Line 116: | Line 166: | ||
== Coadd QC | == Coadd QC | ||
- | Report 2015-04-14: QC of 226 ATLAS coadds in SAMI cluster regions | + | Report 2015-04-16: QC of 207 ATLAS coadds in SAMI cluster regions |
^ QC check ^ Nr OK ^ Nr NOK ^ | ^ QC check ^ Nr OK ^ Nr NOK ^ | ||
- | | Cross-talk | 221 | 0 | | + | | Cross-talk | 207 | 0 | |
- | | Bg subtr. | 220 | 1 | | + | | Bg subtr. | 206 | 1 | |
- | | Calibrations | 221 | 0 | | + | | Calibrations | 207 | 0 | |
- | | Astrom | 176 | 45 | | + | | Astrom | 162 | 45 | |
- | | Photom | 221 | 0 | | + | | Photom | 207 | 0 | |
- | | PSF difference | 207 | 14 | | + | | PSF difference | 196 | 11 | |
- | ^ Overal verdict ^ 167 ^ 54 ^ | + | ^ Overal verdict ^ 156 ^ 51 ^ |
- | + | ||
- | 7 pointings have multiple coadds: | + | |
- | 4 x 2 coadds | + | |
- | 1 x 3 coadds | + | |
- | 1 x 4 coadds | + | |
- | 1 x 6 coadds | + | |
**Astrometry statistics** | **Astrometry statistics** | ||
Line 138: | Line 182: | ||
Data points: blue = u; green = g; red = r; magenta = i | Data points: blue = u; green = g; red = r; magenta = i | ||
- | Dashed lines: QC limits used for KiDS coadds | + | Dashed lines: QC limits adopted in qcCoadd_ATLAS.py |
**PSF sizes and size variations** | **PSF sizes and size variations** | ||
Line 150: | Line 194: | ||
[[http://dbview.astro-wise.org/DbView?project=ATLAS&set_cookie=&QSort=&QDesc=descending&2ndQSort=&2ndQDesc=descending&numrows=rownum&fcontext_project_only=on&show_expanded=no&Exportselect=NoDownload&class_str=CoaddedRegriddedFrame&mode=table_res&depth=1&python_dict=%2528dp0%250AS%2527query%2527%250Ap1%250A%2528dp2%250AsS%2527expanded%2527%250Ap3%250A%2528dp4%250AS%2527CoaddedRegriddedFrame%2527%250Ap5%250A%2528lp6%250AS%2527open%2527%250Ap7%250AaS%2527root%2527%250Ap8%250Aag5%250AasS%2527CoaddedRegriddedFrame.instrument%2527%250Ap9%250A%2528lp10%250AS%2527prefilled%2527%250Ap11%250AaS%2527link_property%2527%250Ap12%250AaS%2527Instrument%2527%250Ap13%250AasS%2527CoaddedRegriddedFrame.filter%2527%250Ap14%250A%2528lp15%250Ag11%250AaS%2527link_property%2527%250Ap16%250AaS%2527Filter%2527%250Ap17%250AassS%2527derived%2527%250Ap18%250A%2528dp19%250As.&expanded_leaf=&expanded_leaf_type=&expanded_leaf_class=&derived_leaf=&node_state=&CoaddedRegriddedFrame.expanded=open&CoaddedRegriddedFrame.instrument.expanded=prefilled&CoaddedRegriddedFrame.filter.expanded=prefilled&CoaddedRegriddedFrame.is_valid.op=%3E&CoaddedRegriddedFrame.is_valid=0&CoaddedRegriddedFrame.instrument.name=OMEGACAM&CoaddedRegriddedFrame.instrument.name.op=%3D&CoaddedRegriddedFrame.regridded_frames.base=RegriddedFrame | coadds]] | [[http://dbview.astro-wise.org/DbView?project=ATLAS&set_cookie=&QSort=&QDesc=descending&2ndQSort=&2ndQDesc=descending&numrows=rownum&fcontext_project_only=on&show_expanded=no&Exportselect=NoDownload&class_str=CoaddedRegriddedFrame&mode=table_res&depth=1&python_dict=%2528dp0%250AS%2527query%2527%250Ap1%250A%2528dp2%250AsS%2527expanded%2527%250Ap3%250A%2528dp4%250AS%2527CoaddedRegriddedFrame%2527%250Ap5%250A%2528lp6%250AS%2527open%2527%250Ap7%250AaS%2527root%2527%250Ap8%250Aag5%250AasS%2527CoaddedRegriddedFrame.instrument%2527%250Ap9%250A%2528lp10%250AS%2527prefilled%2527%250Ap11%250AaS%2527link_property%2527%250Ap12%250AaS%2527Instrument%2527%250Ap13%250AasS%2527CoaddedRegriddedFrame.filter%2527%250Ap14%250A%2528lp15%250Ag11%250AaS%2527link_property%2527%250Ap16%250AaS%2527Filter%2527%250Ap17%250AassS%2527derived%2527%250Ap18%250A%2528dp19%250As.&expanded_leaf=&expanded_leaf_type=&expanded_leaf_class=&derived_leaf=&node_state=&CoaddedRegriddedFrame.expanded=open&CoaddedRegriddedFrame.instrument.expanded=prefilled&CoaddedRegriddedFrame.filter.expanded=prefilled&CoaddedRegriddedFrame.is_valid.op=%3E&CoaddedRegriddedFrame.is_valid=0&CoaddedRegriddedFrame.instrument.name=OMEGACAM&CoaddedRegriddedFrame.instrument.name.op=%3D&CoaddedRegriddedFrame.regridded_frames.base=RegriddedFrame | coadds]] | ||
+ | |||
+ | {{:projects:kids:atlascoaddsinkids.png?200|}} | ||
== VST-ATLAS pipeline description | == VST-ATLAS pipeline description |