Execution Block ID uid://A001/X15a0/Xca Sgr_A_st_h_03_TM1 #142

keflavich · 2022-05-18T16:57:49Z

Product Links:

Reprocessed Product Links:

d-l-walker · 2022-06-17T16:04:59Z

The actual data and final images look good here, but there are a few areas in the calibration that I feel should have been addressed during QA2. I've listed some of the more obvious ones below. I think they're relatively minor issues in the end, but should probably still be flagged out. It'd be great if someone else could check through this to get another opinion(s).

Stage 7 (Tsys): Some examples of contamination in the Tsys data in the science SPWs (spikes that coincide with the frequency range of the science SPWs which are shown as coloured bars at the bottom). This is almost always present in our data, but is usually flagged out during QA2.

Stage 9 (WVR): DA42 seems to have some phase jumps in the first scan.

Stage 19 (applycal): Absorption and phase spread for phase calibrator J1744. This is a persistent issue for this calibrator and is usually flagged before delivery.

d-l-walker · 2022-07-27T11:36:03Z

As mentioned earlier, the calibration here could be improved by adding a few more flags. However, the final calibration looks reasonable, and the images look good. I think we can safely leave this for now, and consider re-running the PL with additional flags at a later date. I will take responsibility for that.

Other than this, the only outstanding issues relate to the size mitigation:

SPW 33 was dropped
All SPWs binned x2 (see Tracking cases of channel binning due to size mitigation in imaging pipeline #179)

Once these are resolved, this should be good to go.

d-l-walker · 2022-07-27T11:48:09Z

Latest PL run (Pipeline Run 20220622T040354) failed at cube imaging stage, with errors:

Error! Sgr_A_star/TARGET/spw25 clean error: Error in running Major Cycle : One or more of the cube section failed in de/gridding. (Same error for all SPWs.)
No image details found despite existing imaging targets. Please check for cleaning errors.

d-l-walker · 2022-09-07T13:04:38Z

SPW 33 was recleaned on HPG, but it diverged. I'll have a go at re-doing this with a higher cyclefactor.

d-l-walker · 2022-11-16T11:37:18Z

@keflavich the cleaning parameters have been updated in #299. Once this PR has been merged, the cleaning for this region should be executed again to undo cube size mitigation and avoid divergence in SPW 33.

Co-authored-by: g25238dw <[email protected]>

keflavich · 2022-11-16T15:19:41Z

Reimaging has been started. spw35 finished waaaay too fast...

keflavich · 2022-11-16T15:25:37Z

Very odd. spw35 reported success even though it was an extreme failure - this is a constant annoyance with CASA, since it doesn't use python's traceback system properly.

The failure was:

2022-11-16 14:18:08     INFO    task_tclean::SynthesisDeconvolver::setupDeconvolution   Set Deconvolution Options for [/blue/adamginsburg/adamginsburg/ACES/workdir/h_spw35_cube_TM1_A001_X15a0_Xca/uid___A001_X15a0_Xca.s38_0.Sgr_A_star_sci.spw35.cube.I.iter1] : hogbom
2022-11-16 14:18:08     WARN    tclean::::casa  Memory available 65536000 kB is very close to amount of required memory 291070433 kB
2022-11-16 14:18:08     INFO    task_tclean::SynthesisImager::executeMajorCycle         ----------------------------------------------------------- Run Major Cycle 1 -------------------------------------
2022-11-16 14:18:09     INFO    task_tclean::SynthesisImagerVi2::nSubCubeFitInMemory    Required memory: 1998 GB. Available mem.: 62.5 GB (rc, mem. fraction: 80%, memory: 62.5) => Subcubes: 32. Processes on node: 1.
2022-11-16 14:18:09     SEVERE  tclean::::casa  Task tclean raised an exception of class RuntimeError with the following message: Error in running Major Cycle : Cannot open existing image : /blue/adamginsburg/adamginsburg/ACES/workdir/h_spw35_cube_TM1_A001_X15a0_Xca/uid___A001_X15a0_Xca.s38_0.Sgr_A_star_sci.spw35.cube.I.iter1.model : Error in opening Image : /blue/adamginsburg/adamginsburg/ACES/workdir/h_spw35_cube_TM1_A001_X15a0_Xca/uid___A001_X15a0_Xca.s38_0.Sgr_A_star_sci.spw35.cube.I.iter1.model
2022-11-16 14:18:09     INFO    tclean::::casa  Task tclean complete. Start time: 2022-11-16 09:18:03.543897 End time: 2022-11-16 09:18:08.980429
2022-11-16 14:18:09     INFO    tclean::::casa  ##### End Task: tclean               #####

I've never seen this before - the error message doesn't tell us clearly what's going on, but I suspect there was a filesystem issue of some sort? This is particularly scary, because it did end up creating entirely useless (corrupt) .image files

d-l-walker · 2023-03-15T10:45:13Z

All cubes have been imaged at full spectral resolution, and SPW 33 doesn't seem to have diverged this time. Marking this one as done. (Though note that we still have the calibration issues that we're investigating more generally ...)

nbudaiev · 2024-02-28T18:13:15Z

QA - Line contamination in continuum images from high/low frequencies

Looks okay, maybe slight contamination in spw25_27.

nbudaiev · 2024-04-03T04:46:08Z

QA - Line contamination in continuum images from high/low frequencies (compared againts v1.1)

Looks great.

keflavich added EB Execution Block TM1 labels May 18, 2022

keflavich added the Delivered label Jun 16, 2022

nbudaiev mentioned this issue Jul 2, 2022

Execution Block ID uid://A001/X15b4/X41 Sgr_A_st_m_03_TM1_updated #118

Open

15 tasks

mpound mentioned this issue Jul 6, 2022

Execution Block ID uid://A001/X15a0/X18a Sgr_A_st_an_03_TM1 #133

Open

15 tasks

keflavich assigned d-l-walker Jul 20, 2022

d-l-walker mentioned this issue Jul 21, 2022

Tracking of potential calibration problems #178

Open

d-l-walker added Needs Reimaging: Spectral Resolution size mitig Needs to be reimaged with full spectral resolution Needs Reimaging: Missing SPW size mitigation Needs to be reimaged without size mitigation labels Jul 27, 2022

d-l-walker mentioned this issue Jul 27, 2022

Tracking cases of channel binning due to size mitigation in imaging pipeline #179

Open

17 tasks

d-l-walker added the Minor calibration issues Minor cal problems to be fixed at a later date label Jul 27, 2022

d-l-walker added the Needs Reimaging: Divergence Needs reimaging b/c of divergence label Sep 7, 2022

d-l-walker pushed a commit to d-l-walker/reduction_ACES that referenced this issue Nov 16, 2022

Update chan params for region h ACES-CMZ#142

4159e3d

d-l-walker mentioned this issue Nov 16, 2022

Update chan params for region h #142 #299

Merged

keflavich pushed a commit that referenced this issue Nov 16, 2022

Update chan params for region h #142 (#299)

91f20d4

Co-authored-by: g25238dw <[email protected]>

keflavich added the NeedsImagingQAAfterReimaging Has been reimaged, but noone has looked at the results yet. Are they better? label Feb 15, 2023

eacmills mentioned this issue Mar 23, 2023

Mapping issues to observing fields #326

Closed

pyhsiehATalma mentioned this issue Jan 31, 2024

Array combination for CS(2-1) (12m + 7m + TP) #339

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Execution Block ID uid://A001/X15a0/Xca Sgr_A_st_h_03_TM1 #142

Execution Block ID uid://A001/X15a0/Xca Sgr_A_st_h_03_TM1 #142

keflavich commented May 18, 2022 •

edited

Loading

d-l-walker commented Jun 17, 2022

d-l-walker commented Jul 27, 2022

d-l-walker commented Jul 27, 2022 •

edited

Loading

d-l-walker commented Sep 7, 2022 •

edited

Loading

d-l-walker commented Nov 16, 2022

keflavich commented Nov 16, 2022

keflavich commented Nov 16, 2022

d-l-walker commented Mar 15, 2023 •

edited

Loading

nbudaiev commented Feb 28, 2024 •

edited

Loading

nbudaiev commented Apr 3, 2024

Execution Block ID uid://A001/X15a0/Xca Sgr_A_st_h_03_TM1 #142

Execution Block ID uid://A001/X15a0/Xca Sgr_A_st_h_03_TM1 #142

Comments

keflavich commented May 18, 2022 • edited Loading

Product Links:

Reprocessed Product Links:

d-l-walker commented Jun 17, 2022

Stage 7 (Tsys): Some examples of contamination in the Tsys data in the science SPWs (spikes that coincide with the frequency range of the science SPWs which are shown as coloured bars at the bottom). This is almost always present in our data, but is usually flagged out during QA2.

Stage 9 (WVR): DA42 seems to have some phase jumps in the first scan.

Stage 19 (applycal): Absorption and phase spread for phase calibrator J1744. This is a persistent issue for this calibrator and is usually flagged before delivery.

d-l-walker commented Jul 27, 2022

d-l-walker commented Jul 27, 2022 • edited Loading

d-l-walker commented Sep 7, 2022 • edited Loading

d-l-walker commented Nov 16, 2022

keflavich commented Nov 16, 2022

keflavich commented Nov 16, 2022

d-l-walker commented Mar 15, 2023 • edited Loading

nbudaiev commented Feb 28, 2024 • edited Loading

nbudaiev commented Apr 3, 2024

keflavich commented May 18, 2022 •

edited

Loading

d-l-walker commented Jul 27, 2022 •

edited

Loading

d-l-walker commented Sep 7, 2022 •

edited

Loading

d-l-walker commented Mar 15, 2023 •

edited

Loading

nbudaiev commented Feb 28, 2024 •

edited

Loading