update branch #1
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
I recommend to remove the arguments args=(self.geocode_list, self.geocode_bbox) since it passes the arguments on the runGeocode.py of the RtcProc which prevents geocoding of the sigma nought product generated from the rtcApp.py. This could be added later if someone would incorporate the geocode_list and geocode_bbox on the runGeocode.py later.
…n to allow arbitrary window size (used to be limited by the 1024 max cuda threads)
… cluster head node without cuda drivers
following PEP008
+ support full resolution geometry files without ".full" in the filename, such as provided by stripmapStack + add --fix-xml option to update the image file path in the xml file, so that IML.loadImage is not called all the time, which could lead to file access issue when multiple processes use the same SLC file
… website (#273) * Changes to fetchOrbit.py to download orbit files in the new ESA website I've made changes to the fetchOrbit.py to download the files on the https://scihub.copernicus.eu/gnss/#/home. I've used the generic credentials to query and download the orbit files. * Update fetchOrbit.py * Make output path generic I've used os.path.join on line no. 165 to make it more generic. * Set the verify option to true I've set the verify option to True to remove the warning regarding "Unverified HTTPS request". * Changes to the download link of the fetchOrbit.py The download link before uses the href link on the XML of the website. It was properly working right until yesterday when it didn't work properly. Instead I've edited the script to be consistent instead with the download link on the scihub copernicus GNSS website. I've tested it and it worked properly. * Update fetchOrbit.py
I've made some changes to fetchOrbit.py due to changes made by ESA based on the issue presented in #273 (comment).
Changes to line 155 of fetchOrbit.py
Co-authored-by: Ryan Burns <[email protected]>
cuda Scons fix: remove unnecessary -lcuda which prevents compiling on…
Keeps the larger size from previous commit, but sets `delay=True` in `RotatingFileHandler` https://docs.python.org/3/library/logging.handlers.html#logging.handlers.RotatingFileHandler Arguments are: `RotatingFileHandler(filename, mode='a', maxBytes=0, backupCount=0, encoding=None, delay=False, errors=None)`
logging.conf: avoid empty file creation
We can run topsApp up through the preprocess step without needing any data. This will at least verify that the config is parsed properly.
Swap lat/lon for proj6 and gdal3.
I'm proposing a fix to create_cmds.py since I found a minor bug in line 165 which doesn't remove the excluded dates during image stacking. Instead line 165 removes dates based on the dates not included from the dates to be included parameter on the alosStack.xml. The image folder contains the ALOS-2 images with dates 191005, 191019, 191102, 191214, 191228. I've tested the changes and it worked properly. Co-authored-by: Ryan Burns <[email protected]>
Remove use of deprecated XML ElementTree getchildren method
cuDenseOffsets.prep*Geom*: supp. full-reso file w/o .full in the name
Changed 'is' to '==' to the SentinelWrapper.py to remove warning
…n to allow arbitrary window size (used to be limited by the 1024 max cuda threads)
Bump bundled autoRIFT to 1.4.0
PyCuAmpcor: fix scons script
+ fix a bug of location shift in the input of prepGeometry() + add return of geomDict in estimateOffsetField() to support re-run for geometry only without --redo in cmd + move the redo check of cuDenseOffsets.py back the previous location, which is right before the actually running, in order to use the previous setup parameter code for geometry preparation only without re-run offset when it already exists. + remove size checking to be consistent with the latest version from Lijun with support of large win size
updated README with new hidden SCONS file that may need to be deleted
stripmapStack.createWaterMask: skip re-dload if wbd file exists
cuDenseOffsets: bugfix in prepGeometry()
* Update CMakeLists.txt
Print that restituted or precise orbits already exists
* UAVSAR_Stack: bugfix for line/sample num and dopplerFile path + UAVSAR_Stack: use segment index while setting the number of lines / samples + UAVSAR_Stack: use self.dopplerFile if it exists otherwise use the path from *.ann file, to support unpackFrame_UAVSAR.py when dop file is not in the current directory + unpackFrame_UAVSAR: rename variables and comments to improve code readability * use getattr() instead of hasattr()
* ionosphere correction for topsStack * Update README.md * Update Alos2ProcPublic.py * Update Stack.py Currently the script writes the `invertIon.py` command pointing to 'ion' and writing to 'ion_dates'. However we need the absolute paths in order to find the 'ion' directory from within the run_files directory (similar to how the `computeIon.py` function is written at l.1488) * Add files via upload * Add files via upload * Add files via upload * Add files via upload * Add files via upload Co-authored-by: Oliver Stephenson <[email protected]>
…f2005_sub.f to compile with new gfortran (#435) * upgraded syntax of ALOS_pre_process/readOrbitPulse.f to compile with new gfortran * updated subroutines in /ISSI/src/igrf2005_sub.f to be consistent
Switch CI base images to ubuntu 20.04
* topsApp.xml: add downsample_snaphu * stackSentinel: bugfix if --bbox not specified in cmd * stack*/unwrap: print time used msg + print out the time used message using time.time() + remove unused module imports + indentation adjustment * cuDenseOffsets: add --fix-image-vrt * fixImageXml: support multiple files w/ wildcards
* stackSentinel: add compute arg group and simplify main() + createParser(): add compute sub group for more organized print out msg + main(): - remove the unsed inps.workflow value checking, as it's covered in the argparse - move the update stack date list checking insidie selectNeighborPairs() * topsStack/mergeBursts: bugfix for float outY/XSize and gdal + mergeBursts.py: bugfix for the gdal call when outY/XSize is not integer by - set width/height to integer - add srcWin argument + mergeBursts.py: repeat gdal.Translate call as a workaround solution to the following gdal issue: - ERROR 1: Input and output dataset sizes or band counts do not match in GDALDatasetCopyWholeRaster() - the issue happens to version 3.3.3 and 3.4, but not in 2.3 + unwrap: bugfix for intendation inconsistency + invertIon: print out num of pairs/dates + stackSentinel: - sort orbit date for downloading - add missing stackReferenceDate arg to selectNeighborPairs() for update mode + README: add link to stack processor readme for quick navigation. * bugfix by removing existing *.hdr files + remove existing *.hdr files, to avoid gdal error, instead of repeat the gdal func call + replace the gdal_translate cmd call with gdal.Translate() in python. + add progress_cb() from stack overflow to printout progress bar in gdal.Translate() call
Previously if the directory of the downloaded files had an underscore the date would incorrectly parsed.
Tutorial fix to avoid confusion for alos2App
Fix Date Parsing Bug
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.