Code

NetCDF thread safety take two#5095

Code

Merged

pp-mo merged 67 commits intoSciTools:mainSciTools/iris:mainfrom trexfeathers:netcdf_segstrexfeathers/iris:netcdf_segsCopy head branch name to clipboardFeb 20, 2023

+1,799-1,179

Commits

Commits on Nov 22, 2022

• Unpin netcdf4.

  trexfeathers

  committed
  6caae04

  Copy full SHA for 6caae04

• Temporarily enable GHA on this branch.

  trexfeathers

  committed
  9dae5d0

  Copy full SHA for 9dae5d0

• Temporarily enable GHA on this branch.

  trexfeathers

  committed
  cdcd0e2

  Copy full SHA for cdcd0e2

• Temporarily enable GHA on this branch.

  trexfeathers

  committed
  1512708

  Copy full SHA for 1512708

• Experiment to disable wheel CI on forks.

  trexfeathers

  committed
  2dc3aff

  Copy full SHA for 2dc3aff

• Disable segfaulting routines.

  trexfeathers

  committed
  c5ab0e4

  Copy full SHA for c5ab0e4

• More temporary changes to get CI passing.

  trexfeathers

  committed
  235e5fa

  Copy full SHA for 235e5fa

• More temporary changes to get CI passing.

  trexfeathers

  committed
  efaab93

  Copy full SHA for efaab93

• Finessed segfault skipping.

  trexfeathers

  committed
  301dbc6

  Copy full SHA for 301dbc6

• Bring in changed from SciTools#5061.

  

  pp-mo

  authored and

  trexfeathers

  committed
  9ece95c

  Copy full SHA for 9ece95c

• Re-instate test_load_laea_grid.

  trexfeathers

  committed
  5103545

  Copy full SHA for 5103545

Commits on Nov 24, 2022

• Adaptations to get the tests passing.

  trexfeathers

  committed
  95f337a

  Copy full SHA for 95f337a

• Use typing.Mapping instead.

  trexfeathers

  committed
  fa82db7

  Copy full SHA for fa82db7

• Get doctests passing.

  trexfeathers

  committed
  b6756d4

  Copy full SHA for b6756d4

• CF only resolve non-url filenames.

  trexfeathers

  committed
  256936c

  Copy full SHA for 256936c

Commits on Nov 25, 2022

• Confirm thread safety fixes.

  trexfeathers

  committed
  cf9ba29

  Copy full SHA for cf9ba29

• Remove dummy assignment.

  trexfeathers

  committed
  aed32c8

  Copy full SHA for aed32c8

• Restored plot_nemo What's New entry.

  trexfeathers

  committed
  835c02d

  Copy full SHA for 835c02d

• _add_aux_factories temporarily release global lock.

  trexfeathers

  committed
  4e2b590

  Copy full SHA for 4e2b590

• Remove per-file locking.

  trexfeathers

  committed
  a8819b4

  Copy full SHA for a8819b4

• Remove remaining test workarounds.

  trexfeathers

  committed
  8207d6d

  Copy full SHA for 8207d6d

• Remove remaining comments.

  trexfeathers

  committed
  c0faa6f

  Copy full SHA for c0faa6f

• Correct use of CFReader context manager.

  trexfeathers

  committed
  8010b2f

  Copy full SHA for 8010b2f

Commits on Nov 30, 2022

• Refactor for easier future maintenance.

  trexfeathers

  committed
  2fb274f

  Copy full SHA for 2fb274f

• Rename netcdf _thread_safe, add header.

  trexfeathers

  committed
  3aaaa1a

  Copy full SHA for 3aaaa1a

Commits on Dec 1, 2022

• Full use of ThreadSafeAggregators.

  trexfeathers

  committed
  02d9a8c

  Copy full SHA for 02d9a8c

• Full use of ThreadSafeAggregators.

  trexfeathers

  committed
  b301120

  Copy full SHA for b301120

• Remove remaining imports of NetCDF4.

  trexfeathers

  committed
  6b7c15c

  Copy full SHA for 6b7c15c

Commits on Dec 2, 2022

• Test to ensure netCDF4 is via _thread_safe module.

  trexfeathers

  committed
  ab733a7

  Copy full SHA for ab733a7

• More refined netcdf._thread_safe classes.

  trexfeathers

  committed
  d066d39

  Copy full SHA for d066d39

Commits on Dec 6, 2022

• _thread_safe docstrings.

  trexfeathers

  committed
  cea0e22

  Copy full SHA for cea0e22

• Restore original NetCDF code where possible.

  trexfeathers

  committed
  5ed0ebb

  Copy full SHA for 5ed0ebb

• Revert changes to 2.3.rst.

  trexfeathers

  committed
  5b3e609

  Copy full SHA for 5b3e609

• Update lockfiles.

  trexfeathers

  committed
  2edb3ce

  Copy full SHA for 2edb3ce

• Merge remote-tracking branch 'upstream/main' into netcdf_segs

  trexfeathers

  committed
  c36c5f5

  Copy full SHA for c36c5f5

Commits on Dec 8, 2022

• Additions to _thread_safe.py

  trexfeathers

  committed
  3059666

  Copy full SHA for 3059666

• Remove temporary CI shims.

  trexfeathers

  committed
  97d5891

  Copy full SHA for 97d5891

Commits on Dec 9, 2022

• New locking stategy for NetCDFDataProxy.

  trexfeathers

  committed
  01be381

  Copy full SHA for 01be381

Commits on Dec 12, 2022

• NetCDFDataProxy simpler use of netCDF4 lock.

  trexfeathers

  committed
  2c972f3

  Copy full SHA for 2c972f3

• Update lock files.

  trexfeathers

  committed
  cb49765

  Copy full SHA for cb49765

• Merge remote-tracking branch 'upstream/main' into netcdf_segs

  trexfeathers

  committed
  140a6c8

  Copy full SHA for 140a6c8

• Go back to using a Threading Lock.

  trexfeathers

  committed
  b2cc5ad

  Copy full SHA for b2cc5ad

Commits on Jan 9, 2023

• Remove superfluous pass commands in test_cf.py.

  trexfeathers

  committed
  128ebaa

  Copy full SHA for 128ebaa

• Rename _thread_safe to _thread_safe_nc.

  trexfeathers

  committed
  8d72578

  Copy full SHA for 8d72578

• Rename thread safe classes to be 'Wrappers'.

  trexfeathers

  committed
  68588b5

  Copy full SHA for 68588b5

• Better contained getattr and setattr pattern.

  trexfeathers

  committed
  5d351db

  Copy full SHA for 5d351db

• Explicitly name netCDF4 module in _thread_safe_nc docstring.

  trexfeathers

  committed
  d53d194

  Copy full SHA for d53d194

• Better docstring for _ThreadSafeWrapper.

  trexfeathers

  committed
  d9bce6b

  Copy full SHA for d9bce6b

• Better comment about THREAD_SAFE_FLAG.

  trexfeathers

  committed
  ed17c83

  Copy full SHA for ed17c83

• list() wrapping within _GLOBAL_NETCDF4_LOCK, to account for generators.

  trexfeathers

  committed
  9b23b30

  Copy full SHA for 9b23b30

• Merge branch 'main' into netcdf_segs

  trexfeathers

  authored
  8faa2ea

  Copy full SHA for 8faa2ea

• More accurate thread_safe docstrings in netcdf.saver.

  trexfeathers

  committed
  3a76fc2

  Copy full SHA for 3a76fc2

• Merge branch 'netcdf_segs' of github.com:trexfeathers/iris into netcdf_segs

  trexfeathers

  committed
  3fb9679

  Copy full SHA for 3fb9679

Commits on Feb 10, 2023

• Merge remote-tracking branch 'upstream/main' into netcdf_segs

  trexfeathers

  committed
  af1aa05

  Copy full SHA for af1aa05

• Split netcdf integration tests into multiple modules.

  trexfeathers

  committed
  22f55e3

  Copy full SHA for 22f55e3

Commits on Feb 13, 2023

• Tests for non-thread-safe NetCDF behaviour.

  trexfeathers

  committed
  9d75765

  Copy full SHA for 9d75765

Commits on Feb 14, 2023

• Docstring accuracy.

  trexfeathers

  committed
  c86881b

  Copy full SHA for c86881b

• Correct use of dask config set (context manager).

  trexfeathers

  committed
  5a53d36

  Copy full SHA for 5a53d36

• Update dependencies.

  trexfeathers

  committed
  d95f3f8

  Copy full SHA for d95f3f8

Commits on Feb 15, 2023

• Review - don't need the first-class import of iris.tests.

  trexfeathers

  committed
  f6eb131

  Copy full SHA for f6eb131

• Better name for the loading test.

  trexfeathers

  committed
  2df6278

  Copy full SHA for 2df6278

• Better selection of data to load.

  trexfeathers

  committed
  2095658

  Copy full SHA for 2095658

• What's New entry.

  trexfeathers

  committed
  e03659a

  Copy full SHA for e03659a

• Improve tests.

  trexfeathers

  committed
  93ac4c4

  Copy full SHA for 93ac4c4

Commits on Feb 20, 2023

• Merge remote-tracking branch 'upstream/main' into netcdf_segs

  trexfeathers

  committed
  3ffe3dc

  Copy full SHA for 3ffe3dc

• Update lock files.

  trexfeathers

  committed
  94da55c

  Copy full SHA for 94da55c

• Increase chunking on test_save.

  trexfeathers

  committed
  a6b893c

  Copy full SHA for a6b893c