From 91f65fe32e0f91c09c78829e0c7ad1f628bcffb1 Mon Sep 17 00:00:00 2001 From: Isan Rivkin Date: Mon, 27 Nov 2023 19:16:25 +0200 Subject: [PATCH 1/3] update docs --- docs/howto/import.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/howto/import.md b/docs/howto/import.md index 5093dc67170..4bc0081cfbc 100644 --- a/docs/howto/import.md +++ b/docs/howto/import.md @@ -73,7 +73,7 @@ lakectl import \ 1. The import duration depends on the amount of imported objects, but will roughly be a few thousand objects per second. 1. For security reasons, if you are using lakeFS on top of your local disk (`blockstore.type=local`), you need to enable the import feature explicitly. To do so, set the `blockstore.local.import_enabled` to `true` and specify the allowed import paths in `blockstore.local.allowed_external_prefixes` (see [configuration reference]({% link reference/configuration.md %})). - Presently, local import is allowed only for directories, and not single objects. + When using lakectl or the lakeFS UI, you can currently import only directories locally. If you need to import a single file, use the [HTTP API](https://docs.lakefs.io/reference/api.html#/import/importStart) or API Clients with `type=object`` in the request body. 1. Making changes to data in the original bucket will not be reflected in lakeFS, and may cause inconsistencies. ## Examples From ed1a66cf2f3d1301149e9a7886370ebf60827d10 Mon Sep 17 00:00:00 2001 From: Isan Rivkin Date: Mon, 27 Nov 2023 19:23:28 +0200 Subject: [PATCH 2/3] remove --- docs/howto/import.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/howto/import.md b/docs/howto/import.md index 4bc0081cfbc..08fd4e70763 100644 --- a/docs/howto/import.md +++ b/docs/howto/import.md @@ -73,7 +73,7 @@ lakectl import \ 1. The import duration depends on the amount of imported objects, but will roughly be a few thousand objects per second. 1. For security reasons, if you are using lakeFS on top of your local disk (`blockstore.type=local`), you need to enable the import feature explicitly. To do so, set the `blockstore.local.import_enabled` to `true` and specify the allowed import paths in `blockstore.local.allowed_external_prefixes` (see [configuration reference]({% link reference/configuration.md %})). - When using lakectl or the lakeFS UI, you can currently import only directories locally. If you need to import a single file, use the [HTTP API](https://docs.lakefs.io/reference/api.html#/import/importStart) or API Clients with `type=object`` in the request body. + When using lakectl or the lakeFS UI, you can currently import only directories locally. If you need to import a single file, use the [HTTP API](https://docs.lakefs.io/reference/api.html#/import/importStart) or API Clients with `type=object` in the request body. 1. Making changes to data in the original bucket will not be reflected in lakeFS, and may cause inconsistencies. ## Examples From 792e52167ba2a496f2fdf162b933ec87800c353e Mon Sep 17 00:00:00 2001 From: Isan Rivkin Date: Tue, 28 Nov 2023 10:29:36 +0200 Subject: [PATCH 3/3] update docs --- docs/howto/deploy/onprem.md | 2 +- docs/howto/import.md | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/docs/howto/deploy/onprem.md b/docs/howto/deploy/onprem.md index f666327838c..07dc816459b 100644 --- a/docs/howto/deploy/onprem.md +++ b/docs/howto/deploy/onprem.md @@ -227,7 +227,7 @@ blockstore: - Using a local adapter on a shared location is relativly new and not battle-tested yet - lakeFS doesn't control the way a shared location is managed across machines -- Import works only for folders +- When using lakectl or the lakeFS UI, you can currently import only directories. If you need to import a single file, use the [HTTP API](https://docs.lakefs.io/reference/api.html#/import/importStart) or API Clients with `type=object` in the request body and `destination=`. - Garbage collector (for committed and uncommitted) and lakeFS Hadoop FileSystem currently unsupported {% include_relative includes/setup.md %} diff --git a/docs/howto/import.md b/docs/howto/import.md index 08fd4e70763..13db0753325 100644 --- a/docs/howto/import.md +++ b/docs/howto/import.md @@ -73,7 +73,7 @@ lakectl import \ 1. The import duration depends on the amount of imported objects, but will roughly be a few thousand objects per second. 1. For security reasons, if you are using lakeFS on top of your local disk (`blockstore.type=local`), you need to enable the import feature explicitly. To do so, set the `blockstore.local.import_enabled` to `true` and specify the allowed import paths in `blockstore.local.allowed_external_prefixes` (see [configuration reference]({% link reference/configuration.md %})). - When using lakectl or the lakeFS UI, you can currently import only directories locally. If you need to import a single file, use the [HTTP API](https://docs.lakefs.io/reference/api.html#/import/importStart) or API Clients with `type=object` in the request body. + When using lakectl or the lakeFS UI, you can currently import only directories locally. If you need to import a single file, use the [HTTP API](https://docs.lakefs.io/reference/api.html#/import/importStart) or API Clients with `type=object` in the request body and `destination=`. 1. Making changes to data in the original bucket will not be reflected in lakeFS, and may cause inconsistencies. ## Examples