Code

Feat/954 llama cpp#1000

Code

Merged

davidberenstein1957 merged 34 commits intoargilla-io:developargilla-io/distilabel:developfrom bikash119:feat/954_llama-cppbikash119/distilabel:feat/954_llama-cppCopy head branch name to clipboardJan 9, 2025

+459-1

Commits

Commits on Sep 24, 2024

• Support embeddings generation using llama_cpp

  bikash119

  committed
  c9ed5fd

  Copy full SHA for c9ed5fd

• Added llama-cpp-python as optional dependency

  bikash119

  committed
  c3464bc

  Copy full SHA for c3464bc

Commits on Sep 25, 2024

• - Added normalize_embeddings argument to allow user to pass if the embeddings should be normalized

  Show description for 582ca40
  bikash119

  committed
  582ca40

  Copy full SHA for 582ca40

Commits on Sep 26, 2024

• Update pyproject.toml

  Show description for fba8ada
  

  bikash119

  and

  davidberenstein1957

  authored
  fba8ada

  Copy full SHA for fba8ada

• - Updated test to allow developer to define test model location.

  Show description for e288b31
  bikash119

  committed
  e288b31

  Copy full SHA for e288b31

• Merge remote-tracking branch 'upstream/develop' into feat/954_llama-cpp

  bikash119

  committed
  d6d4352

  Copy full SHA for d6d4352

• - Made the test session scope

  Show description for a936a39
  bikash119

  committed
  a936a39

  Copy full SHA for a936a39

• - Reverted the changes made to model_path

  bikash119

  committed
  316afa0

  Copy full SHA for 316afa0

• - Implement test_encode_batch to verify various batch sizes

  Show description for 7137883
  bikash119

  committed
  7137883

  Copy full SHA for 7137883

• - Included LlamaCppEmbeddings to __ini__.py

  bikash119

  committed
  2d0aa76

  Copy full SHA for 2d0aa76

Commits on Sep 30, 2024

• - Use HF_TOKEN to download model from hub to generate embeddings.

  bikash119

  committed
  778532f

  Copy full SHA for 778532f

Commits on Oct 2, 2024

• - Download from hub is now available through mixin

  bikash119

  committed
  55c3a0d

  Copy full SHA for 55c3a0d

Commits on Oct 3, 2024

• Revert "- Download from hub is now available through mixin"

  Show description for 935cdb8
  bikash119

  committed
  935cdb8

  Copy full SHA for 935cdb8

• Revert "- Use HF_TOKEN to download model from hub to generate embeddings."

  Show description for 29a8d56
  bikash119

  committed
  29a8d56

  Copy full SHA for 29a8d56

• - Removed mixin implemenation to download the model

  Show description for b40b0d2
  bikash119

  committed
  b40b0d2

  Copy full SHA for b40b0d2

Commits on Oct 4, 2024

• - Additional example added for private / public model

  bikash119

  committed
  b08f3ae

  Copy full SHA for b08f3ae

• - The tests can now be configured to use cpu or gpu based on parameter --cpu-only.

  Show description for a49363c
  bikash119

  committed
  a49363c

  Copy full SHA for a49363c

• - repo_id or model_path : one of the parameters is mandatory

  Show description for 575f48e
  bikash119

  committed
  575f48e

  Copy full SHA for 575f48e

• Added description to attribute : model

  bikash119

  committed
  48dce7b

  Copy full SHA for 48dce7b

• - Fixed examples

  bikash119

  committed
  0e1fb8e

  Copy full SHA for 0e1fb8e

• Updated examples

  bikash119

  committed
  f72ef30

  Copy full SHA for f72ef30

Commits on Oct 14, 2024

• Update src/distilabel/embeddings/llamacpp.py

  Show description for 8218242
  

  bikash119

  and

  davidberenstein1957

  authored
  8218242

  Copy full SHA for 8218242

• Update src/distilabel/embeddings/llamacpp.py

  Show description for db00482
  

  bikash119

  and

  davidberenstein1957

  authored
  db00482

  Copy full SHA for db00482

• Update src/distilabel/embeddings/llamacpp.py

  Show description for 0fb7f15
  

  bikash119

  and

  davidberenstein1957

  authored
  0fb7f15

  Copy full SHA for 0fb7f15

• Updated test to set disable_cuda_device_placement=True when testing for cpu

  bikash119

  committed
  155feb2

  Copy full SHA for 155feb2

• Merge branch 'develop' into feat/954_llama-cpp

  bikash119

  authored
  b218b44

  Copy full SHA for b218b44

Commits on Oct 16, 2024

• Merge branch 'develop' into feat/954_llama-cpp

  bikash119

  authored
  58aa996

  Copy full SHA for 58aa996

• testcase will by default load the model to cpu

  bikash119

  committed
  3659400

  Copy full SHA for 3659400

• Merge branch 'feat/954_llama-cpp' of github.com:bikash119/distilabel into feat/954_llama-cpp

  bikash119

  committed
  92481b0

  Copy full SHA for 92481b0

Commits on Oct 19, 2024

• Merge branch 'develop' into feat/954_llama-cpp

  bikash119

  authored
  ef98d63

  Copy full SHA for ef98d63

Commits on Oct 26, 2024

• Updated import statements to allign with new folder structure

  bikash119

  committed
  2258190

  Copy full SHA for 2258190

• example code updated

  bikash119

  committed
  da92cc9

  Copy full SHA for da92cc9

• examples fixed

  bikash119

  committed
  09dd551

  Copy full SHA for 09dd551

Commits on Dec 2, 2024

• Merge branch 'develop' into feat/954_llama-cpp

  bikash119

  authored
  b9c5305

  Copy full SHA for b9c5305