Code

distilabel 1.3.0#857

Code

Merged

gabrielmbmb merged 48 commits intomainargilla-io/distilabel:mainfrom developargilla-io/distilabel:developCopy head branch name to clipboardAug 6, 2024

+9,030-1,129

Commits

Commits on Jun 18, 2024

• Bump version

  gabrielmbmb

  committed
  54bfb46

  Copy full SHA for 54bfb46

Commits on Jun 21, 2024

• Add new step CombineKeys (#747)

  Show description for 4c0f319
  plaguss

  authored
  4c0f319

  Copy full SHA for 4c0f319

Commits on Jun 26, 2024

• Refactor naming columns steps combinecolumns combinekeys expandcolumns (#758)

  Show description for 5fb28b6
  

  davidberenstein1957

  and

  gabrielmbmb

  authored
  5fb28b6

  Copy full SHA for 5fb28b6

• Drop: LoadHubDataset due to deprecation in 1.3 (#759)

  davidberenstein1957

  authored
  fdb5c8f

  Copy full SHA for fdb5c8f

Commits on Jun 27, 2024

• Add requirements list for Pipeline (#720)

  Show description for c357090
  

  plaguss

  and

  gabrielmbmb

  authored
  c357090

  Copy full SHA for c357090

• Add StepResources and step replicas in Pipeline (#750)

  Show description for e040dec
  

  gabrielmbmb

  and

  plaguss

  authored
  e040dec

  Copy full SHA for e040dec

Commits on Jun 28, 2024

• Add develop branch

  gabrielmbmb

  committed
  ad372a3

  Copy full SHA for ad372a3

Commits on Jul 1, 2024

• Merge branch 'main' into develop

  gabrielmbmb

  committed
  91bc0fa

  Copy full SHA for 91bc0fa

Commits on Jul 3, 2024

• Add load stages (#760)

  Show description for 87b8f85
  

  gabrielmbmb

  and

  plaguss

  authored
  87b8f85

  Copy full SHA for 87b8f85

• Update min required version to python==3.9 (#770)

  Show description for 647d040
  gabrielmbmb

  authored
  647d040

  Copy full SHA for 647d040

Commits on Jul 4, 2024

• Optionally include the pipeline script in the hub when pushing your distiset (#762)

  Show description for cc36fa5
  

  plaguss

  and

  gabrielmbmb

  authored
  cc36fa5

  Copy full SHA for cc36fa5

Commits on Jul 8, 2024

• Add docs-pr.yml and docs-pr-close.yml workflows (#774)

  Show description for 3098ecd
  gabrielmbmb

  authored
  3098ecd

  Copy full SHA for 3098ecd

Commits on Jul 9, 2024

• Add RayPipeline class (#769)

  Show description for 3d07c22
  gabrielmbmb

  authored
  3d07c22

  Copy full SHA for 3d07c22

• Checkout to merged branch (#776)

  gabrielmbmb

  authored
  ed0f08e

  Copy full SHA for ed0f08e

Commits on Jul 12, 2024

• Merge branch 'main' into develop

  gabrielmbmb

  committed
  86d4e80

  Copy full SHA for 86d4e80

Commits on Jul 15, 2024

• Add Magpie and MagpieGenerator tasks (#778)

  Show description for 4fc569d
  

  gabrielmbmb

  and

  plaguss

  authored
  4fc569d

  Copy full SHA for 4fc569d

Commits on Jul 16, 2024

• Fix some issues related to Magpie task (#783)

  Show description for b22a494
  gabrielmbmb

  authored
  b22a494

  Copy full SHA for b22a494

Commits on Jul 19, 2024

• Add end_with_user and include_system_prompt flags to Magpie tasks and handle Nones. (#784)

  Show description for 0ef3f70
  gabrielmbmb

  authored
  0ef3f70

  Copy full SHA for 0ef3f70

• Add concurrency group (#796)

  gabrielmbmb

  authored
  04f1528

  Copy full SHA for 04f1528

Commits on Jul 22, 2024

• Add _desired_num_gpus attribute to CudaDevicePlacementMixin (#795)

  gabrielmbmb

  authored
  458cf44

  Copy full SHA for 458cf44

Commits on Jul 23, 2024

• Merge branch 'main' into develop

  gabrielmbmb

  committed
  ea1c44b

  Copy full SHA for ea1c44b

• Compatibility with vLLM with tensor_parallel_size argument (#805)

  Show description for b7f124f
  

  gabrielmbmb

  and

  plaguss

  authored
  b7f124f

  Copy full SHA for b7f124f

• Update default names in GroupColumns (#808)

  Show description for a3f6cdd
  plaguss

  authored
  a3f6cdd

  Copy full SHA for a3f6cdd

• Merge branch 'main' into develop

  gabrielmbmb

  committed
  e99ecdf

  Copy full SHA for e99ecdf

Commits on Jul 24, 2024

• Request batches to GeneratorStep if only step in pipeline (#828)

  Show description for 90909ab
  gabrielmbmb

  authored
  90909ab

  Copy full SHA for 90909ab

Commits on Jul 25, 2024

• Add default name for a pipeline (#809)

  Show description for a4d2f2e
  plaguss

  authored
  a4d2f2e

  Copy full SHA for a4d2f2e

• Update distilabel phrasing based on PR hugging face hub (#821)

  Show description for bffc37e
  davidberenstein1957

  authored
  bffc37e

  Copy full SHA for bffc37e

Commits on Jul 26, 2024

• Some more Magpie improvements (#833)

  Show description for 6ac0267
  gabrielmbmb

  authored
  6ac0267

  Copy full SHA for 6ac0267

• Add Embeddings base class, SentenceTransformerEmbeddings class, EmbeddingGeneration and FaissNearestNeighbour steps (#830)

  Show description for 04b86f5
  gabrielmbmb

  authored
  04b86f5

  Copy full SHA for 04b86f5

Commits on Jul 27, 2024

• Create file per hostname in CudaDevicePlacementMixin (#814)

  Show description for 25601bb
  gabrielmbmb

  authored
  25601bb

  Copy full SHA for 25601bb

Commits on Jul 29, 2024

• Create a GeneratorStep from a dataset using a helper function (#812)

  Show description for fc7e82e
  

  3 peopleauthored
  fc7e82e

  Copy full SHA for fc7e82e

• Do not take into account disable_cuda_device_placement for pipeline signature (#838)

  Show description for 974b45e
  gabrielmbmb

  authored
  974b45e

  Copy full SHA for 974b45e

Commits on Jul 30, 2024

• Add RewardModelScore step (#840)

  Show description for 20bd1e3
  gabrielmbmb

  authored
  20bd1e3

  Copy full SHA for 20bd1e3

• Fix LoadDataFromHub attribute _dataset had ellipsis by default instead of None (#841)

  Show description for 2aa977f
  gabrielmbmb

  authored
  2aa977f

  Copy full SHA for 2aa977f

• Create PlacementGroup for steps using vLLM (#842)

  Show description for be61d20
  gabrielmbmb

  authored
  be61d20

  Copy full SHA for be61d20

• Update argilla integration to use argilla_sdk v2 (#705)

  Show description for 18dc02c
  

  4 peopleauthored
  18dc02c

  Copy full SHA for 18dc02c

• Make overall-rating default (#843)

  gabrielmbmb

  authored
  9aa8b35

  Copy full SHA for 9aa8b35

Commits on Jul 31, 2024

• Use CudaDevicePlacementMixin in RewardModelScore step (#845)

  Show description for 3d2fca0
  gabrielmbmb

  authored
  3d2fca0

  Copy full SHA for 3d2fca0

Commits on Aug 1, 2024

• Gather ray nodes gpus info (#848)

  gabrielmbmb

  authored
  c776d36

  Copy full SHA for c776d36

• Ignore disable_cuda_device_placement attribute for pipeline signature

  gabrielmbmb

  committed
  d0fbd5d

  Copy full SHA for d0fbd5d

Commits on Aug 5, 2024

• Fix typo in docs (#850)

  plaguss

  authored
  bcbf6a1

  Copy full SHA for bcbf6a1

• Add xfail (#852)

  gabrielmbmb

  authored
  94852c4

  Copy full SHA for 94852c4

• Fix creating placement group when pipeline_parallel_size>1 (#851)

  Show description for 79a07d5
  gabrielmbmb

  authored
  79a07d5

  Copy full SHA for 79a07d5

• Include Google Analytics in docs (#847)

  Show description for 4e1f2bc
  davidberenstein1957

  authored
  4e1f2bc

  Copy full SHA for 4e1f2bc

Commits on Aug 6, 2024

• Add ClientvLLM class (#854)

  Show description for 092c364
  gabrielmbmb

  authored
  092c364

  Copy full SHA for 092c364

• Add hard-negative flag to include similar challenging negatives on triplets (#856)

  Show description for ff3f484
  

  plaguss

  and

  gabrielmbmb

  authored
  ff3f484

  Copy full SHA for ff3f484

• Add bibtex references in the docstrings to be shown in the README (#855)

  Show description for 44bd633
  

  plaguss

  and

  gabrielmbmb

  authored
  44bd633

  Copy full SHA for 44bd633

• Merge branch 'main' into develop

  gabrielmbmb

  committed
  3690bd6

  Copy full SHA for 3690bd6