Bug: add_replication_rule method failing on more than 6000 blocks

[hassan11196]

Bug Description

The add_replication_rule method of the rucio python client fails with the following error.

Details: no error information passed (http status code: 413)

The request creating this transfer was misconfigured so we rejected that workflow.
I am reporting the issue here for future reference. FYI @haozturk

Reproduction Steps

I don't know which HTTP endpoint is used by the Rucio Python client underneath, Therefore I am just providing details about the client.

1. use add_replication_rule method to create a rule for more than 6000 blocks.

Expected Behavior

No response

Possible Solution

No response

Related Issues

No response

[haozturk]

Hi @hassan11196 can please provide the exact command that gives this error?

[hassan11196]

Hi @haozturk

here is the rucio method being called that fails
https://github.com/dmwm/WMCore/blob/90a14e513d8bce727388f6dcf6b7dac80b616fbd/src/python/WMCore/Services/Rucio/Rucio.py#L515C13-L515C92

Following is the Log Message in MS-Transferor with the dataset name:

Creating rule for workflow cmsunified_EXT_task_BPH-GenericGSmearS-00004__v1_T_241111_214602_7530 with 6764 DIDs in container /InclusiveDileptonMinBias_TuneCP5Plus_13p6TeV_pythia8/GenericNoSmearGEN-124X_mcRun3_2022_realistic_v12-v2/GEN, RSEs: T2_CH_CERN|T1_US_FNAL_Disk, grouping: DATASET

In the following file, you can find the complete list of blocks.
rucio_failing_method.txt

Let me know if you need anything else.
Thanks