Details
-
New Feature
-
Status: Closed (View Workflow)
-
Major
-
Resolution: Fixed
-
None
-
None
-
2023-8
Description
By the current design of DJS it tries to distribute rows to buckets based on a hashing result for each row, when the bucket exceed the memory limit defined in session variables it tries to redistribute the current bucket into the small buckets again using a hash with different seed, in case all rows a the same in the bucket we cannot distribute them into different buckets as designed, we go into endless recursion trying to do this. The current task is to handle this corner cases by updating the approach of bucket selection algorithm and bucket distribution algorithm.