Details
-
New Feature
-
Status: Closed (View Workflow)
-
Critical
-
Resolution: Fixed
-
6.1.1
-
None
-
2021-9, 2021-10, 2021-11, 2021-12, 2021-13, 2021-14, 2021-15, 2021-16, 2021-17
Description
As of now there is no way to vectorize the loops of the scanning/filtering code that resides in primitives/linux-port/column.*
The basic logic is that for the column the mentioned code traverses the block of values:
- skiping empty values
- filtering the values using related filters from SQL statement
- saving the values that satisfies into the output buffer
The code optionally traverses the column block and touch only those values with specific RIDs sent from upper layers.
The data processing is scalar here with lots of conditions that slows down execution.
The suggested way is to refactor the code to leverage data prefetch and batch processing using SIMD instructions. The available CPU command set should be detected in runtime on PP startup or at least once per column block.