Details
-
Improvement
-
Status: Scheduled
-
Not specified
-
Resolution: Unresolved
-
None
-
None
-
None
Description
Currently the page decompression takes quite a long time, and means that fewer pages can be cached in memory. If they could be compared in place it may provide significant benefits.
It would cause backward compatibility issues, and complicate the work of any other code that tries to directly read the index format.
Attachments
Issue Links
- relates to
-
-
- Resolved
-
-
HPCC-29159 Add an option to provide the default index compression format
-
- Resolved
-
1.
|
add a function to calculate index sizes for a query/queryset |
|
Accepted | Anthony Fishbeck |
2.
|
Investigate leaf compressing every N items and decompressing on demand |
|
New | Unassigned |
3.
|
Integrate index cache with roxiemem |
|
New | Unassigned |
4.
|
Default FILEPOSITION(FALSE) on indexes |
|
New | Unassigned |
5.
|
Inplace compression improvements |
|
New | Unassigned |
6.
|
inplace indexes - minor code optimizations |
|
New | Unassigned |
7.
|
Check that increment in payload size cannot cause internal consistency problems |
|
New | Unassigned |
8.
|
Reuse the compressor when building and index |
|
New | Unassigned |
9.
|
Expand inplace payload on demand |
|
New | Unassigned |
10.
|
Reuse temporary buffers when building an index |
|
New | Unassigned |
11.
|
Improve the block-compressed serialization |
|
New | Unassigned |
12.
|
Support other non-incremental compression |
|
New | Unassigned |
13.
|
Investigate dynamic payload lengths |
|
New | Unassigned |
14.
|
Optimize lookup of a range option |
|
New | Unassigned |
15.
|
Compress blobs using lz4 |
|
New | Unassigned |
