08-Data Compression¶
¶
Compress: alter options
1. Create a table containing data types including BOOL, TINYINT, SMALLINT, INT, BIGINT, FLOAT, DOUBLE, and BINARY;
2. insert records and query the results
3. Modify compression settings (compression option, level, and encoding method), including disabling compression entirely, then query the results
4. Execute FLUSH DATABASE and restart the taosdservice
5. Insert new data again and continue querying the results
¶
Compress: alter table
1. Insert data
2. Modify table structure
3. Execute FLUSH DATABASE
4. Insert data again and query the results
¶
Tool system tables inspect
1. Create 1 stb(17 columns) and 4 child tables
2. Insert each child table 1000 rows data
3. Check default encode/compress/level is correct
4. Alter encode/compress/level for columns and insert data
5. flush database
6. Add columns with encode/compress/level and insert data
7. Check all data is correct
8. Check error create/alter/add column with encode/compress/level
¶
Check compress data accuracy
1. taosBenchmark create 1 stb 10 ctb
2. Insert each child table 100000 rows with fixed column values
3. Check data accuracy with column value is not equal to fixed value
4. Check data accuracy with column value is equal to fixed value
5. Do snapshot aggregation
6. Check aggregation result correctness
7. Insert null values into all columns except timestamp column
8. Check null values correctness
¶
Compress tsz algorithm
1. Init config open TSZ compression and set IfAdtFse to 1
2. Create 1 stable 5 child tables
3. each child table insert 50000 rows data with some null float/double values
4. Verify data correctness after insert with TSZ compression
5. Alter config IfAdtFse to 0
6. Repeat steps 1-3 to verify data correctness