Skip to content

03-Benchmark

taosBenchmark basic
1. Insert data with different json files
2. Check data correct depends on json file
3. Check taosBenchmark options
4. Check custom column and tags
5. Check default json file
6. Check demo mode
7. Check from to continue insert
8. Check from to insert
9. Check insert auto create table json
10.Check insert bind vgroup
11.Check json tag
12.Check limit offset json
13.Check insert precision
14. Check insert with mix mode()
15. Check insert correctly with different stt options
16. Check taos config is correctedly set
path: cases/81-Tools/03-Benchmark/test_benchmark_basic.py

taosBenchmark bugs
1. Verify bug TD-32913
2. Verify bug TD-31575
3. Verify bug TD-31490
4. Verify bug TS-5846
5. Verify bug TS-5234
6. Verify bug TD-22190
path: cases/81-Tools/03-Benchmark/test_benchmark_bugs.py

taosBenchmark command line
1. Verify -c with different config path
2. Verify -I with taosc, rest, stmt, stmt2, sml, sml-line, sml-telnet, sml-json, sml-taosjson
3. Verify -b with all data types
4. Verify -v with support vgroups
5. Verify -A with all data types
6. Verify -S to set start time
7. Verify -U to do supplement insert
8. Verify -V to check version info
9. Verify other command line options -ntyNxGrTiFM
10. Verify JIRA TD-11510/TD-19387/TD-19985/TD-21063/TD-22334/TD-21932/TD-19352/TD-21806
11. Verify invalid command line options
path: cases/81-Tools/03-Benchmark/test_benchmark_commandline.py

Benchmark disorder data
1. Prepare disorder data with taosBenchmark -O option
2. Run sql to verify the data correctness
3. Run sql again after flush database
4. Verify sub table data correctness
5. Run sql again after flush database
6. Verify sub table data correctness again
7. Repeat the above steps with different parameters
path: cases/81-Tools/03-Benchmark/test_benchmark_commandline.py

taosBenchmark connect with Native and WebSocket
1. Verify "-Z native -X http://127.0.0.1:6041"
2. Verify "-Z websocket -X http://127.0.0.1:6042"
3. Verify command line connection mode priority over json and env
4. Verify env connection mode priority over json
5. Verify except command line connection mode
6. Verify host and port in command line and json
path: cases/81-Tools/03-Benchmark/test_benchmark_conn_mode.py

taosBenchmark datatypes
1. Check decimal data type
path: cases/81-Tools/03-Benchmark/test_benchmark_datatypes.py

taosBenchmark exception
1. Insert operator be canceled check expect
2. Insert operator be forced exit check expect
3. Insert operator meet dnode exit check expect
path: cases/81-Tools/03-Benchmark/test_benchmark_except.py

taosBenchmark insert mix mode
1. Insert data with mix mode json file
2. Generate data rate: disorder_ratio 10%, update_ratio 5%, delete_ratio 1%
3. Verify generate rows is less than 95% (except delete rows)
path: cases/81-Tools/03-Benchmark/test_benchmark_mix.py

taosBenchmark query basic
1. Insert test data into benchmark tables.
2. Run taosBenchmark in three query modes:
1) specified table query
2) specified table mixed query
3) super table query
3. Validate the output of each query mode to ensure correct execution.
4. Perform exception tests to verify error handling.
path: cases/81-Tools/03-Benchmark/test_benchmark_query_main.py

taosBenchmark query with json
1. Create database and super table
2. Create sub-tables and insert data
3. taosBenchmark run with taosc_query.json
4. taosBenchmark run with rest_query.json
5. taosBenchmark run with taosc_query_mixed_query.json
6. taosBenchmark run with rest_query_mixed_query.json
7. Verify query result correct
8. Verify query times correct
9. Verify query with times less than or equal to 100
10. Verify query result print QPS
11. Use illegal or out of range parameters query json file
path: cases/81-Tools/03-Benchmark/test_benchmark_query_rest.py

taosBenchmark query with json
1. taosBenchmark run with query sqlfile
2. Verify data correct after query sqlfile
3. taosBenchmark run with query error sqlfile
4. Verify handling of error sqlfile
path: cases/81-Tools/03-Benchmark/test_benchmark_query_sqlfile.py

taosBenchmark run with rest connect
1. Verify "-I sml-rest -t 1 -n 1 -y"
2. Verify "-I sml-rest-line -t 1 -n 1 -y"
3. Verify "-I sml-rest-telnet -t 1 -n 1 -y"
4. Verify "-I sml-rest-json -t 1 -n 1 -y"
5. Verify "-I sml-rest-taosjson -t 1 -n 1 -y"
6. Verify "-N -I sml-rest -y" negative case
7. Run with rest insert all data-types
8. Connect with telnet_tcp protocol
9. Verify taosadapter with sml rest json/line/telnet
path: cases/81-Tools/03-Benchmark/test_benchmark_rest.py

taosBenchmark schemaless insert
1. sml auto create table with json
2. sml insert alltypes with json
3. sml interlace
4. sml json alltypes interlace
5. sml json alltypes
6. sml json insert alltypes same min max
7. sml taosjson alltypes
8. sml taosjson insert alltypes same min max
9. sml telnet alltypes
10.sml telnet insert alltypes same min max
path: cases/81-Tools/03-Benchmark/test_benchmark_sml.py

taosBenchmark stmt & stmt2 insert
1. Stmt auto create table with json
2. Stmt insert alltypes with json
3. Stmt insert alltypes same min max
4. Stmt offset with json
5. Stmt2 restart dnode during insert with json
6. Stmt2 insert with auto-create-table(yes or no), interlace or batch, csv or not
7. Old case (taosdemo) for insert with stmt other parameters
path: cases/81-Tools/03-Benchmark/test_benchmark_stmt.py

taosBenchmark tag order sml
1. Sml insert with tag order and interlace 1
2. Sml insert with tag order and interlace 0
3. Check tag value is ordered after insert
path: cases/81-Tools/03-Benchmark/test_benchmark_tag_order_sml.py

taosBenchmark tag order sql
1. Sql insert with tag order and interlace 1
2. Sql insert with tag order and interlace 0
3. Check tag value is ordered after insert
path: cases/81-Tools/03-Benchmark/test_benchmark_tag_order_sql.py

taosBenchmark tag order stmt
1. Stmt insert with tag order and interlace 1
2. Stmt insert with tag order and interlace 0
3. Check tag value is ordered after insert
path: cases/81-Tools/03-Benchmark/test_benchmark_tag_order_stmt.py

taosBenchmark tag order stmt2
1. Stmt2 insert with tag order and interlace 1
2. Stmt2 insert with tag order and interlace 0
3. Check tag value is ordered after insert
path: cases/81-Tools/03-Benchmark/test_benchmark_tag_order_stmt2.py

taosBenchmark taosc insert
1. Taosc insert auto create table with json
2. Taosc insert alltypes with json partial col
3. Taosc insert alltypes with json
4. Taosc insert alltypes same min max
5. Taosc insert mix
6. Taosc insert retry global with json
7. Taosc insert retry stb with json
8. Taosc insert with table creating interval
path: cases/81-Tools/03-Benchmark/test_benchmark_taosc.py

taosBenchmark tmq
1. Check tmq basic insert data, tmq sequ, tmq parallel
2. Check tmq case for different options
3. Check coredump do restart taosd during consume data
path: cases/81-Tools/03-Benchmark/test_benchmark_tmq.py

taosBenchmark official website
1. Check official website example case run successfully
2. example files: insert.json/query.json/queryStb.json/tmq.json
path: cases/81-Tools/03-Benchmark/test_benchmark_website.py

taosBenchmark websocket
1. Check option -W http://localhost:6041
2. Check option --driver='WebSocket'
3. Check option --cloud_dsn='http://localhost:6041'
path: cases/81-Tools/03-Benchmark/test_benchmark_websocket.py

taosBenchmark json with csv
1. Create table tags from csv file
2. Create table with keywords
3. Export data to csv files
4. Insert data from json and csv files
5. Stmt sample with csv and json
6. Stmt sample with csv and json doesnt use ts
7. Stmt sample with csv and json subtable
8. Taosc sample with csv and json
9. Taosc sample with csv and json subtable
path: cases/81-Tools/03-Benchmark/test_benchmark_with_csv.py