Query Apache TsFile Directly with DuckDB

说明与用途

通过 DuckDB 直接查询 Apache TsFile 数据，省去转换步骤，实现工业 IoT 的高效时序分析。

问题

Industrial IoT systems generate massive time‑series data that is efficiently stored in Apache TsFile, but users need to analyze it with tools beyond the original database.

结果

Direct SQL access to TsFile data simplifies IoT analytics, eliminating data conversion steps and enabling efficient filtering, aggregation, and export.

工作流

• Install the DuckDB‑TsFile extension with INSTALL tsfile FROM community;
• Load the extension using LOAD tsfile;
• Query a TsFile with SELECT time, device_id, temperature FROM read_tsfile('/data/measurements.tsfile', 'sensors') WHERE time BETWEEN 1700000000000 AND 1700003600000;
• Use standard SQL operations for analysis
• Export results back to TsFile with COPY ... TO ... (FORMAT TSFILE)

证据

DuckDB is an in-process analytical database that provides powerful SQL capabilities for data exploration and analysis.

来源

The DuckDB‑TsFile Extension connects Apache TsFile with DuckDB, allowing users to query TsFile table-model files directly through SQL.

来源

Key capabilities include: Reading TsFile data directly with read_tsfile(), Querying TsFile data using DuckDB SQL, Projection pushdown, Time‑predicate pushdown, TAG predicate pushdown, Exporting query results to TsFile format using COPY ... TO ... (FORMAT TSFILE).

来源