Query Apache TsFile Directly with DuckDB

Описание и применение

Прямой доступ к данным Apache TsFile через DuckDB позволяет выполнять SQL‑анализ без промежуточного преобразования, упрощая обработку больших потоков датчиков в промышленном IoT.

Задача

Industrial IoT systems generate massive time‑series data that is efficiently stored in Apache TsFile, but users need to analyze it with tools beyond the original database.

Результат

Direct SQL access to TsFile data simplifies IoT analytics, eliminating data conversion steps and enabling efficient filtering, aggregation, and export.

Рабочий процесс

• Install the DuckDB‑TsFile extension with INSTALL tsfile FROM community;
• Load the extension using LOAD tsfile;
• Query a TsFile with SELECT time, device_id, temperature FROM read_tsfile('/data/measurements.tsfile', 'sensors') WHERE time BETWEEN 1700000000000 AND 1700003600000;
• Use standard SQL operations for analysis
• Export results back to TsFile with COPY ... TO ... (FORMAT TSFILE)

Доказательства

DuckDB is an in-process analytical database that provides powerful SQL capabilities for data exploration and analysis.

Источник

The DuckDB‑TsFile Extension connects Apache TsFile with DuckDB, allowing users to query TsFile table-model files directly through SQL.

Источник

Key capabilities include: Reading TsFile data directly with read_tsfile(), Querying TsFile data using DuckDB SQL, Projection pushdown, Time‑predicate pushdown, TAG predicate pushdown, Exporting query results to TsFile format using COPY ... TO ... (FORMAT TSFILE).

Источник