Capabilities overview
capabilities fall into the following categories:Data storage and organization
- Hypertables: automatically partition time-series data into chunks for efficient data management at scale
- Hypercore: automatically provides columnar storage with advanced compression, delivering 90-95% storage reduction
Data processing and aggregation
- Continuous aggregates: automatically maintain pre-computed aggregations that update incrementally as new data arrives
- Hyperfunctions: provide specialized SQL functions for time-series analysis, including statistical aggregation and percentiles
Data lifecycle management
- Data retention: policies automatically drop old data based on time intervals, keeping storage costs under control
- Compression: (superseded by Hypercore) provides row-based compression for older data in existing deployments
Schema optimization and automation
- Optimize your schema: using PostgreSQL features like indexes, constraints, triggers, tablespaces, and foreign data wrappers
- Jobs: automate recurring tasks like compression, continuous aggregate refreshes, data retention, and custom maintenance
Typical workflow
Here’s how capabilities work together in a typical time-series application:- Data ingestion Start by creating a hypertable for your time-series data. The hypertable automatically partitions data into time-based chunks, enabling efficient inserts and queries. As data arrives, it’s written to the appropriate chunk based on timestamp. For high-volume ingestion, optimize your schema with appropriate indexes and constraints. Use bulk insert methods like COPY or multi-row INSERT statements for best performance. For migrating existing data or importing from external sources, see import and ingest data.
- Real-time analytics As data lands in hypertables, continuous aggregates automatically update to maintain pre-computed summaries. Use hyperfunctions in your aggregates to calculate statistics, percentiles, time-weighted averages, and other specialized metrics. Query continuous aggregates instead of raw data for instant results on dashboards and reports. Real-time aggregates ensure you see the latest data without waiting for batch processing.
- Data optimization Hypercore automatically provides columnar storage with advanced compression for all new hypertables, dramatically reducing storage costs and speeding up analytical queries. Data is automatically converted to columnar format and optimized for analytical access patterns. This columnar storage reduces storage by 90-95% while maintaining full query capabilities and delivering 100-1000x performance improvements for analytics workloads.
- Data lifecycle Configure retention policies to automatically drop old data when it’s no longer needed. Retention works seamlessly with Hypercore and compression, removing entire chunks efficiently without impacting performance. Retention policies can preserve aggregated data in continuous aggregates even after dropping raw data, enabling long-term trend analysis without storing every data point.
- Automation Schedule jobs to automate compression, continuous aggregate refreshes, retention, and custom maintenance tasks. Jobs run reliably in the background and provide execution history for monitoring and troubleshooting. Use job scheduling for regular data quality checks, statistics updates, or data transformations that need to run on a schedule.
Capabilities by use case
IoT and sensor data
For IoT workloads with millions of devices generating continuous metrics:- Hypertables: partition data by time and optionally by device ID for optimal performance
- Hypercore: automatic columnar storage compresses sensor readings with 95%+ storage reduction
- Continuous aggregates: pre-compute device statistics, fleet-wide metrics, and anomaly detection
- Data retention: automatically drop raw sensor data after a retention period
- Hyperfunctions: use downsampling (LTTB) for visualization, time-weighted averages for irregular samples
Financial analytics
For financial data with high-frequency trading, market data, and portfolio analytics:- Hypertables: store tick data, OHLCV bars, and trade executions with automatic columnar storage
- Hyperfunctions: calculate candlestick aggregates, percentiles, statistical measures
- Continuous aggregates: maintain pre-computed OHLCV bars, technical indicators, portfolio valuations
- Hypercore: automatic compression enables cost-effective long-term backtesting on historical market data
- Optimize schema: use indexes for symbol lookups, constraints for data integrity
Observability and monitoring
For system metrics, logs, and distributed tracing:- Hypertables: ingest metrics, logs, and traces with automatic partitioning and columnar storage
- Continuous aggregates: maintain service health metrics, error rates, latency percentiles
- Hyperfunctions: calculate uptime/downtime (heartbeat aggregation), detect anomalies, analyze distributions
- Hypercore: automatic compression enables cost-effective long-term retention of historical metrics and traces
- Data retention: drop raw data after debugging period while keeping aggregated metrics