Data Engineering & ETL
Design and implement scalable ETL or ELT pipelines using streaming or batch approaches. Observability, testing, and replayability are built-in.
- Streaming: Kafka / Pulsar
- Orchestration: Airflow / Prefect
- Warehouses: Snowflake / BigQuery / Redshift