Senior Data Engineer

Mô tả công việc Data Ingestion Design and implement batch data pipelines to ingest enrollment data from multiple sources. Develop data ingestion workflows using Python, Airflow, and SQL. Integrate data from different systems and ensure reliable data delivery. Data Quality & Validation Implement data validation and quality checks throughout the pipeline. Identify, handle, and troubleshoot data inconsistencies and processing errors. Ensure data accuracy, completeness, and consistency. Data Transformation Design and implement data transformation workflows using SQL and dbt. Transform and prepare data for downstream consumption and analytics. Optimize data processing and query performance where required. Historical Tracking Implement mechanisms to maintain and track historical enrollment data. Ensure data changes and historical records can be reliably traced and retrieved. REST API Development Develop and maintain REST APIs using Node.js / NestJS to serve processed data. Design APIs for reliable and efficient data access. Event Publishing Implement event publishing and data integration using Kafka. Ensure reliable event delivery between data services and downstream systems. UV qtam liên hệ mình zl o332.o22.o55 hoặc contact@techdy.vn nhé. IB mình nếu bạn quan tâm các vị trí khác đang open lĩnh vực IT, Data & AI (đang open 100+ vị trí từ Middle đến Lead++).