Data Engineer
Responsibilities
- Design, maintain and optimize data pipelines;
- Design and develop DWH;
- Integrate data from various sources (APIs, external DBs, file stores, etc.);
- Ensure data quality, reliability and timely updates;
- Implement best practices for CI/CD, testing and monitoring in data handling;
- Interact with analysts and developers to implement business requirements.
Requirements
- 2 years experience of working in the position of Data Engineer;
- Strong knowledge of SQL, experience in writing complex queries and optimization;
- Practical experience with analytical warehouses (ClickHouse/Greenplum);
- Deep understanding of principles and practical experience with dbt (models, macros, tests, materializations);
- Experience building ETL/ELT pipelines;
- Knowledge of DWH/DM architecture design principles;
- Knowledge of Python and experience writing scripts/utilities for data processing;
- Experience with Airflow or other orchestrators;
- Understanding of CI/CD processes (GitHub Actions, GitLab CI, etc.);
- Experience with version control systems (Git);
- Knowledge of Data Vault / Star Schema / Snowflake Schema concepts.
Will be a plus:
- Practical experience with Google BigQuery.