UC
Senior Data Engineer
4.0/10
Unknown Company
Not specified
Remote
senior
6 days ago
datadevGreenplumTrinoApache AirflowClickHousePythonSparkSQLS3HadoopJAVA
AI Summary
The vacancy has a solid tech stack but lacks compensation details and company information, affecting overall quality.
Check Match โ Just drop your CV
See your fit for Senior Data Engineer in seconds.
Description
Looking for a Senior Data Engineer with extensive experience in data technologies and systems.
Must have strong skills in SQL, Python, and various data processing tools.
Requirements
Requirements
- โขStack: Greenplum, Trino, Apache Airflow, ClickHouse, Python, Spark, SQL (dbt), S3, Hadoop.
- โขGeneral understanding of Lakehouse technology stack.
- โขUnderstanding the differences between BigData/Lakehouse and regular-sized data.
- โขKnowledge of SQL (indexes, functions, optimization, performance profiling).
- โขKnowledge of programming languages (JAVA, Python).
- โขExperience with relational databases (Oracle, Postgres, MySQL, MsSQL, etc.).
- โขAbility to work with Git (knowledge of git pull/commit/push commands).
- โขExperience with DBT, Cosmos, Ni-Fi.
- โขExperience in Spark development.
- โขSkills in using Hadoop ecosystem components: Yarn, Ranger, Zookeeper, Hive metastore.
- โขUnderstanding of Trino features.
- โขUnderstanding of data formats Iceberg, Parquet, Avro.
- โขUnderstanding of working with minio or any other S3-based storage.
- โขExperience using project management and documentation systems.
- โขExperience in developing atypical integrations (including SAP systems).
- โขExperience in developing near-realtime streams (Flink, Debezium).
- โขExperience optimizing high-load streams (billions of incremental records) using Observability tools (Grafana, Victoria Metrics, Zabbix).
Loading similar jobs...