UC
Senior Data Engineer
6.0/10
Unknown Company
Not specified
Remote
senior
3 days ago
datatechSQLJAVAPythonOraclePostgresMySQLMsSQLGitDBTCosmos
AI Summary
The vacancy is detailed in technical requirements but lacks compensation information and company context.
Check Match — Just drop your CV
See your fit for Senior Data Engineer in seconds.
Description
Looking for a Senior Data Engineer with expertise in Lakehouse technology and Big Data.
Remote position available.
Requirements
Requirements
- •Project: Retail.
- •General understanding of Lakehouse technology stack.
- •Understanding the difference between Big Data/Lakehouse and regular-sized data.
- •Knowledge of SQL (indexes, functions, optimization, performance profiling).
- •Knowledge of programming languages (JAVA, Python).
- •Experience with relational databases (Oracle, Postgres, MySQL, MsSQL, etc.).
- •Ability to work with Git (knowledge of git pull/commit/push commands).
- •Experience with DBT, Cosmos, Ni-Fi.
- •Experience in development with Spark.
- •Skills in using components of the Hadoop ecosystem: Yarn, Ranger, Zookeeper, Hive metastore.
- •Understanding the features of Trino.
- •Understanding data formats Iceberg, Parquet, Avro.
- •Understanding how to work with minio or any other S3-based storage.
- •Experience using project management and documentation systems.
- •Experience in developing atypical integrations (including SAP systems).
- •Experience in developing near-realtime streams (Flink, Debezium).
- •Experience optimizing high-load streams (billions of incremental records) using Observability tools (Grafana, Victoria metrics, Zabbix).
Loading similar jobs...