Spark Developer (Scala / Data Lake VTB)

VTB is seeking a Spark Developer skilled in Scala and data processing to work remotely from Russia.

## What you'll do

• •Develop complex distributed data processing tasks using Scala.
• •Build efficient pipelines using Spark DataFrame API.
• •Optimize Spark applications for high-load operations.
• •Implement ETL processes integrating with Oracle, Postgres, MS SQL, and other databases.
• •Collaborate with cross-functional teams to enhance the Data Lake.

• •Proficient in Scala and Apache Spark.
• •Understanding of DWH and Data Lake principles.
• •Excellent SQL skills and experience with various DBMS.
• •Experience with Hadoop, Hive, and CI/CD tools.
• •Experience with large data clusters is a plus.