UC

Senior Data Engineer

6.0/10

Unknown Company

Not specified
Office / on-site
senior
about 1 month ago
aidevPythonApache SparkHadoopSQLGitBig DataDistributed Systems

AI Summary

The vacancy provides clear responsibilities and tech stack but lacks compensation details and company information.

Check Match โ€” Just drop your CV

See your fit for Senior Data Engineer in seconds.

Description

What you'll do

  • โ€ขCollect and analyze business and technical requirements.
  • โ€ขConduct exploratory data analysis (EDA) to assess data quality and usability.
  • โ€ขLoad, process, and transform large datasets.
  • โ€ขDevelop and implement high-performance, secure, and scalable data processing pipelines.
  • โ€ขApply feature engineering methods to support ML models.
  • โ€ขOptimize Spark jobs and distributed data processing workflows.
  • โ€ขCollaborate closely with analytics leads, data specialists, and cross-functional teams in an Agile environment.
  • โ€ขInteract effectively with stakeholders to ensure project alignment and successful implementation.

Requirements

  • โ€ข8โ€“10+ years of experience in data design and ML pipeline development.
  • โ€ขProficiency in Python, Apache Spark, Hadoop ecosystem, SQL, Git, big data architectures, and distributed systems.
  • โ€ขExperience in Agile/Scrum environments.
  • โ€ขExcellent English proficiency (mandatory).
  • โ€ขBachelor's or Master's degree in Computer Science, Engineering, or related fields.
Loading similar jobs...