AWS Data Engineer(Ign Job/ 92)

• Design, develop, and maintain data pipelines and architectures that enable fast data transformation and processing.
• Work with cross-functional teams to identify and prioritize data transformation requirements.
• Ensure data quality, integrity, and security throughout the data transformation process.
• Collaborate with data scientists and analysts to develop and optimize data models and algorithms.
• Optimize data pipeline performance, scalability, and reliability.

Develop and maintain technical documentation for data pipelines and architectures

 

• Bachelor’s degree in computer science, Engineering, or a related field.

• Language – Pyspark and Java
• Data modelling, Data Ingestion , Data Warehouse
• Should have hands on experience in handling projects on Data Bricks
• Should have strong Design skills
• Azure – Experience in working on AWS platform, Databricks , ADLS, Delta Storage
• Disturbed processing Python, PySpark, AWS Glue, AWS S3, GitLab.
• At least 4+ years of experience in data engineering, software development, or related field.
• Familiarity with machine learning and data science concepts.
• Experience with agile development methodologies and version control systems such as Git.