OpenOpportunity Sourced Jobs — Bengaluru, Hyderabad, Kolkata, Mumbai, New Delhi, Pune, Chennai
Full Time · On Site · Entry Level
Role: Data Engineer | Department: Engineering - Software & QA | Industry: IT Services & Consulting | Education: UG: Any Graduate PG: Any Postgraduate Job summary Our client is seeking a Senior Data Engineer to join our fast-growing team The successful candidate will join the testing team to work on ETL and development tasks This is an exciting and challenging opportunity to build out new pipelines combining and processing large amounts of structured data from a variety of sources with the power of PySpark at your fingertips Key Responsibilities: Designing, deploying and managing complex production data pipelines that interact with a range of data sources (file systems, web, database, users) Strong experience with Amazon Web Services (AWS) 5 years' work in data engineering field At least 2 years' experience with PySpark and AWS data tools (particularly, Glue) Knowledge: Data modeling, data pipeline architecture, Big Data implementation Software development lifecycle best practices Financial knowledge would be an asset Note: This is a third-party recruitment listing (opening line: "Our client is seeking...") posted with no rating or reviews, spread simultaneously across seven cities (Bengaluru, Hyderabad, Kolkata, Mumbai, New Delhi, Pune, Chennai). Its own Key Responsibilities explicitly require "5 years' work in data engineering field" plus "At least 2 years' experience with PySpark and AWS data tools" - a third confirmed instance in this batch of an explicit stated experience minimum contradicting both the "0 - 2 years" structured field and the search's 0-2-year filter.
api gateway, scala, sql coding, pyspark, sql, git, spark, writing, linux, shell scripting, mysql, etl, communication skills, python, github, dynamo db, aws lambda, nosql, pandas, amazon sqs, aws glue, eventbridge, sns, athena, agile, aws, etl process, presto