We are seeking a highly skilled Data Engineer with extensive experience in AWS to join our team. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and architectures within the AWS ecosystem. This role requires a strong foundation in data engineering principles, ETL processes, and cloud services. The successful candidate will collaborate closely with cross-functional teams to ensure seamless data flow and maintain high standards of data quality and management.
Key Responsibilities
Design and implement scalable data pipelines leveraging AWS services such as S3, Glue, Redshift, EMR, Lambda, and Athena. Develop and maintain robust ETL/ELT processes to ingest both structured and unstructured data from a variety of sources. Continuously optimize the performance and reliability of data workflows to meet evolving business requirements. Work collaboratively with data scientists, analysts, and business stakeholders to gather and clarify data needs. Create and maintain data models and database solutions that support analytics and reporting functions. Ensure data quality, security, and compliance by adhering to best practices and organizational policies. Identify and troubleshoot issues within data pipelines, conducting root cause analysis to prevent future disruptions.
Required Qualifications
Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related discipline. A minimum of 3 to 5 years of professional experience as a Data Engineer. Proven hands-on experience with AWS data services including Glue, S3, Redshift, Athena, Lambda, and Step Functions. Strong proficiency in SQL and experience with both relational and NoSQL databases such as PostgreSQL and DynamoDB. Skilled in programming languages such as Python, PySpark, or Scala for data transformation and scripting. Experience with data pipeline orchestration tools like Apache Airflow or AWS Step Functions. Familiarity with CI/CD practices and tools including Git, Jenkins, and AWS CodePipeline. Solid understanding of data warehousing concepts, data modeling techniques, and big data technologies.
This position provides an excellent opportunity to work in a dynamic and innovative environment that values collaboration and continuous improvement. Candidates passionate about building efficient data systems and leveraging AWS technologies to drive actionable business insights are encouraged to apply.