We are looking for a highly experienced Senior Software Engineer with a strong background in AWS and distributed systems. The successful candidate will be responsible for designing, developing, and deploying scalable software solutions using AWS cloud services and Big Data platforms. This role requires close collaboration with cross-functional teams to create robust distributed applications that align with evolving business needs. The Senior Software Engineer will report directly to a Senior Manager and play a key role in driving technical excellence across projects.
Key Responsibilities
Design, develop, and deploy scalable, high-performance software solutions on AWS cloud infrastructure. Work closely with cross-functional teams to gather requirements, define system architecture, and implement solutions that meet business objectives. Utilize a wide range of AWS services such as EC2, S3, Lambda, API Gateway, DynamoDB, RDS, and EMR to build reliable distributed applications. Develop and maintain data processing pipelines using Big Data technologies including Hadoop, Spark, Kafka, and Hive. Create batch applications leveraging Spark with Scala or PySpark. Optimize performance and efficiency of data processing applications running on Athena, Presto, and Spark frameworks. Design, develop, and manage complex data workflows and pipelines using Apache Airflow. Configure and maintain Airflow environments, handling scheduling, monitoring, and troubleshooting of workflow executions. Develop custom operators and sensors to extend Airflow’s functionality for specific use cases.
Required Qualifications
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical discipline. At least 6 years of experience as a Software Engineer developing cloud-based applications. Proven hands-on expertise with AWS services and infrastructure, including compute, storage, networking, security, and serverless computing. Proficiency in programming languages such as Java, Python, or Scala, along with familiarity with modern software development methodologies and tools. Strong understanding of Big Data concepts, architectures, and technologies, with practical experience building both batch and streaming applications. Experience working with Big Data frameworks like Hadoop, Spark, Kafka, Athena, and related tools such as Hive, HBase, and Presto.
Preferred Qualifications and Benefits
Experian is a global leader in data and technology, serving businesses and individuals across industries such as financial services, healthcare, automotive, agribusiness, and insurance. As a FTSE 100 company with over 22,500 employees in 32 countries, Experian invests significantly in its people and cutting-edge technologies to unlock the power of data.
Our culture celebrates individuality and fosters an inclusive environment that values diversity, equity, and inclusion (DEI). We emphasize work-life balance, professional development, authenticity, engagement, collaboration, wellness, and recognition. Experian has been recognized as a Great Place To Work™ in 24 countries and is listed among FORTUNE’s Best Companies to Work For, as well as Glassdoor’s Best Places to Work globally.
We are proud to be an Equal Opportunity and Affirmative Action employer. Innovation flourishes through our diverse workforce, and we encourage employees to bring their whole selves to work. Accommodations are available for candidates with disabilities or special needs.
Experian supports employee well-being through comprehensive family benefits, enhanced medical coverage, and paid time off, reflecting our commitment to work-life balance, health, and safety.
Join Experian and contribute to building a better tomorrow with a team dedicated to innovation and excellence.