Opening Summary

We are seeking a talented and experienced Big Data Engineer with a passion for data management and analytics to join our team. The ideal candidate will have 4+ years of relevant experience with SQL, Hive, Spark and basic Unix shell scripting skills. The candidate must be familiar with ETL (Extract, Transform, Load) processes and be able to work with large data sets.

Requirements

• 4+ years of relevant experience in big data engineering
• Strong proficiency in SQL, Hive, Spark and basic Unix shell scripting
• Solid understanding of ETL processes
• Experience working with large data sets
• Familiarity with data modeling and data warehousing concepts
• Excellent problem-solving skills and attention to detail
• Strong communication skills and ability to work in a team environment

Responsibilities

• Develop and maintain scalable and high-performance big data solutions
• Design, develop and implement ETL processes
• Perform data analysis and data profiling to ensure data quality and integrity
• Collaborate with cross-functional teams including data scientists, business analysts, and product
• Managers to identify and solve complex business problems
• Develop and maintain documentation, including technical specifications and user guides
• Conduct code reviews and mentor junior team members

Preferred Qualification

Experience with Pig, Java, Go, NiFi and PySpark Worked on AMEX projects or experience in FSS domain Knowledge of distributed computing, Hadoop ecosystem, and NoSQL databases

Notes

• If you are passionate about big data and are looking for a challenging and rewarding opportunity, we encourage you to apply for this position.