Senior Data Engineer_446

Experience of 5 to 8 years.

Academic qualifications Required BE/B.Tech / MCA

Mandatory

• 5-8 years of experience in Big Data engineering with a focus on PySpark (Cloudera preferred), Databricks, and Azure Synapse.
• Strong expertise in PySpark for data processing and transformation.
• Hands-on experience with Databricks, including job monitoring, debugging, and optimization.
• Strong in SQL and Proficiency in writing and optimizing SQL queries in data warehousing solutions.
• Familiarity with Apache Oozie, Azure Data Factory or Airflow for scheduling and orchestrating data workflows.
• Solid understanding of Spark architecture and performance tuning techniques.
• Strong analytical and troubleshooting skills to debug and resolve data pipeline issues.
• Experience working in a Linux environment and managing cloud-based clusters.
• Strong analytical and computing skills and experience in working with Agile delivery teams, experience in conducting product and solution demos and trainings

Desirable:

• Domain Experience - Insurance/Banking/Finance
• Experience in performance tuning of Spark jobs and optimizing Databricks workloads.
• Knowledge of data governance and security best practices in Azure Synapse and Databricks.
• Familiarity with CI/CD pipelines and version control systems (e.g., Git).
• Awareness of modern data lake and data warehouse architectures

Your benefits:

·        We offer a hybrid work model which recognizes the value of striking a balance between in-person collaboration and remote working incl. up to 25 days per year working from abroad

·        We believe in rewarding performance and our compensation and benefits package includes a company bonus scheme, pension, employee shares program and multiple employee discounts (details vary by location)

·        From career development and digital learning programs to international career mobility, we offer lifelong learning for our employees worldwide and an environment where innovation, delivery and empowerment are fostered

·        Flexible working, health and wellbeing offers (including healthcare and parental leave benefits) support to balance family and career and help our people return from career breaks with experience that nothing else can teach

About Allianz Technology

Allianz Technology is the global IT service provider for Allianz and delivers IT solutions that drive the digitalization of the Group. With more than 11,000 employees located in 20 countries around the globe, Allianz Technology works together with other Allianz entities in pioneering the digitalization of the financial services industry.We oversee the full digitalization spectrum – from one of the industry’s largest IT infrastructure projects that includes data centers, networking and security, to application platforms that span from workplace services to digital interaction. In short, we deliver full-scale, end-to-end IT solutions for Allianz in the digital age.

D&I statement 

Allianz Technology is proud to be an equal opportunity employer encouraging diversity in the working environment. We are interested in your strengths and experience. We welcome all applications from all people regardless of gender identity and/or expression, sexual orientation, race or ethnicity, age, nationality, religion, disability, or philosophy of life.

Join us. Let´s care for tomorrow.

You. IT