Data Engineer

About Centific

At Centific, people are at the center of our culture.We constantly seek out opportunities for people to enhance their skills,

and emphasize work-life balance for all our employees.We believe that competition can bring out the very best in people

– from our annual creative film and speech contests to our weekly office game tournaments,we mix work and play to engage our people and help our clients succeed.

About Job

Key Responsibilities:

• Develop and optimize PySpark-based ETL pipelines for processing large-scale data.
• Develop, test, and maintain robust Python applications.
• Collaborate with data engineers, analysts, and other developers to design and implement data solutions
• Work with Azure Data Lake, Azure Databricks, and Azure Data Factory to build scalable data solutions.
• Implement data classification, policy enforcement, and metadata extraction within Purview.
• Collaborate with data engineers and business teams to ensure smooth data flow across systems.
• Troubleshoot performance bottlenecks in Spark jobs and improve data pipeline efficiency.
• Ensure data security, compliance, and quality following best practices.

Required Skills & Qualifications:

• 3+ years of experience in Python and PySpark for big data processing.
• Proven experience as a Python Developer or similar role.
• Strong experience with Azure Data Services (Data Lake, Data Factory).
• Excellent problem-solving skills and ability to work in an agile environment.
• Excellent communication and teamwork abilities.

Centific is an equal opportunity employer. We aim to create an inclusive workplace and leverage the power of diversity. We are committed to providing a work environment free of discrimination and harassment. We do not discriminate or allow harassment on the basis of race, color, religion, disability, gender, national origin, sexual orientation, gender identity, gender expression, age, genetic information, military status or any other legally protected status. Workplace discrimination related to being pregnant and pregnancy-related harassment, including discrimination in the hiring process, is strictly prohibited in Centific Global Solutions.

Originally posted on Himalayas