Data Engineer
Location: Bengaluru, Gurgaon, Pune
Job code: 101088
Posted on: Dec 20, 2024
About Us:
AceNet Consulting is a fast-growing global business and technology consulting firm specializing in business strategy, digital transformation, technology consulting, product development, start-up advisory and fund-raising services to our global clients across banking & financial services, healthcare, supply chain & logistics, consumer retail, manufacturing, eGovernance and other industry sectors.
We are looking for hungry, highly skilled and motivated individuals to join our dynamic team. If you’re passionate about technology and thrive in a fast-paced environment, we want to hear from you.
Job Summary:
We are seeking a highly skilled Data Engineer with expertise in Scala, Spark, Azure Synapse, Azure Data Factory (ADF), and SQL to join our dynamic team. In this role, you will be responsible for designing, developing, and optimizing data pipelines, ensuring efficient data integration, and supporting analytics initiatives on cloud-based platforms.
Key Responsibilities:
*Data Pipeline Development: Design and implement robust data pipelines using Scala and Spark for efficient data processing and transformation.
*Cloud Data Integration: Leverage Azure Synapse and ADF to build scalable data integration solutions and workflows.
*Database Management: Write and optimize complex SQL queries to support data extraction, transformation, and loading (ETL) processes.
*Data Quality and Governance: Ensure high data quality, security, and compliance with organizational standards and policies.
*Performance Optimization: Monitor and optimize the performance of data pipelines and storage systems.
*Collaboration: Work closely with data analysts, data scientists, and other stakeholders to understand requirements and deliver actionable insights.
Role Requirements and Qualifications:
*Proven experience in data engineering with expertise in Scala, Spark, and SQL.
*Hands-on experience with Azure Synapse Analytics and Azure Data Factory (ADF).
*Strong understanding of cloud-based data architectures and data processing frameworks.
*Knowledge of data warehousing, ETL processes, and data modeling.
*Familiarity with additional Azure services such as Azure Databricks, Azure Data Lake, or Azure DevOps.
*Experience in implementing CI/CD pipelines for data workflows.
*Understanding of big data ecosystems and distributed systems.
Why Join Us:
*Opportunities to work on transformative projects, cutting-edge technology and innovative solutions with leading global firms across industry sectors.
*Continuous investment in employee growth and professional development with a strong focus on up & re-skilling.
*Competitive compensation & benefits, ESOPs and international assignments.
*Supportive environment with healthy work-life balance and a focus on employee well-being.
*Open culture that values diverse perspectives, encourages transparent communication and rewards contributions.
How to Apply:
If you are interested in joining our team and meet the qualifications listed above, please apply and submit your resume highlighting why you are the ideal candidate for this position.