Azure Data Engineer

Tata Consultancy Services (TCS) is a global leader in IT and business solutions, employing over 612,000 professionals across 55 countries and generating USD 29.08 billion in revenue for the 2023-24 fiscal year. TCS offers a comprehensive suite of services including Cloud Infrastructure, Cognitive Business Operations, Cybersecurity, Consulting, Enterprise solutions, Internet of Things / Digital engineering, and Data and Analytics. As one of India's largest equal opportunity employers, TCS has more than one lakh female associates and is consistently recognized as a leader in 'India's Most Respected Companies' surveys.

We are seeking an experienced Azure Data Engineer to join our team. This role involves providing expertise in Azure stacks, specifically Azure Databricks and Azure Data Factory, for solution design and technical implementation. You will be responsible for designing, coding, unit testing, and reviewing iterative improvements to data platforms, ensuring adherence to sound architecture principles. The position requires building and maintaining the infrastructure for data products, including data pipelines, storage systems, and processing engines, while ensuring scalability, reliability, and performance. Collaboration with Data Architects and Domain Data Stewards is key to designing and implementing data solutions that meet business requirements and align with Data Mesh principles.

• Provide Azure stacks (ADB and ADF) technology expertise for solution design and technical implementation.
• Design, code, unit test, and conduct code reviews for iterative improvements to the platform.
• Ensure adherence to sound architectural principles.
• Build and maintain the infrastructure for data products, including data pipelines, storage systems, and processing engines.
• Ensure the scalability, reliability, and performance of data infrastructure, optimizing resource utilization and minimizing downtime.
• Collaborate with Data Architects and Domain Data Stewards to design and implement data solutions that align with business requirements and Data Mesh principles.

• Proficiency in Azure Databricks, Azure Data Factory, Python, PySpark, SQL, ETL, and CI/CD.
• Demonstrated experience in implementing projects using Azure stacks.
• Hands-on experience with Azure Databricks and Azure Data Factory.
• Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, and SYNAPSE Analytics.
• Proficiency in data ingestion, curation, and transformation using Spark.

• This position is based in Mumbai, Bangalore, Chennai, Hyderabad, or Gurugram.
• The required experience level is 5-15 years.