About the role
Required Skill Set: Data Lake architecture, Azure Services ADLS, ADF, Azure Databricks, Synapse
ADF, ADB, SQL, Pyspark, python
Good Knowledge of Data Brick lake house and Azure Data Lake concept • Knowledge of Data Bricks delta concept
Delta live tables (DLT) •
Strong hands-on experience in ELT pipeline development using Azure Data factory and Databricks Autoloader, Notebook scripting and Azure Synapse Activity Copy, Data Flow Task •
Strong knowledge of metadata-driven data pipeline, metadata management, dynamic logic •
In-depth knowledge of data storage solutions, including Azure Data Lake Storage (ADLS), and Azure Serverless SQL Pool. •
Experience with data transformation using Spark, and SQL technologies. • Solid understanding of design patterns, and best practices of the cloud stack. •
Experience with code management and version control using Git or similar tools. •
Strong problem-solving and debugging skills in ETL workflows and data pipelines. •
Strong understanding of Azure Data bricks and Azure Synapse internals features and capabilities. •
Knowledge of Azure DevOps and continuous integration and deployment (CI/CD) process. •
Knowledge of data quality and data profiling techniques, with experience in data validation and data cleansing.
Millions of jobs, with real people getting hired every day
Questions, answered
Click "Apply with JobAssist" – we tailor your resume and application to this role and submit it for your approval.
Yes. This role at Tata Consultancy Services was screened before publishing – we confirmed the employer before listing it.
The employer didn't disclose a salary range for this listing. JobAssist shows pay whenever it's available.
This position can be done from anywhere, with no in-office requirement.
Yes – every application is tailored from your profile and this job's requirements, and you can review and edit before it's sent.