Programmer Analyst/Software Developer

Deerfield, Not Specified

Employer: Tata Consultancy Service Limited
Industry: Technology
Salary: Competitive
Job type: Full-Time
  • Extract Transform and Load data from Sources Systems to Azure Data Storage services and Snowflake using a combination of Azure Data Factory, Azure DataBricks. Data Ingestion to one or more Azure Services - (Azure Data Lake, Azure Storage) and processing the data in In Azure Databricks.
  • Created Pipelines in ADF using Linked Services/Datasets/Pipeline/ to Extract, Transform and load data from different sources like Azure SQL, Blob storage, Azure SQL Data warehouse, write-back tool and backwards.
  • Worked on migration of data from Teradata server to Cloud databases (Snowflake).
  • Extracted data from Snowflake to Azure DataLake through Databricks notebooks.
  • Extracted data from Azure DataLake to Snowflake through Databricks notebooks.
  • Worked on Data Ingestion from one environment to other environments through storage explorer.
  • Build Complex distributed systems involving huge amount data handling, collecting metrics building data pipeline, and Analytics.
  • Worked on Snowflake warehouses and Databases.
  • Extracted, transformed and loaded the data into snowflake warehouses.
  • Develop and implement database solutions in Azure SQL Data Warehouse, Azure SQL.
  • Develop & implement medium to large scale BI solutions on Azure using Azure Data Platform services (Azure Data Lake, Data Factory, Data Bricks and Azure SQL DW)
  • Have good experience working with Azure BLOB and Data lake storage.
  • Have extensive experience in creating pipeline jobs, scheduling triggers, and Mapping data flows using Azure Data Factory (V2) and using Key Vaults to store credentials.
  • Data Ingestion to one or more Azure Services - (Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and processing the data in In Azure Databricks.
Created: 2024-05-04
Reference: 311077
Country: United States
State: Not Specified
City: Deerfield