Tata Consultancy Services
ETL Lead
Tata Consultancy Services, Pleasanton, California, United States, 94566
Must Have Technical/Functional Skills Informatica IICS, Orace, Databricks,SQL, Python, Databricks.
Experience Required
o 10Plus years of experience in the analysis, design,development, testing and maintenance of ETL/ELT solutions
o Strongexperience in the areas of Data Integration, Data Warehousing, applicationintegration and Business Intelligence as an SME/Architect, showcasing deepknowledge of the platform's capabilities
o Knowledgeof Informatica products: Intelligent Data Management Cloud or (IICS),Informatica Power Center (10.4), Data Quality, Power Exchange and MDM.
o Knowledgeof connecting IICS to popular cloud platforms like Azure
o Designend-to-end ETL processes using Python to extract, transform, and load data fromdiverse sources into a centralized data warehouse.
o Worked onjoin, filter, aggregator, router, sorter, sequence generator, hierarchy-parser,expression transformations in informatica cloud IICS- Data Integration.
o Experienceworking with Informatica IICS tool effectively using it for Data Migration frommultiple source systems
o Demonstratedsuccess in building Restful API Integration, SOAP (WSDL) using IICS.
o Developmodular and scalable ETL workflows, ensuring efficient data processing andseamless integration with downstream applications.
o IntegrateData bricks with data lakes and data warehouses like AWS S3, Azure Data LakeStorage.
o Strongknowledge in Data warehousing concepts, Relational Database Management Systemsand Dimensional modeling.
o Experiencewith database systems like SQL Server, Oracle, MySQL, and Mongo DB.
o ImplementAzure Data bricks cluster, notebooks, jobs and auto scaling.
o PrepareTechnical Design documents, Run books after completion of development.
o Knowledgeon Python Scripting.
o Goodworking experience in Agile and Waterfall methodologies.
Roles & Responsibilities
o Lead theoverall Data ingestion, ETL process.
o &nb sp; Quicklyadapt to standard policies/procedures processes and business needs.
o Provideoversight and solutions to address gaps in application functionality, dataquality, and performance related issues and executing/revising/Updating, andSQL code to respond to different maintenance requests.
o Lead theautomation effort by developing scripts in Unix and or Python
o Handleperformance challenges and incorporate best practice to improve efficiency.
Generic Managerial Skills •Goodcollaboration & communication skills, the ability to participate in aninterdisciplinary team. •Strongwritten communications and documentation experience •Abilityto work on several work streams with excellent time management. •Able toformulate and execute solutions to take into consideration the needs ofmultiple stakeholders. •Apositive, constructive approach with an emphasis on collaboration and goodexecution.
Salary Range: 100,000-$140,000 a year
Experience Required
o 10Plus years of experience in the analysis, design,development, testing and maintenance of ETL/ELT solutions
o Strongexperience in the areas of Data Integration, Data Warehousing, applicationintegration and Business Intelligence as an SME/Architect, showcasing deepknowledge of the platform's capabilities
o Knowledgeof Informatica products: Intelligent Data Management Cloud or (IICS),Informatica Power Center (10.4), Data Quality, Power Exchange and MDM.
o Knowledgeof connecting IICS to popular cloud platforms like Azure
o Designend-to-end ETL processes using Python to extract, transform, and load data fromdiverse sources into a centralized data warehouse.
o Worked onjoin, filter, aggregator, router, sorter, sequence generator, hierarchy-parser,expression transformations in informatica cloud IICS- Data Integration.
o Experienceworking with Informatica IICS tool effectively using it for Data Migration frommultiple source systems
o Demonstratedsuccess in building Restful API Integration, SOAP (WSDL) using IICS.
o Developmodular and scalable ETL workflows, ensuring efficient data processing andseamless integration with downstream applications.
o IntegrateData bricks with data lakes and data warehouses like AWS S3, Azure Data LakeStorage.
o Strongknowledge in Data warehousing concepts, Relational Database Management Systemsand Dimensional modeling.
o Experiencewith database systems like SQL Server, Oracle, MySQL, and Mongo DB.
o ImplementAzure Data bricks cluster, notebooks, jobs and auto scaling.
o PrepareTechnical Design documents, Run books after completion of development.
o Knowledgeon Python Scripting.
o Goodworking experience in Agile and Waterfall methodologies.
Roles & Responsibilities
o Lead theoverall Data ingestion, ETL process.
o &nb sp; Quicklyadapt to standard policies/procedures processes and business needs.
o Provideoversight and solutions to address gaps in application functionality, dataquality, and performance related issues and executing/revising/Updating, andSQL code to respond to different maintenance requests.
o Lead theautomation effort by developing scripts in Unix and or Python
o Handleperformance challenges and incorporate best practice to improve efficiency.
Generic Managerial Skills •Goodcollaboration & communication skills, the ability to participate in aninterdisciplinary team. •Strongwritten communications and documentation experience •Abilityto work on several work streams with excellent time management. •Able toformulate and execute solutions to take into consideration the needs ofmultiple stakeholders. •Apositive, constructive approach with an emphasis on collaboration and goodexecution.
Salary Range: 100,000-$140,000 a year