CAPGEMINI ENGINEERING
Azure Databricks Engineer
CAPGEMINI ENGINEERING, Bridgewater, Massachusetts, us, 02324
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired bya collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizationsunlock the value of technology and build a more sustainable, more inclusive world.
Job Location : Princeton NJ (Hybrid)
Key Responsibilities
The Databricks Engineer will be responsible for developing and maintaining data pipelines to read partner files from AWS S3 transform the data using Databricks and assist in the migration from Snowflake to Azure Databricks.This role requires working closely with the Databricks Architect to ensure the successful implementation of data solutionsDevelop and manage data pipelines to read and process partner files from AWS S3 using Azure Databricks.Implement transformations using Python and Spark to prepare data for loading into Snowflake and Azure DatabricksAssist with the migration of data objects schema and databases from Snowflake to Azure DatabricksWork with the Databricks Architect to ensure efficient design and implementation of data transformation and migration activitiesPerform unit testing and troubleshooting of data pipelinesEnsure best practices are followed for coding security and data qualityRequired Skills
Experience in developing data pipelines with Azure Databricks Spark and Python.Strong understanding of AWS S3 Snowflake and data migration concepts.Proficiency in SQL for data querying transformation and analysis.Experience with unit testing debugging and troubleshooting data pipelines.Good communication skills and ability to work in a collaborative team environment.Life At Capgemini
Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer:
Flexible workHealthcare including dental, vision, mental health, and well-being programsFinancial well-being programs such as 401(k) and Employee Share Ownership PlanPaid time off and paid holidaysPaid parental leaveFamily building benefits like adoption assistance, surrogacy, and cryopreservationSocial well-being benefits like subsidized back-up child/elder care and tutoringMentoring, coaching and learning programsEmployee Resource GroupsDisaster Relief
Disclaimer
Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.
This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.
Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.
Click the following link for more information on your rights as an Applicant http://www.capgemini.com/resources/equal-employment-opportunity-is-the-law
Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fuelled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion.
Job Location : Princeton NJ (Hybrid)
Key Responsibilities
The Databricks Engineer will be responsible for developing and maintaining data pipelines to read partner files from AWS S3 transform the data using Databricks and assist in the migration from Snowflake to Azure Databricks.This role requires working closely with the Databricks Architect to ensure the successful implementation of data solutionsDevelop and manage data pipelines to read and process partner files from AWS S3 using Azure Databricks.Implement transformations using Python and Spark to prepare data for loading into Snowflake and Azure DatabricksAssist with the migration of data objects schema and databases from Snowflake to Azure DatabricksWork with the Databricks Architect to ensure efficient design and implementation of data transformation and migration activitiesPerform unit testing and troubleshooting of data pipelinesEnsure best practices are followed for coding security and data qualityRequired Skills
Experience in developing data pipelines with Azure Databricks Spark and Python.Strong understanding of AWS S3 Snowflake and data migration concepts.Proficiency in SQL for data querying transformation and analysis.Experience with unit testing debugging and troubleshooting data pipelines.Good communication skills and ability to work in a collaborative team environment.Life At Capgemini
Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer:
Flexible workHealthcare including dental, vision, mental health, and well-being programsFinancial well-being programs such as 401(k) and Employee Share Ownership PlanPaid time off and paid holidaysPaid parental leaveFamily building benefits like adoption assistance, surrogacy, and cryopreservationSocial well-being benefits like subsidized back-up child/elder care and tutoringMentoring, coaching and learning programsEmployee Resource GroupsDisaster Relief
Disclaimer
Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.
This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.
Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.
Click the following link for more information on your rights as an Applicant http://www.capgemini.com/resources/equal-employment-opportunity-is-the-law
Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fuelled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion.