Sogeti
Databricks Architect
Sogeti, Kansas City, Kansas, United States, 66115
Sogeti is a leading provider of professional technology services, specializing in Application Management, Infrastructure Management and High-Tech Engineering. Sogeti offers cutting-edge solutions around Testing, Business Intelligence, Mobility, Cloud and Security, combining world class methodologies and the global delivery model, Rightshore®. Sogeti brings together more than 20,000 professionals in 15 countries and is present in over 100 locations in Europe, the US and India. Sogeti is a wholly-owned subsidiary of Cap Gemini S.A., listed on the Paris Stock Exchange.
At Sogeti USA, we are committed to building a long and enduring relationship with our employees and to creating an environment that rewards and empowers. Our mission is to constantly exceed our employees' expectations in the same way that we strive to exceed our clients' expectations. We offer an environment that celebrates innovation and helps you to achieve a good balance between your professional and personal life. We strive to be an employer of choice!
What You’ll Do
10+ years Data Architecture design and implementation experienceBanking/financial service domain experience is a big plusResponsible for architecture, design, and development of end-to-end pipelines on Azure using ADF for orchestration and Databricks for writing necessary business logic using PySpark, SQL.Experience and familiarity with Azure services such as Synapse, Azure Functions, Monitors, ADLS, Data Lakehouse, Medallion Architecture etc.,Ability to develop and enhance custom frameworks using Databricks notebooks using Python, Spark to implement more efficient ELT processes.Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.Working with stakeholders including data, design, product, and executive teams and assisting them with data-related technical issues.Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing for greater scalability, etc.Experience working with and supporting cross-functional teams (Data Scientists, Architects, Analytics SMEs etc.,) in a dynamic environment.Build processes supporting data transformation, data structures, metadata, dependency, and workload management •Databricks - Compute cluster configuration options, best practices, guidance, etc. •Databricks - Performance and Optimization options (optimize, z-order, liquid clustering, etc.)Databricks - Business continuity / disaster recovery / data backups •Databricks - Environment management (dev/qa/prod/etc.)Databricks- DBA-like operations (vacuum file cleanup, partitioning, file size tuning, etc.) •Databricks - Expertise with architecture/admin/advance usage skillsets • Experience working with Azure Stream Analytics - Good to haveExperience working with Azure Machine Learning & MLFlow - - Good to haveMinimum education qualification
Bachelor's Degree in Computer Science, Computer Engineering, MIS or related field.The benefits our employees enjoy:
401(k) Savings Plan- Matched 150% up to 6%. (Our 401k is in the top 1% of 401(k) plans offered in the US!)Medical/Prescription/Dental/Vision Coverage!Low-premium and deductible. Plan with free preventive care.$12,000 in Tuition Reimbursement100% Company-paid mobile phone planPersonal Time Off (PTO)- Ensuring a balance of work and home life
At Sogeti USA, we are committed to building a long and enduring relationship with our employees and to creating an environment that rewards and empowers. Our mission is to constantly exceed our employees' expectations in the same way that we strive to exceed our clients' expectations. We offer an environment that celebrates innovation and helps you to achieve a good balance between your professional and personal life. We strive to be an employer of choice!
What You’ll Do
10+ years Data Architecture design and implementation experienceBanking/financial service domain experience is a big plusResponsible for architecture, design, and development of end-to-end pipelines on Azure using ADF for orchestration and Databricks for writing necessary business logic using PySpark, SQL.Experience and familiarity with Azure services such as Synapse, Azure Functions, Monitors, ADLS, Data Lakehouse, Medallion Architecture etc.,Ability to develop and enhance custom frameworks using Databricks notebooks using Python, Spark to implement more efficient ELT processes.Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.Working with stakeholders including data, design, product, and executive teams and assisting them with data-related technical issues.Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing for greater scalability, etc.Experience working with and supporting cross-functional teams (Data Scientists, Architects, Analytics SMEs etc.,) in a dynamic environment.Build processes supporting data transformation, data structures, metadata, dependency, and workload management •Databricks - Compute cluster configuration options, best practices, guidance, etc. •Databricks - Performance and Optimization options (optimize, z-order, liquid clustering, etc.)Databricks - Business continuity / disaster recovery / data backups •Databricks - Environment management (dev/qa/prod/etc.)Databricks- DBA-like operations (vacuum file cleanup, partitioning, file size tuning, etc.) •Databricks - Expertise with architecture/admin/advance usage skillsets • Experience working with Azure Stream Analytics - Good to haveExperience working with Azure Machine Learning & MLFlow - - Good to haveMinimum education qualification
Bachelor's Degree in Computer Science, Computer Engineering, MIS or related field.The benefits our employees enjoy:
401(k) Savings Plan- Matched 150% up to 6%. (Our 401k is in the top 1% of 401(k) plans offered in the US!)Medical/Prescription/Dental/Vision Coverage!Low-premium and deductible. Plan with free preventive care.$12,000 in Tuition Reimbursement100% Company-paid mobile phone planPersonal Time Off (PTO)- Ensuring a balance of work and home life