Data Engineer

Job ID Number R4203 Employment Type Full time Worksite Flexibility Remote Job Summary As the Data Engineer, you will take the lead in providing complex application development services in the client's Google Cloud Platform environment. Job Description We are looking for a Data Engineer to join our team for a 6-month contract opportunity that is full time and fully remote. The selected candidate will take the lead in providing complex application development services in the clients Google Cloud Platform environment, typically as part of a project team or in an application support role. The selected candidate will analyze, design, code, test and implement more complex systematic solutions. They also provide general support to maintain more complex applications that meet the service levels, system availability, performance and quality levels required. What Youll Do Takes a lead role for analyzing, designing, coding, testing and implementing more complex application enhancements, as well as providing general production support, meeting defined scope, target dates and budgets with minimal or no defects. Utilize and participate in the more complex full system development life cycle, per current Highmark SDLC standards. Take a lead role in collaborating with customers, business analysts, partners, and IT team members to understand business requirements that drive the analysis and design of quality technical solutions. Concentrate on providing innovative solutions to more complex business needs. Perform work in compliance with all Highmark and Highmark IT standards, policies and procedures. Actively take a leading role and participates on project teams in various project roles, including, but not limited to, Developer, Technical Lead and Project Manager, based upon level of experience. Effectively communicate with team members, customers, partners and management, including assisting with or conducting more complex technical walkthroughs, reporting project status, enabling vendor solutions and providing accurate and concise documentation. Other duties as assigned or requested. What Youll Need Required Bachelors degree in Information Technology, Computer Science or closely related field 5 years of experience as a developer 3 years of experience in Databricks technology and be experienced in working with Databricks notebooks, clusters, and jobs. They should be able to optimize and troubleshoot Databricks workflows. Deep understanding of Spark and its core concepts Proficient in Spark programming Python, Pyspark Strong data engineering skills, including experience with data ingestion (batch and streaming), data transformation, and data quality validation. Familiar with ETL and have hands-on experience with data pipelines and data orchestration tools Expertise with GCP, including services like Google Cloud Storage, BigQuery, Pub/Sub, and Dataflow Problem solving, root cause analysis, and issue resolution Demonstrated leadership skills Experience in Healthcare or Health Insurance Industry Experience with Databricks, GCP, application development tools, business processes, software development life cycle used by Highmark enterprise Preferred Masters degree in Information Technology, Computer Science or closely related field 5 years of experience as a developer with demonstrated skills in: Databricks and Python/Pyspark GCP: Big Query and PostgreSQL Certifications such as Python, Databricks, GCP Physical Demands Ability to safely and successfully perform the essential job functions consistent with the ADA and other federal, state and local standards Sedentary work that involves sitting or remaining stationary most of the time with occasional need to move around the office to attend meetings, etc. Ability to conduct repetitive tasks on a computer, utilizing a mouse, keyboard and monitor LI-JM1 Reasonable Accommodation Statement If you require a reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employment selection process, please direct your inquiries to application.accommodationscai.io or (888) 824 8111. Equal Employment Opportunity Policy Statement It is the policy of CAI not to discriminate against any employee or applicant due to race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or being a protected veteran. It is also the policy of CAI to take affirmative action to employ and to advance in employment, all persons regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or being a protected veteran, and to base all employment decisions only on valid job requirements. This policy shall apply to all employment actions, including but not limited to recruitment, hiring, upgrading, promotion, transfer, demotion, layoff, recall, termination, rates of pay or other forms of compensation and selection for training, including apprenticeship, at all levels of employment. Employees and applicants of CAI will not be subject to harassment due to race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or being a protected veteran. Additionally, retaliation, including intimidation, threats, or coercion, because an employee or applicant has objected to discrimination, engaged or may engage in filing a complaint, assisted in a review, investigation, or hearing or have otherwise sought to obtain their legal rights under any Federal, State, or local EEO law is prohibited.