Logo
Spectraforce Technologies

Data Engineer III

Spectraforce Technologies, North Chicago, Illinois, us, 60086


Project Name: UDH (United Data Hub)What is the length of the assignment? 8 months. Extension is expected at this timeTop 5 Skill sets 1. DevOps 2. AWS Cloud3. Terraform4. Python 5 CI/CD pipelinesNice to have skills or certifications:1. Blue-Green deployments 2. Kubernetes3. Ansible PlaybooksWork Location(s): Chicago Downtown, Willis TowerInterview Process:Will it be via video or in person? Both Video and In PersonHow many interviews do you anticipate? 2 Interview, first will be on Video followed by In-PersonRate Details, based on job title work location: Min $ 116.08 Max: $ 134.79THIS IS A ONSITE POSITION AT CHICAGO DOWNTOWN. CANDIDATE IS EXPECTED TO BE ONSITE 3-4 DAYS A WEEK. ***********************************************************************OVERVIEW/SUMMARYThe Product Analytics team at United Airlines is on a transformational journey to unlock the full potential of enterprise data, build a dynamic, diverse, and inclusive culture and develop a modern cloud-based data lake architecture to scale our applications, and drive growth using data and machine learning. Our objective is to enable the enterprise to unleash the potential of data through innovation and agile thinking, and to execute on an effective data strategy to transform business processes, rapidly accelerate time to market and enable insightful decision making.JOB OVERVIEW AND RESPONSIBILITIESIn this role you will partner with various teams to define and execute data acquisition, storage, transformation, processing and make data actionable for operational and analytics initiatives that create sustainable revenue and share growth. This role requires expertise in United's data sources and technology business intuition, and a working knowledge of data transformation and analytical tools. Support large scale data pipelines in a distributed and scalable environmentEnable and optimize production AWS environment for data infrastructure and frameworksExpert in creating Terraform modules to automate deploymentsKnowledge of Databricks and Datalake technologies Partner with development teams and other department leaders/stakeholders to provide cutting edge technical solutions that enable business capabilitiesParticipate and lead in design and development of innovative batch and streaming data applications using AWS technologiesProvide the team technical direction and approach to be undertaken and guide them in resolution of queries/issuesAWS CertificationKnowledge: Python, Bash scripting, PySpark, AWS Services (Airflow, Glue, Lambda, others), Terraform, DatabricksSkills: Thorough troubleshooter, Hands on AWS Technology leader, People person and ability to conclude an undertakingAbility: Solve problems under pressure and in constrained scenarios, Leadership, Making right judgementMust be fluent in English (written and spoken)Coordinate and guide cross-functional projects that involve team members across all areas of the enterprise, vendors, external agencies, and partnersAbility to manage multiple deliverables both short and long-term in a busy and aggressive environment, while staying flexible to dynamic needs and priority levelsManage agile development and delivery by collaborating with project manager, product owner and development leads REQUIRED Bachelor's degree in quantitative field (statistics, software engineering, business analytics, information systems, aviation management or related degree)5+ years of experience in data engineering or ETL development roleExperience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.Strong analytic skills related to working with structure, semi- structure, and unstructured datasets.Experience with Big Query, SQL server, etc.Experience with AWS cloud services: Redshift, S3, Athena, etc.Experience with SQL and various database interface tools: SSMS, Oracle SQL developer, etc.Passionate about solving problems through data and analytics, and creating data products including data modelsStrong initiative to take ownership of data-focused projects, get involved in the details of validation and testing, as well as provide a business user perspective to their workAbility to communicate complex quantitative concepts in a clear, precise, and actionable mannerProven proficiency with Microsoft Excel and PowerPointStrong problem-solving skills, using data to tackle problemsOutstanding writing, communication, and presentation skillsPREFERREDMaster's degreeExperience with Quantum Metrics and AkamaiExperience with languages: Python, R, etc.Strong experience with continuous integration & delivery using Agile methodologiesData engineering experience with transportation/airline industryStrong problem-solving skills Pre-Identified Candidate/Extension? NoIf yes, Enter Name of Applicant (No Value)Skill Level Senior Level (greater than 8 yrs exp.)