Intelliswift
Data Engineer II
Intelliswift, Reading, Massachusetts, 01814
Pay rate range - $60/hr. to $65/hr. on W2 Onsite Required Skills & Experience 3 years of data engineering experience Experience with data modeling, warehousing, and building ETL pipelines Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS Master's degree in computer science, engineering, analytics, mathematics, statistics, IT or equivalent Experience with SQL Experience working on and delivering end-to-end projects independently Preferred Qualifications Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, Firehose, Lambda, and IAM roles and permissions Experience with non-relational databases/data stores (object storage, document or key-value stores, graph databases, column-family databases) Experience as a data engineer or related specialty (e.g., software engineer, business intelligence engineer, data scientist) with a track record of manipulating, processing, and extracting value from large datasets Experience with Apache Spark / Elastic Map Reduce Familiarity and comfort with Python, SQL, Docker, and Shell scripting. Java is preferred but not necessary. Experience with continuous delivery, infrastructure as code, and microservices, in addition to designing and implementing automated data solutions using Apache Airflow, AWS Step Functions, or equivalent Leadership Principals: Deliver Results, Ownership, Learn and be Curious Day to Day: As a Data Engineer you will be working in one of the world's largest and most complex data warehouse environments. You will develop and support the analytic technologies that give our customers timely, flexible, and structured access to their data. You will be responsible for designing and implementing complex data models to scale research and simulations. You will work with business customers to understand the business requirements and implement solutions to support analytical and reporting needs. -Partnering with scientists to assist with algorithms and research -Creation of data modules Team projects: for designing and implementing complex data models to scale research and simulations Responsibilities: As a Data Engineer you will be working in one of the world's largest and most complex data warehouse environments. You will develop and support the analytic technologies that give our customers timely, flexible, and structured access to their data. You will be responsible for designing and implementing complex data models to scale research and simulations. You will work with business customers to understand the business requirements and implement solutions to support analytical and reporting needs.