KYYBA
Databricks engineer only W2
KYYBA, Boston, Massachusetts, us, 02298
Job Description
Responsibilities: 4+ years of Databricks Experience 1+ years of AirFlow Experience 1+ years of IBM StreamSet Experience Develop Data Engineering and ML pipelines in Databricks and different AWS services, including S3, EC2, API, RDS, Kinesis/Kafka, and Lambda to build serverless applications. Solid understanding of Databricks fundamentals/architecture and hands-on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering, ML, and SQL warehouse). Knowledge of medallion architecture, DLT, and unity catalog within Databricks. Experience in migrating data from on-prem Hadoop to Databricks/AWS. Understanding of core AWS services, uses, and AWS architecture best practices. Hands-on experience in different domains, like database architecture, business intelligence, machine learning, advanced analytics, big data, etc. Solid knowledge of Airflow. Solid knowledge of CI/CD pipeline in AWS technologies. Application migration of RDBMS, Java/Python applications, model code, elastic, etc. Solid programming background in Scala, Python, SQL. Company Description
About Kyyba: Founded in 1998 and headquartered in Farmington Hills, MI, Kyyba has a global presence delivering high-quality resources and top-notch recruiting services, enabling businesses to effectively respond to organizational changes and technological advances. At Kyyba, the overall well-being of our employees and their families is important to us. We are proud of our work culture which embodies our core values; incorporating value, passion, excellence, empowerment, and happiness, creating a vibrant and productive atmosphere. We empower our employees with the resources, incentives, and flexibility that they need to support a healthy, balanced, and fulfilling career by providing many valuable benefits and a balanced compensation structure combined with career development.
#J-18808-Ljbffr
Responsibilities: 4+ years of Databricks Experience 1+ years of AirFlow Experience 1+ years of IBM StreamSet Experience Develop Data Engineering and ML pipelines in Databricks and different AWS services, including S3, EC2, API, RDS, Kinesis/Kafka, and Lambda to build serverless applications. Solid understanding of Databricks fundamentals/architecture and hands-on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering, ML, and SQL warehouse). Knowledge of medallion architecture, DLT, and unity catalog within Databricks. Experience in migrating data from on-prem Hadoop to Databricks/AWS. Understanding of core AWS services, uses, and AWS architecture best practices. Hands-on experience in different domains, like database architecture, business intelligence, machine learning, advanced analytics, big data, etc. Solid knowledge of Airflow. Solid knowledge of CI/CD pipeline in AWS technologies. Application migration of RDBMS, Java/Python applications, model code, elastic, etc. Solid programming background in Scala, Python, SQL. Company Description
About Kyyba: Founded in 1998 and headquartered in Farmington Hills, MI, Kyyba has a global presence delivering high-quality resources and top-notch recruiting services, enabling businesses to effectively respond to organizational changes and technological advances. At Kyyba, the overall well-being of our employees and their families is important to us. We are proud of our work culture which embodies our core values; incorporating value, passion, excellence, empowerment, and happiness, creating a vibrant and productive atmosphere. We empower our employees with the resources, incentives, and flexibility that they need to support a healthy, balanced, and fulfilling career by providing many valuable benefits and a balanced compensation structure combined with career development.
#J-18808-Ljbffr