Artmac
Senior Big Data Engineer - Java, Scala, Spark, Azure
Artmac, Atlanta, Georgia, United States, 30383
3 weeks ago Be among the first 25 applicants
Get AI-powered advice on this job and more exclusive features.
Who We Are
Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to customers.
Job Description
Job Title: Senior Big Data Engineer – Java, Scala, Spark, Azure
Job Type: C2C
Experience: 7-8 Years
Location: Atlanta, Georgia
Responsibilities
Minimum of 7+ Years of experience in IT
Proficient in Java and fixing/redesigning native libraries
Create Scala jobs for data transformation and aggregation with a focus on the functional programming paradigm.
Knowledge of Python
Familiarity with Unix scripting
Demonstrate issues faced in implementation and performance tuning experience in previous project and best practices following in performance implementations
Help in designing, building, and enhancing platform and ensure that developed components are testable, repeatable, highly performant, scalable, and automated.
Produce unit tests for Spark transformations and helper methods
Write Scala doc-style documentation with all code & design data processing pipelines
Spark query tuning and performance optimization
Batch interfaces and Real-time interfaces like Kafka messaging
Good presentation and communication skills to express what is being worked on day-to-day activities
Past experience in BigData development is preferable (Streaming on Apache Flink or Apache Spark) or else should be able to demonstrate conceptual differences between batch and streaming data processing
Past experience in DataWarehouse/ETL/SQL development is preferable who can understand the E2E data flow or the application architecture
Azure Integration and deployment experience
Quick learner who can come out with alternate options to solve an application problem
Qualification
Bachelor’s degree in software engineering or computer science.
Seniority level
Mid-Senior level Employment type
Contract Job function
Engineering and Information Technology Industries
Software Development
#J-18808-Ljbffr
Mid-Senior level Employment type
Contract Job function
Engineering and Information Technology Industries
Software Development
#J-18808-Ljbffr