TEKsystems
REMOTE Data Engineer (W2 Only Databricks Experience Preferred)
TEKsystems, Atlanta, Georgia, United States, 30383
Our client is searching for a Senior Software Engineer specializing in SQL development that has experience with Databricks for a temp-to-perm position that can be worked remotely.
All candidates must work directly for TEKsystems on a W2 basis before converting to full-time employment of our client.
This role provides technical expertise to software development projects and the development and implementation of database management system solutions.
Most of this work will involve database development and experience with Azure Synapse or Databricks is required.
Duties:
● Defines IT software and database solutions by working with enterprise architecture teams and IT leadership.
● Effectively plans and manages assignments spanning multiple projects
● Collaborates with data scientists and analysts to provide data-driven solutions and insights.
● Drives technical and procedural change relative to best practices in software and database development
● Defines test strategies and procedures to drive total quality across IT systems
● Clearly communicates project issues and status with the project team and IT leadership.
● Integrates new data engineering tools with other data storage and processing systems.
● Ensures data security and compliance with data governance policies.
● Builds and maintains data pipelines and workflows.
● Develops and optimizes Spark-based data processing applications.
● Implements data transformations and aggregations for large datasets.
● Troubleshoots and debugs data-related issues.
● Develops in languages like PySpark and Python
● Preprocess of structured and unstructured data
● Analyzes, transforms, and creates SQL queries
Key Qualifications:
● Experience in all phases of the software/database development cycle is required.
● Experience with Python and Spark in Databricks required.
● Experience with Terraform is highly desirable.
● Working experience in CI/CD deployments required.
● Must have experience using Microsoft Visual Studio and understanding of the C# programming language
● Must have experience building data services in use of SQL stored procedures, functions, or other platform constructs.
● Experience using cloud-based data technologies and/or MPP database systems is highly desirable.
● Must be able to read, analyze, and interpret business requirements and translate those into functioning computer software that executes in a relational database system.
● Must be able to write reports, business correspondence, and procedure manuals.
● Must be able to effectively present information and respond to questions from groups of managers, clients, and other associates.
● Must be able to effectively communicate verbally and in writing business issues and needs.
● Must be proactive, have teamwork abilities, be self-motivated, possess competent judgment and be deadline oriented
● Excellent analytical, problem-solving and troubleshooting skills.
All employees must be willing to submit to a drug and background check
o Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following:
§ Medical, dental & vision
§ Critical Illness, Accident, and Hospital
§ 401(k) Retirement Plan – Pre-tax and Roth post-tax contributions available
§ Life Insurance (Voluntary Life & AD&D for the employee and dependents)
§ Short and long-term disability
§ Health Spending Account (HSA)
§ Transportation benefits
§ Employee Assistance Program
§ Time Off/Leave (PTO, Vacation or Sick Leave)
About TEKsystems:
We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.
The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.
All candidates must work directly for TEKsystems on a W2 basis before converting to full-time employment of our client.
This role provides technical expertise to software development projects and the development and implementation of database management system solutions.
Most of this work will involve database development and experience with Azure Synapse or Databricks is required.
Duties:
● Defines IT software and database solutions by working with enterprise architecture teams and IT leadership.
● Effectively plans and manages assignments spanning multiple projects
● Collaborates with data scientists and analysts to provide data-driven solutions and insights.
● Drives technical and procedural change relative to best practices in software and database development
● Defines test strategies and procedures to drive total quality across IT systems
● Clearly communicates project issues and status with the project team and IT leadership.
● Integrates new data engineering tools with other data storage and processing systems.
● Ensures data security and compliance with data governance policies.
● Builds and maintains data pipelines and workflows.
● Develops and optimizes Spark-based data processing applications.
● Implements data transformations and aggregations for large datasets.
● Troubleshoots and debugs data-related issues.
● Develops in languages like PySpark and Python
● Preprocess of structured and unstructured data
● Analyzes, transforms, and creates SQL queries
Key Qualifications:
● Experience in all phases of the software/database development cycle is required.
● Experience with Python and Spark in Databricks required.
● Experience with Terraform is highly desirable.
● Working experience in CI/CD deployments required.
● Must have experience using Microsoft Visual Studio and understanding of the C# programming language
● Must have experience building data services in use of SQL stored procedures, functions, or other platform constructs.
● Experience using cloud-based data technologies and/or MPP database systems is highly desirable.
● Must be able to read, analyze, and interpret business requirements and translate those into functioning computer software that executes in a relational database system.
● Must be able to write reports, business correspondence, and procedure manuals.
● Must be able to effectively present information and respond to questions from groups of managers, clients, and other associates.
● Must be able to effectively communicate verbally and in writing business issues and needs.
● Must be proactive, have teamwork abilities, be self-motivated, possess competent judgment and be deadline oriented
● Excellent analytical, problem-solving and troubleshooting skills.
All employees must be willing to submit to a drug and background check
o Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following:
§ Medical, dental & vision
§ Critical Illness, Accident, and Hospital
§ 401(k) Retirement Plan – Pre-tax and Roth post-tax contributions available
§ Life Insurance (Voluntary Life & AD&D for the employee and dependents)
§ Short and long-term disability
§ Health Spending Account (HSA)
§ Transportation benefits
§ Employee Assistance Program
§ Time Off/Leave (PTO, Vacation or Sick Leave)
About TEKsystems:
We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.
The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.