INSPYR Solutions
Senior Data Engineer
INSPYR Solutions, San Francisco, California, United States, 94199
Title:
Senior Data Engineer
Location:
Remote
Duration:
6 - 12 months
Compensation:
$80 - $90 an hour
Work Requirements:
US Citizen, GC Holders or Authorized to Work in the U.S.
Description
We are seeking a skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure to support the organization's data-driven initiatives. This position is based on the Databricks platform, and we are looking for candidates with expertise in building scalable and efficient data pipelines.
ResponsibilitiesCollaborate with cross-functional teams to understand data requirements and design scalable data solutions on the Databricks platform.Develop and maintain ETL processes to ingest, transform, and load data from various sources into Databricks Delta Lake.Design and implement data models and schemas to ensure data accuracy, consistency, and reliability.Optimize and tune data pipelines for performance and efficiency.Work closely with data scientists, analysts, and other stakeholders to understand their data needs and provide timely data support.Implement data security and privacy measures to ensure compliance with industry standards and regulations.Monitor and troubleshoot data pipeline issues, providing timely resolution to minimize downtime.Stay abreast of the latest advancements in Databricks and other relevant technologies to continually enhance data engineering practices.
QualificationsBachelor's degree in Computer Science, Information Technology, or a related field.Proven experience as a Data Engineer with a focus on Databricks.Strong proficiency in programming languages such as Python, Scala, or Java.Hands-on experience with big data technologies, including Apache Spark and Databricks Delta Lake.Solid understanding of data modeling, ETL processes, and data warehousing concepts.Familiarity with cloud platforms, such as AWS, Azure, or Google Cloud.Excellent problem-solving and communication skills.Ability to work collaboratively in a team-oriented environment.Preferred Qualifications:Databricks Certified Developer or Databricks Certified Data Engineer certification.Experience with version control systems, such as Git.Knowledge of DevOps practices and tools for automated testing and deployment.Familiarity with data streaming technologies (e.g., Apache Kafka).
Our Benefits Package IncludesComprehensive medical benefitsCompetitive pay, 401(k)Retirement plan…and much more!
About INSPYR Solutions
Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients’ business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at inspyrsolutions.com.
INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities.#J-18808-Ljbffr
Senior Data Engineer
Location:
Remote
Duration:
6 - 12 months
Compensation:
$80 - $90 an hour
Work Requirements:
US Citizen, GC Holders or Authorized to Work in the U.S.
Description
We are seeking a skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure to support the organization's data-driven initiatives. This position is based on the Databricks platform, and we are looking for candidates with expertise in building scalable and efficient data pipelines.
ResponsibilitiesCollaborate with cross-functional teams to understand data requirements and design scalable data solutions on the Databricks platform.Develop and maintain ETL processes to ingest, transform, and load data from various sources into Databricks Delta Lake.Design and implement data models and schemas to ensure data accuracy, consistency, and reliability.Optimize and tune data pipelines for performance and efficiency.Work closely with data scientists, analysts, and other stakeholders to understand their data needs and provide timely data support.Implement data security and privacy measures to ensure compliance with industry standards and regulations.Monitor and troubleshoot data pipeline issues, providing timely resolution to minimize downtime.Stay abreast of the latest advancements in Databricks and other relevant technologies to continually enhance data engineering practices.
QualificationsBachelor's degree in Computer Science, Information Technology, or a related field.Proven experience as a Data Engineer with a focus on Databricks.Strong proficiency in programming languages such as Python, Scala, or Java.Hands-on experience with big data technologies, including Apache Spark and Databricks Delta Lake.Solid understanding of data modeling, ETL processes, and data warehousing concepts.Familiarity with cloud platforms, such as AWS, Azure, or Google Cloud.Excellent problem-solving and communication skills.Ability to work collaboratively in a team-oriented environment.Preferred Qualifications:Databricks Certified Developer or Databricks Certified Data Engineer certification.Experience with version control systems, such as Git.Knowledge of DevOps practices and tools for automated testing and deployment.Familiarity with data streaming technologies (e.g., Apache Kafka).
Our Benefits Package IncludesComprehensive medical benefitsCompetitive pay, 401(k)Retirement plan…and much more!
About INSPYR Solutions
Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients’ business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at inspyrsolutions.com.
INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities.#J-18808-Ljbffr