Accord Technologies Inc.
Databricks Engineer
Accord Technologies Inc., Plano, Texas, us, 75086
Databricks Engineer
Location: Plano, TX Hybrid (need candidates within TX)
Experience: 10+ years
Must Have:
DatabricksApache SparkPython (and/or Scala)AWSSQLJavaCI/CD Pipeline toolsMinimum Industry Experience:
10 years
Job Description:
Bachelor’s degree or equivalent work experienceMust have experience implementing at least 2 end-to-end projects with Databricks which includes components like:Delta LakeUnity CatalogDatabricks ConnectDatabricks APIDatabricks Workflow OrchestrationMust be well-versed with Databricks Lakehouse concepts and its implementation in large scale enterprise environmentsMust have a good understanding of creating complex data pipelines and using data ingestion tools like NiFiMust be well-versed in using the Apache Spark framework and strong in SQL and Spark-SQLMust have excellent coding skills in Python (and/or Scala), preferably PythonMust have strong performance optimization skills to improve efficiency and reduce costs using techniques like parallel processingMust have worked on AWS and should have working experience of AWS services like S3, Lambda, DynamoDB, SQS, CloudWatchMust be able to work with architects and lead engineers to design solutions to meet functional and non-functional requirementsMust have strong written and verbal communication skillsMust have experience in an Agile environmentData engineering background is a plus
#J-18808-Ljbffr
Location: Plano, TX Hybrid (need candidates within TX)
Experience: 10+ years
Must Have:
DatabricksApache SparkPython (and/or Scala)AWSSQLJavaCI/CD Pipeline toolsMinimum Industry Experience:
10 years
Job Description:
Bachelor’s degree or equivalent work experienceMust have experience implementing at least 2 end-to-end projects with Databricks which includes components like:Delta LakeUnity CatalogDatabricks ConnectDatabricks APIDatabricks Workflow OrchestrationMust be well-versed with Databricks Lakehouse concepts and its implementation in large scale enterprise environmentsMust have a good understanding of creating complex data pipelines and using data ingestion tools like NiFiMust be well-versed in using the Apache Spark framework and strong in SQL and Spark-SQLMust have excellent coding skills in Python (and/or Scala), preferably PythonMust have strong performance optimization skills to improve efficiency and reduce costs using techniques like parallel processingMust have worked on AWS and should have working experience of AWS services like S3, Lambda, DynamoDB, SQS, CloudWatchMust be able to work with architects and lead engineers to design solutions to meet functional and non-functional requirementsMust have strong written and verbal communication skillsMust have experience in an Agile environmentData engineering background is a plus
#J-18808-Ljbffr