Diverse Lynx
Azure Data Brick engineer
Diverse Lynx, Minneapolis, Minnesota, United States, 55400
ADF - Will be used for ingestion pipeline and orchestration for entire pipelineAzure Databricks - Will be used for transformation and storage. Resource should have Unity catalog knowledge as OFT is using UC for governance, tag and document data assets.Python
- Will be used for writing notebooks in DatabricksPyspark
- Will be used for interfacing with Spark using Python and some data transformation.Datamodeling - Knowledge is expected for onsite resource. Optional for offshore.Healthcare domain knowledge - Good to haveCI/CD/DevOps - OptionalTesting using Pytest - Let us set the expectations with the resources that they will have to learn Pytest on the job and automate some data validation procedures.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
- Will be used for writing notebooks in DatabricksPyspark
- Will be used for interfacing with Spark using Python and some data transformation.Datamodeling - Knowledge is expected for onsite resource. Optional for offshore.Healthcare domain knowledge - Good to haveCI/CD/DevOps - OptionalTesting using Pytest - Let us set the expectations with the resources that they will have to learn Pytest on the job and automate some data validation procedures.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.