Lorven Technologies
PALANTIR - Senior Data Engineer - Dallas TX (Onsite)
Lorven Technologies, Dallas, Texas, United States, 75215
Our client is looking for an
PALANTIR - Senior Data Engineer
with a
Long-Term Contract
in
Dallas, TX (Onsite)
below is the detailed requirement.
Position :
PALANTIR - Senior Data Engineer
Location :
Dallas, TX (Onsite)
Duration : Long term Contract
Job Description:
Required:
Total 10+ years of experience with 3 plus years of experience in
data engineering/ETL ecosystems
with
Palantir Foundry ,
Python ,
PySpark
and
Java .Required skills:
PalantirNice to have skills:
Pyspark and PythonExpert in writing
shell scripts
to execute various job schedulerHands-on experience in
Palantir & PySpark
to build data pipes in
AWS environmentsGood knowledge of
Palantir componentsGood exposure to
RDMSBasic understanding of
Data Mappings
and
WorkflowsAny knowledge of the
Palantir Foundry Platform
will be a big plusImplemented a few projects in
Energy
and
Utility space
is a plusResponsibilities:
Use Pyspark to build data pipes in AWS environmentsWrite design documents and independently build the Data Pipes based on the defined source to target mappingsConvert complex stored procedures, SQL triggers, etc. logic using PySpark in the Cloud platformBe open to learning new technologies and implementing solutions quickly in the cloud platformCommunicate with program key stakeholders to keep the project aligned with their goalsEffectively interact with QA and UAT team for code testing and migrate to different regionsSpearheads data engineering initiatives targeting moderately to complex data and analytics challenges, delivering impactful outcomes through comprehensive analysis and problem-solvingPioneers the identification, conceptualization, and execution of internal process enhancements, encompassing scalable infrastructure redesign, optimized data distribution, and the automation of manual workflowsAddresses extensive application programming and analysis quandaries within defined procedural guidelines, offering resolutions that span wide-ranging scopesActively engages in agile/scrum methodologies, actively participating in ceremonies such as stand-ups, planning sessions, and retrospectives.Orchestrates the development and execution of automated and user acceptance tests, integral to the iterative development lifecycle.Fosters the maturation of broader data systems and architecture, assessing individual data pipelines and suggesting/implementing enhancements to align with project and enterprise maturity objectiveEnvisions and constructs infrastructure that facilitates access and analysis of vast datasets while ensuring data quality and metadata accuracy through systematic cataloging
PALANTIR - Senior Data Engineer
with a
Long-Term Contract
in
Dallas, TX (Onsite)
below is the detailed requirement.
Position :
PALANTIR - Senior Data Engineer
Location :
Dallas, TX (Onsite)
Duration : Long term Contract
Job Description:
Required:
Total 10+ years of experience with 3 plus years of experience in
data engineering/ETL ecosystems
with
Palantir Foundry ,
Python ,
PySpark
and
Java .Required skills:
PalantirNice to have skills:
Pyspark and PythonExpert in writing
shell scripts
to execute various job schedulerHands-on experience in
Palantir & PySpark
to build data pipes in
AWS environmentsGood knowledge of
Palantir componentsGood exposure to
RDMSBasic understanding of
Data Mappings
and
WorkflowsAny knowledge of the
Palantir Foundry Platform
will be a big plusImplemented a few projects in
Energy
and
Utility space
is a plusResponsibilities:
Use Pyspark to build data pipes in AWS environmentsWrite design documents and independently build the Data Pipes based on the defined source to target mappingsConvert complex stored procedures, SQL triggers, etc. logic using PySpark in the Cloud platformBe open to learning new technologies and implementing solutions quickly in the cloud platformCommunicate with program key stakeholders to keep the project aligned with their goalsEffectively interact with QA and UAT team for code testing and migrate to different regionsSpearheads data engineering initiatives targeting moderately to complex data and analytics challenges, delivering impactful outcomes through comprehensive analysis and problem-solvingPioneers the identification, conceptualization, and execution of internal process enhancements, encompassing scalable infrastructure redesign, optimized data distribution, and the automation of manual workflowsAddresses extensive application programming and analysis quandaries within defined procedural guidelines, offering resolutions that span wide-ranging scopesActively engages in agile/scrum methodologies, actively participating in ceremonies such as stand-ups, planning sessions, and retrospectives.Orchestrates the development and execution of automated and user acceptance tests, integral to the iterative development lifecycle.Fosters the maturation of broader data systems and architecture, assessing individual data pipelines and suggesting/implementing enhancements to align with project and enterprise maturity objectiveEnvisions and constructs infrastructure that facilitates access and analysis of vast datasets while ensuring data quality and metadata accuracy through systematic cataloging