Inabia Software & Consulting Inc.
PALANTIR Senior Data Engineer
Inabia Software & Consulting Inc., Dallas, Texas, United States, 75215
Role:
PALANTIR Senior Data EngineerLocation:
Dallas, TX (Onsite) (Locals Preferred)Duration:
ContractWork Authorization:
(H1B/H4 EAD/L2 EAD/USC/GC)
Mandatory Skills:
Data Engineer, Palantir, AWS, Python, PysparkYears of Experience:
10+ Years of Experience
Job Description:Job Duties and Responsibilities:
Use Pyspark to build data pipes in AWS environments.Write design documents and independently build the Data Pipes based on the defined source to target mappings.Convert complex stored procedures, SQL triggers, etc. logic using PySpark in the Cloud platform.Be open to learning new technologies and implementing solutions quickly in the cloud platform.Communicate with program key stakeholders to keep the project aligned with their goals.Effectively interact with QA and UAT team for code testing and migrate to different regions.Spearhead data engineering initiatives targeting moderately to complex data and analytics challenges, delivering impactful outcomes through comprehensive analysis and problem-solving.Pioneer the identification, conceptualization, and execution of internal process enhancements, encompassing scalable infrastructure redesign, optimized data distribution, and the automation of manual workflows.Address extensive application programming and analysis quandaries within defined procedural guidelines, offering resolutions that span wide-ranging scopes.Actively engage in agile/scrum methodologies, participating in ceremonies such as stand-ups, planning sessions, and retrospectives.Orchestrate the development and execution of automated and user acceptance tests, integral to the iterative development lifecycle.Foster the maturation of broader data systems and architecture, assessing individual data pipelines and suggesting/implementing enhancements to align with project and enterprise maturity objectives.Envision and construct infrastructure that facilitates access and analysis of vast datasets while ensuring data quality and metadata accuracy through systematic cataloging.
Position Qualifications:
Total 10+ years of experience with 3+ years of experience in data engineering/ETL ecosystems with Palantir Foundry, Python, PySpark, and Java.Required skills: Palantir.Nice to have skills: Pyspark and Python.Expert in writing shell scripts to execute various job schedulers.Hands-on experience in Palantir & PySpark to build data pipes in AWS environments.Good knowledge of Palantir components.Good exposure to RDMS.Basic understanding of Data Mappings and Workflows.Any knowledge of the Palantir Foundry Platform will be a big plus.Experience implementing projects in the Energy and Utility space is a plus.
#J-18808-Ljbffr
PALANTIR Senior Data EngineerLocation:
Dallas, TX (Onsite) (Locals Preferred)Duration:
ContractWork Authorization:
(H1B/H4 EAD/L2 EAD/USC/GC)
Mandatory Skills:
Data Engineer, Palantir, AWS, Python, PysparkYears of Experience:
10+ Years of Experience
Job Description:Job Duties and Responsibilities:
Use Pyspark to build data pipes in AWS environments.Write design documents and independently build the Data Pipes based on the defined source to target mappings.Convert complex stored procedures, SQL triggers, etc. logic using PySpark in the Cloud platform.Be open to learning new technologies and implementing solutions quickly in the cloud platform.Communicate with program key stakeholders to keep the project aligned with their goals.Effectively interact with QA and UAT team for code testing and migrate to different regions.Spearhead data engineering initiatives targeting moderately to complex data and analytics challenges, delivering impactful outcomes through comprehensive analysis and problem-solving.Pioneer the identification, conceptualization, and execution of internal process enhancements, encompassing scalable infrastructure redesign, optimized data distribution, and the automation of manual workflows.Address extensive application programming and analysis quandaries within defined procedural guidelines, offering resolutions that span wide-ranging scopes.Actively engage in agile/scrum methodologies, participating in ceremonies such as stand-ups, planning sessions, and retrospectives.Orchestrate the development and execution of automated and user acceptance tests, integral to the iterative development lifecycle.Foster the maturation of broader data systems and architecture, assessing individual data pipelines and suggesting/implementing enhancements to align with project and enterprise maturity objectives.Envision and construct infrastructure that facilitates access and analysis of vast datasets while ensuring data quality and metadata accuracy through systematic cataloging.
Position Qualifications:
Total 10+ years of experience with 3+ years of experience in data engineering/ETL ecosystems with Palantir Foundry, Python, PySpark, and Java.Required skills: Palantir.Nice to have skills: Pyspark and Python.Expert in writing shell scripts to execute various job schedulers.Hands-on experience in Palantir & PySpark to build data pipes in AWS environments.Good knowledge of Palantir components.Good exposure to RDMS.Basic understanding of Data Mappings and Workflows.Any knowledge of the Palantir Foundry Platform will be a big plus.Experience implementing projects in the Energy and Utility space is a plus.
#J-18808-Ljbffr