Lorven Technologies
Data Architect - Long Term Contract - Hybrid in Houston, TX
Lorven Technologies, Houston, Texas, United States, 77246
Job Title: Data Architect (Energy Domain is Mandatory)
Location: Hybrid in Houston, TX
Duration: Long Term Contract
We are seeking a highly skilled and experienced Data Architect with extensive experience in Snowflake and Databricks. The ideal candidate will have a strong background data migration from RDBMS to Snowflake and Databricks, and a deep understanding of modern data architecture principles. You will need to partner with end-users to understand process, requirements and analyze problems to design solutions and ultimately deliver tangible business value & benefit.
Key responsibilities:Design, develop, and implement robust data architecture solutions utilizing modern day data platforms like Snowflake and Databricks.Ensure scalable, reliable, and secure data environments that meet business requirements and support advanced analytics.Lead the migration of data from traditional RDBMS systems to Snowflake and Databricks environments.Architect and design scalable data pipelines and infrastructure to support the organization's data needs.Develop and manage ETL processes using Snowflake and Databricks to ensure efficient data extraction, transformation, and loading.Optimize ETL workflows to enhance performance and maintain data integrity.Ensure seamless data transition with minimal disruption to ongoing operations.Monitor and optimize performance of data systems to ensure reliability, scalability, and cost-effectiveness within Snowflake and Databricks environments.Collaborate with cross-functional teams, including data engineers, data scientists, analysts, and product managers, to understand data requirements and deliver solutions.Define best practices and standards for data engineering/data warehouse processes and ensure adherence to them.Evaluate and implement new technologies and tools to improve the efficiency and effectiveness of data pipelines.Provide technical leadership and mentorship to junior members of the data engineering team.Work closely with DevOps and infrastructure teams to deploy and manage data systems in production environments.Ensure that all data solutions comply with organizational policies, industry standards, and regulatory requirements.Collaborate with enterprise architects and IT leadership to ensure alignment of data architecture with overall IT architecture and strategies.Skill and Experience:
BS or MS in Computer Science or relevant experience.Extensive experience with Snowflake and Databricks, including ETL processes and data migration.Certifications in Snowflake and/or Databricks.Experience with additional cloud platforms like AWS, Azure, or GCP.Knowledge of big data technologies and frameworks.Strong knowledge of data warehousing concepts, data modeling, and SQL.Experience with RDBMS systems and transitioning data to modern cloud platforms.Proficiency in programming languages such as Python, SQL, and scripting languages.Knowledge of data governance frameworks, data quality management practices, and data security principlesProficiency in database technologies, including relational databases e.g., SQL Server. In-depth knowledge of data modeling, database design.Familiarity with containerization technologies such as Docker and orchestration tools like Kubernetes.Excellent problem-solving and analytical skills. Strong communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams.
Location: Hybrid in Houston, TX
Duration: Long Term Contract
We are seeking a highly skilled and experienced Data Architect with extensive experience in Snowflake and Databricks. The ideal candidate will have a strong background data migration from RDBMS to Snowflake and Databricks, and a deep understanding of modern data architecture principles. You will need to partner with end-users to understand process, requirements and analyze problems to design solutions and ultimately deliver tangible business value & benefit.
Key responsibilities:Design, develop, and implement robust data architecture solutions utilizing modern day data platforms like Snowflake and Databricks.Ensure scalable, reliable, and secure data environments that meet business requirements and support advanced analytics.Lead the migration of data from traditional RDBMS systems to Snowflake and Databricks environments.Architect and design scalable data pipelines and infrastructure to support the organization's data needs.Develop and manage ETL processes using Snowflake and Databricks to ensure efficient data extraction, transformation, and loading.Optimize ETL workflows to enhance performance and maintain data integrity.Ensure seamless data transition with minimal disruption to ongoing operations.Monitor and optimize performance of data systems to ensure reliability, scalability, and cost-effectiveness within Snowflake and Databricks environments.Collaborate with cross-functional teams, including data engineers, data scientists, analysts, and product managers, to understand data requirements and deliver solutions.Define best practices and standards for data engineering/data warehouse processes and ensure adherence to them.Evaluate and implement new technologies and tools to improve the efficiency and effectiveness of data pipelines.Provide technical leadership and mentorship to junior members of the data engineering team.Work closely with DevOps and infrastructure teams to deploy and manage data systems in production environments.Ensure that all data solutions comply with organizational policies, industry standards, and regulatory requirements.Collaborate with enterprise architects and IT leadership to ensure alignment of data architecture with overall IT architecture and strategies.Skill and Experience:
BS or MS in Computer Science or relevant experience.Extensive experience with Snowflake and Databricks, including ETL processes and data migration.Certifications in Snowflake and/or Databricks.Experience with additional cloud platforms like AWS, Azure, or GCP.Knowledge of big data technologies and frameworks.Strong knowledge of data warehousing concepts, data modeling, and SQL.Experience with RDBMS systems and transitioning data to modern cloud platforms.Proficiency in programming languages such as Python, SQL, and scripting languages.Knowledge of data governance frameworks, data quality management practices, and data security principlesProficiency in database technologies, including relational databases e.g., SQL Server. In-depth knowledge of data modeling, database design.Familiarity with containerization technologies such as Docker and orchestration tools like Kubernetes.Excellent problem-solving and analytical skills. Strong communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams.