TalentElixir Consulting
Cloud Data Architect
TalentElixir Consulting, Houston, Texas, United States, 77246
About the job Cloud Data Architect
Our client is looking for a Cloud Data Architect with minimum 5 years of experience designing, building, and supporting solutions. You will participate in helping them store and process large amounts of batch, streaming, structured and unstructured data. The data sources come from a wide variety of hybrid cloud environments. You will be asked to be self-driven, take charge in identifying and fixing problems, and excel in a collaborative and constantly changing environment. This position will be responsible for designing, building, and supporting a next-generation cloud data platform that will form the technical foundation for a data-driven organization.
Daily Responsibilities:
Lead architecture, design, and development of a next-generation data platform in the cloud that serves as the central repository for data across the organizationHands-on solution development leveraging modern cloud data technologies, tools, languages, and platformsDefine and establish data architecture principles, standards, guidelines, and patternsBalance service delivery with continuous process improvement and automation to architect reliable, and stable data platform capabilitiesWork with functional leads and business leaders to ensure a technical strategy is aligned with company and departmental visionLead, manage and guide technical project teamsDrive the adoption of a DevOps/SRE culture across teamsMentor other team membersSupport vendor management activities with key vendors such as cloud providers, and drive early adoption activities and vendor technology roadmap discussionsRequired Skills:
8+ years of experience in a hands-on software/data engineering role including data modeling, data integration, data ingestion, data transformation, data mining, and data warehousingExperience designing and building cloud-native data platforms (AWS preferred)Experience designing and building ETL and ELT data pipelines for batch and streaming data using cloud-native serverless technologies like AWS Glue and LambdaAdvanced knowledge of SQL and data warehouse conceptsExperience building solutions to measure data qualityExperience with Snowflake or other cloud-native data warehousesExperience with cloud-native SQL and NoSQL DBaaS platforms like AWS RDS, MongoDB AtlasExperience building data ingestion pipelines using Python and PySparkExperience with streaming data platforms like Apache Kafka or AWS Kinesis, and event-driven architecturesSolid understanding of DevOps and SRE and experience implementing CI/CD, test automation, infrastructure as code (Terraform), metrics, and monitoringExperience using DevOps platforms and tools (Azure DevOps, GitHub)Proficiency with both Linux and WindowsExperience with containerized applications using DockerExperience with agile methodologies including Scrum and KanbanExperience leading teams of data engineers and software developers spanning multiple time zonesStrong problem-solving and analytical skillsExceptional verbal and written communicationBachelor's degree in Computer Science, Engineering, MIS, or equivalent experienceDesired Skills:
Experience building solutions with Docker and Kubernetes (EKS, AKS, GKE)Experience building ETL and ELT data pipelines using Informatica Cloud platformExperience with data quality and catalog tools (e.g. Informatica, Collibra).Knowledge of data governance practices, business, and technology issues related to management of enterprise information assets, and approaches related to data protectionFamiliarity and experience in data protection and information security in the cloudFamiliarity with cloud-native technologies and platforms for artificial intelligence and machine learning (e.g. SageMaker)
Our client is looking for a Cloud Data Architect with minimum 5 years of experience designing, building, and supporting solutions. You will participate in helping them store and process large amounts of batch, streaming, structured and unstructured data. The data sources come from a wide variety of hybrid cloud environments. You will be asked to be self-driven, take charge in identifying and fixing problems, and excel in a collaborative and constantly changing environment. This position will be responsible for designing, building, and supporting a next-generation cloud data platform that will form the technical foundation for a data-driven organization.
Daily Responsibilities:
Lead architecture, design, and development of a next-generation data platform in the cloud that serves as the central repository for data across the organizationHands-on solution development leveraging modern cloud data technologies, tools, languages, and platformsDefine and establish data architecture principles, standards, guidelines, and patternsBalance service delivery with continuous process improvement and automation to architect reliable, and stable data platform capabilitiesWork with functional leads and business leaders to ensure a technical strategy is aligned with company and departmental visionLead, manage and guide technical project teamsDrive the adoption of a DevOps/SRE culture across teamsMentor other team membersSupport vendor management activities with key vendors such as cloud providers, and drive early adoption activities and vendor technology roadmap discussionsRequired Skills:
8+ years of experience in a hands-on software/data engineering role including data modeling, data integration, data ingestion, data transformation, data mining, and data warehousingExperience designing and building cloud-native data platforms (AWS preferred)Experience designing and building ETL and ELT data pipelines for batch and streaming data using cloud-native serverless technologies like AWS Glue and LambdaAdvanced knowledge of SQL and data warehouse conceptsExperience building solutions to measure data qualityExperience with Snowflake or other cloud-native data warehousesExperience with cloud-native SQL and NoSQL DBaaS platforms like AWS RDS, MongoDB AtlasExperience building data ingestion pipelines using Python and PySparkExperience with streaming data platforms like Apache Kafka or AWS Kinesis, and event-driven architecturesSolid understanding of DevOps and SRE and experience implementing CI/CD, test automation, infrastructure as code (Terraform), metrics, and monitoringExperience using DevOps platforms and tools (Azure DevOps, GitHub)Proficiency with both Linux and WindowsExperience with containerized applications using DockerExperience with agile methodologies including Scrum and KanbanExperience leading teams of data engineers and software developers spanning multiple time zonesStrong problem-solving and analytical skillsExceptional verbal and written communicationBachelor's degree in Computer Science, Engineering, MIS, or equivalent experienceDesired Skills:
Experience building solutions with Docker and Kubernetes (EKS, AKS, GKE)Experience building ETL and ELT data pipelines using Informatica Cloud platformExperience with data quality and catalog tools (e.g. Informatica, Collibra).Knowledge of data governance practices, business, and technology issues related to management of enterprise information assets, and approaches related to data protectionFamiliarity and experience in data protection and information security in the cloudFamiliarity with cloud-native technologies and platforms for artificial intelligence and machine learning (e.g. SageMaker)