Data Engineer General

16th August, 2024 Data Engineer General 1001611 Job Description: We are seeking an experienced and highly skilled Senior DevOps Engineer to join the GDIA department at Company. The ideal candidate will have a strong background in data warehousing and significant experience working with Google Cloud Platform (GCP). As a Senior DevOps Engineer, you will play a critical role in designing, implementing, and maintaining the infrastructure and tools that enable our data engineering and analytics teams to operate efficiently and effectively. Skills Required: Infrastructure as Code: Design, build, and maintain scalable and reliable infrastructure on GCP using Infrastructure as Code (IaC) tools such as Terraform and Deployment Manager. Automate the provisioning and management of cloud resources to ensure consistency and repeatability. Continuous Integration and Continuous Deployment (CI/CD): Implement and manage CI/CD pipelines using tools like Jenkins, GitLab CI, or Cloud Build to facilitate seamless code integration and deployment. Ensure automated testing and monitoring are integrated into the CI/CD process to maintain high-quality code and rapid delivery cycles. Data Pipeline Management: Collaborate with data engineers to design and optimize data pipelines on GCP using tools such as Apache Airflow, Cloud Composer, and Cloud Dataflow. Implement monitoring and alerting solutions to detect and resolve issues in data pipelines promptly. Cloud Platform Expertise: Utilize GCP services such as Cloud Storage, Cloud Run, and Cloud Functions to build scalable and cost-effective solutions. Implement best practices for cloud security, cost management, and resource optimization. Collaboration and Communication: Work closely with data engineers, data scientists, and other stakeholders to understand their requirements and provide the necessary infrastructure and tooling support. Foster a culture of collaboration and continuous improvement within the team. Monitoring and Incident Management: Implement robust monitoring, logging, and alerting solutions using tools like Stackdriver, Prometheus, and Grafana. Manage and respond to incidents, ensuring minimal downtime and quick resolution of issues. Documentation and Training: Create and maintain comprehensive documentation for infrastructure, CI/CD pipelines, and operational procedures. Provide training and support to team members on DevOps best practices and GCP services. Skills Preferred: Technical Skills: Proficiency in Infrastructure as Code (IaC) tools such as Terraform, Deployment Manager, or CloudFormation. Strong knowledge of CI/CD tools and practices, including Jenkins, GitLab CI, and Cloud Build. Experience with data pipeline tools and frameworks such as Apache Airflow, Cloud Composer, and Cloud Dataflow. Familiarity with GCP services, including Cloud Storage, Cloud Run, Cloud Functions, and BigQuery. Proficiency in scripting languages such as Python, Bash, or PowerShell. Soft Skills: Excellent problem-solving and analytical skills. Strong communication and collaboration abilities. Ability to work independently and as part of a team in a fast-paced, dynamic environment. Experience Required: Minimum of 5 years of experience in DevOps or infrastructure engineering, with a strong focus on data warehousing. At least 2 years of hands-on experience working with Google Cloud Platform (GCP). Education Required: Bachelor's degree in Computer Science, Information Technology, or a related field is required. Education Preferred: A Master's degree in a relevant field is preferred. Additional Info: At FastTek Global, Our Purpose is Our People and Our Planet . We come to work each day and are reminded we are helping people find their success stories . Also, Doing the right thing is our mantra . We act responsibly, give back to the communities we serve and have a little fun along the way. We have been doing this with pride, dedication and plain, old-fashioned hard work for 24 years FastTek Global is financially strong, privately held company that is 100% consultant and client focused . We've differentiated ourselves by being fast, flexible, creative and honest . Throw out everything you've heard, seen, or felt about every other IT Consulting company. We do unique things and we do them for Fortune 10, Fortune 500, and technology start-up companies. Our benefits are second to none and thanks to our flexible benefit options you can choose the benefits you need or want, options include: Medical and Dental (FastTek pays majority of the medical program) Vision Personal Time Off (PTO) Program Long Term Disability (100% paid) Life Insurance (100% paid) 401(k) with immediate vesting and 3% (of salary) dollar-for-dollar match Plus, we have a lucrative employee referral program and an employee recognition culture. FastTek Global was named one of the Top Workplaces in Michigan by the Detroit Free Press in 2013, 2014, 2015, 2016, 2017, 2018, 2019, 2020, 2021 , 2022 and 2023 To view all of our open positions go to: https://www.fasttek.com/fastswitch/findwork Follow us on Twitter: https://twitter.com/fasttekglobal Follow us on Instagram: https://www.instagram.com/fasttekglobal Find us on LinkedIn: https://www.linkedin.com/company/fasttek You can become a fan of FastTek on Facebook: https://www.facebook.com/fasttekglobal/