Senior Data Engineer

Senior Data Engineer Visa : Any ( No OPT ) Experience : 8 Contract : W2 / C2C ( only GC EAD /H4EAD ) Location : Quincy MA only local candidates Role Overview: Join the CASM team to build scalable, enterprise-level Cyber AI applications for security, risk, and vulnerability management. Collaborate in Agile teams with Product, AI, DevOps, and Data Quality Management to create a unified, secure platform for risk visibility. Key Responsibilities: Data Integration & API Development: Integrate cybersecurity data sources and build data APIs for real-time insights and streamlined access. Pipeline Engineering: Design and optimize large-scale ETL/ELT pipelines on Databricks using Python and PySpark. Data Quality & Governance: Implement automated data checks, manage data lineage, and ensure compliance with cybersecurity standards. Analytics & Visualization: Create data models, visualizations, and dashboards for threat and vulnerability insights using Databricks and React.js. Data Architecture: Develop secure, scalable environments on AWS (S3, ELB, Lambda) for data storage and processing. CI/CD for Data & Security: Use CI/CD pipelines to automate testing and deployment in alignment with Agile practices. ML Integration: Deploy ML models for threat detection, anomaly detection, and risk scoring. Mentorship: Guide junior engineers, establish best practices, and foster a high-performance, innovative culture. Qualifications: Education: B.S., M.S., or Ph.D. in Computer Science, Data Science, or related field. Experience: 8 years in data engineering, specifically with Databricks, big data frameworks, and ML integration. Technical Skills: Strong Python, PySpark, SQL, and Databricks experience. AWS expertise (EC2, S3, Lambda, ELB) with container orchestration (Docker, Kubernetes). Proficiency in CI/CD, security protocols (SCAS, SAST), and SDLC frameworks. Data Quality & Compliance: Hands-on with Databricks DQM and data governance tools. Agile Environment: Deep Agile/Scrum experience for collaborative, adaptive delivery. Preferred Skills: Data Modeling for Cybersecurity: Advanced experience with data lineage, governance, and privacy. Machine Learning: Experience with predictive modeling and anomaly detection in cybersecurity. Mentorship & Culture: Skilled in fostering a collaborative, continuous improvement environment. Please provide month and date with sub. Also