Logo
Diverse Lynx

Python pyspark Developer

Diverse Lynx, New York, New York, us, 10261


Must Have Skills? Proficiency in containerization technologies such as Docker and Kubernetes.? Hands-on experience with front-end framework like React, Vue.js, Next.js or Angular.js? Experience in infrastructure as code (IaC) using Terraform, particularly with AWS provider? Strong Coding skills in Python, Java or Scala for data processing task.? Proficient in integrating Single Sign-On (SSO) with Microsoft Azure AD using OAuth, OpenID Connect (OIDC) and SAML protocols.? Solid Understanding of relational and NoSQL database, such as PostgreSQL, MySQL, DynamoDB or MongoDB.? Familiarity with data pipelines orchestration tools such as Airflow or Flask.? Proficiency in data transformation and ETL process, including tools like Apache Spark or Glue.? Strong experience with cloud platforms, especially AWS, including services like Lambda, S3, RDS and Glue? Familiarity with big data technologies, including Hadoop, Hive or Redshift? Experience with user authentication and authorization using AWS Cognito.? Expertise in API development, security and implementing best practices for scalable solutions.? Experience with monitoring and logging tools, such as Prometheus, Grafana or ELK Stack to ensure system reliability and application performance.? Strong understanding of DevOps principles, CI/CD pipelines and best practices.? Experience with core AWS technologies such as EC2, ELB, Auto Scaling, S3, EFS, Lambda, API Gateway, Step Functions, CloudWatch, VPC, Route 53, ACM.? Experience with BI tools like Tableau, AWS Quick Sight

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.