Senior Python Developer (PySpark & Django Specialist)

Job Title:

Senior Python Developer (PySpark & Django Specialist)

Job Summary :We are seeking an experienced Senior Python Developer with expertise in PySpark and Django to lead the design and development of scalable applications and data processing systems. The ideal candidate will have more than 5 years of experience in Python programming and in-depth knowledge of big data frameworks, web technologies, and cloud infrastructures. As a senior member of the team, you will mentor junior developers, contribute to technical decision-making, and deliver high-quality, performance-optimized solutions.

Key Responsibilities :Lead Application Development :

Develop, and maintain complex, high-performance applications using Python, Django, and PySpark.Data Pipeline Optimization :

Design and optimize big data processing pipelines using PySpark, ensuring efficient ETL processes and real-time data handling.Technical Leadership :

Provide mentorship and guidance to junior developers, code reviews, and best practice enforcement in code structure and development processes.Scalable Web Solutions :

Lead the development of scalable web applications using Django, ensuring they meet business and user requirements, focusing on security, scalability, and performance.Database Design & Management :

Work with a range of databases (relational and NoSQL), optimizing queries and database architecture for performance and scalability.

Required Skills and Qualifications :5+ Years of Python Development :

Proven experience in developing scalable and maintainable software solutions using Python.PySpark Expertise :

Advanced knowledge of PySpark for processing large datasets, including experience with Spark SQL, DataFrames, and RDDs.Django Expertise :

Extensive experience with Django, including ORM, REST framework, security practices, middleware, and performance optimization.Data Modeling & Management :

Strong expertise in designing, optimizing, and managing relational databases (PostgreSQL, MySQL) and NoSQL databases (MongoDB, Cassandra).DevOps & CI/CD :

Solid understanding of DevOps practices and experience in building and managing CI/CD pipelines using Jenkins, GitLab, or similar.Testing & Debugging :

Proficiency in automated testing and debugging, using frameworks such as PyTest, UnitTest, and Behave to ensure high code quality.Front-End Collaboration :

Basic familiarity with front-end technologies such as JavaScript (React, Angular, or Vue.js) to collaborate effectively with front-end teams.

Preferred Skills :Big Data Technologies :

Experience with additional big data technologies such as Hadoop, Kafka, Hive, or Flink.Distributed Systems :

Knowledge of distributed systems and parallel processing techniques for managing large datasets.Microservices Architecture :

Experience designing and implementing microservices using Docker, Kubernetes, or serverless technologies.Agile Development :

Strong experience working within Agile frameworks (Scrum or Kanban) and contributing to sprint planning and retrospectives.Containerization :

Expertise in containerization technologies (Docker) and orchestration tools like Kubernetes.

#J-18808-Ljbffr