JobRialto
Python Data Engineer
JobRialto, Reston, Virginia, United States, 22090
Job Summary:
We are seeking a Python Data Engineer with strong backend development experience, AWS expertise, and proficiency in complex SQL. The ideal candidate will have a solid understanding of configuring AWS services, automating processes, and building scalable data solutions. Experience in both backend and UI development is a plus.
Key Responsibilities:
• Develop and maintain data pipelines using Python and AWS services.
• Configure and automate AWS Lambda functions and EMR clusters for data processing.
• Write and optimize complex SQL queries to efficiently extract and manipulate data from databases.
• Design, build, and integrate API calls from databases to support backend services.
• Collaborate with cross-functional teams to ensure seamless data flow between backend and UI components.
• Ensure code efficiency, scalability, and performance throughout the development process.
• Monitor and troubleshoot issues related to data pipelines and backend systems.
Required Qualifications:
• Strong expertise in Python development with hands-on experience in configuring AWS services (Lambda, EMR).
• Proficient in SQL, capable of writing and optimizing complex queries for large datasets.
• Experience building API calls from databases to support backend processes.
• Knowledge of AWS ecosystem and its various services for automation and data processing.
• Ability to work collaboratively with cross-functional teams to align backend and UI components.
• Excellent problem-solving and analytical skills.
Preferred Qualifications:
• Experience with data visualization tools and building UI components.
• Familiarity with additional AWS services like S3, Redshift, or Athena.
• Exposure to Agile development methodologies and tools such as Jira.
Education:
Bachelors Degree
We are seeking a Python Data Engineer with strong backend development experience, AWS expertise, and proficiency in complex SQL. The ideal candidate will have a solid understanding of configuring AWS services, automating processes, and building scalable data solutions. Experience in both backend and UI development is a plus.
Key Responsibilities:
• Develop and maintain data pipelines using Python and AWS services.
• Configure and automate AWS Lambda functions and EMR clusters for data processing.
• Write and optimize complex SQL queries to efficiently extract and manipulate data from databases.
• Design, build, and integrate API calls from databases to support backend services.
• Collaborate with cross-functional teams to ensure seamless data flow between backend and UI components.
• Ensure code efficiency, scalability, and performance throughout the development process.
• Monitor and troubleshoot issues related to data pipelines and backend systems.
Required Qualifications:
• Strong expertise in Python development with hands-on experience in configuring AWS services (Lambda, EMR).
• Proficient in SQL, capable of writing and optimizing complex queries for large datasets.
• Experience building API calls from databases to support backend processes.
• Knowledge of AWS ecosystem and its various services for automation and data processing.
• Ability to work collaboratively with cross-functional teams to align backend and UI components.
• Excellent problem-solving and analytical skills.
Preferred Qualifications:
• Experience with data visualization tools and building UI components.
• Familiarity with additional AWS services like S3, Redshift, or Athena.
• Exposure to Agile development methodologies and tools such as Jira.
Education:
Bachelors Degree