Sr Python Developer at Chateck Inc

Overview:

We are seeking a Python Developer with a unique blend of DevOps practices and PySpark expertise to join our innovative team. The ideal candidate should possess a robust background in Python programming, particularly with data manipulation libraries like Pandas, experience in optimizing processes using threading and GIL and integrating REST APIs using frameworks such as Flask and Django. Moreover, familiarity with structured Python project development and workflow automation using Airflow is necessary. Proficiency in DevOps tools like Docker and ECS for containerization and deployment and hands-on experience in PySpark for big data processing is required.

Responsibilities:

• Develop Python-based applications and services, focusing on efficiency, reliability, and scalability.

• Utilize Pandas and other Python libraries for data manipulation and analysis tasks.

• Optimize application performance through threading and Global Interpreter Lock (GIL) management.

• Integrate RESTful APIs using Flask and Django frameworks for seamless data exchange.

• Implement structured Python project code structures, adhering to best practices and coding standards.

• Design and implement data pipelines and workflows using Apache Airflow.

• Containerize applications using Docker and manage orchestration with ECS.

• Implement big data processing solutions using PySpark, ensuring efficient data handling and computation.

• Collaborate with cross-functional teams to deliver integrated solutions, including data engineers, data scientists, and DevOps specialists.

Requirements:

• Proven experience as a Python Developer with a strong understanding of Python's ecosystem and libraries ( 8 to 10 years of experience)

• Hands-on experience in process optimization using threading and GIL management.

• Solid understanding of RESTful API integration using Flask and/or Django.

• Experience working with structured Python projects, not limited to standalone scripts.

• I am familiar with Apache Airflow for workflow management and automation.

• Proficiency in containerization using Docker and orchestration with ECS.

• Experience with PySpark for big data processing, including data manipulation and computation.

• Strong problem-solving skills and the ability to work independently and as part of a team.

• Excellent communication skills and ability to collaborate effectively with technical and non-technical stakeholders.

Preferred Skills:

• Familiarity with CI/CD pipelines and automated testing frameworks.

• Understanding of Agile methodologies and software development lifecycle.

• Experience with other big data technologies and frameworks (Hadoop, Spark).

• Contributions to open-source projects or active participation in technical communities.