Python Developer/Senior Python Developer - Data Analysis & Processing

As a Python Developer/Senior Python Developer at our company, your role will involve building robust data-processing solutions, writing monitoring scripts, proactively identifying and fixing data and system issues, and ensuring high data quality and reliability. Web scripting experience is optional but considered an advantage. **Key Responsibilities:** - **Data Analysis & Processing:** - Develop and optimize data analysis pipelines for large datasets. - Perform exploratory data analysis (EDA) and generate meaningful insights. - Improve performance and reliability of existing data workflows. - **Data Validation & Quality:** - Design and implement data validation frameworks and rule engines. - Ensure data accuracy, completeness, and consistency. - Investigate data discrepancies and fix data quality issues. - **Data Extraction & Integration:** - Build and maintain data extraction scripts from APIs, databases, files, and third-party systems. - Automate ingestion and transformation processes. - Handle structured, semi-structured, and unstructured data. - **Monitoring & Issue Resolution:** - Write monitoring scripts to track data pipelines, jobs, and process health. - Set up alerts and logs for failures, delays, and data anomalies. - Analyze root causes and fix production issues in data workflows. - Improve system stability through proactive monitoring and preventive fixes. - **Framework & Architecture:** - Design and maintain reusable Python frameworks, libraries, and utilities. - Ensure modular, maintainable, and scalable architecture. - Conduct code reviews and enforce coding best practices. - **Collaboration & Mentorship:** - Work closely with data analysts, QA, and business teams. - Mentor junior developers and support technical problem-solving. - Participate in technical design and solution discussions. **Required Technical Skills:** - **Core Python:** - Strong expertise in Python 3.x. - Experience in writing efficient, readable, and testable code. - **Data & Libraries:** - Strong hands-on experience with Pandas, NumPy. - Experience with data validation tools (Pydantic, Marshmallow, Great Expectations, or custom frameworks). - Proficiency in log handling and error management. - **Databases:** - Strong knowledge of SQL and relational databases. - Experience working with large datasets. - **Testing & Debugging:** - Experience with unit testing frameworks (pytest, unittest). - Strong debugging, troubleshooting, and performance optimization skills. **Optional/Advantage Skills:** - Hands-on experience with web scraping and automation tools such as BeautifulSoup, Requests, Scrapy, Selenium, Playwright, etc. - Working knowledge of Django, Flask, or FastAPI. - Experience with scheduling jobs (cron, internal schedulers). - Exposure to message queues or batch processing systems. If you believe you meet the requirements and are excited about the opportunity to work on challenging projects, we encourage you to apply. As a Python Developer/Senior Python Developer at our company, your role will involve building robust data-processing solutions, writing monitoring scripts, proactively identifying and fixing data and system issues, and ensuring high data quality and reliability. Web scripting experience is optional but considered an advantage. **Key Responsibilities:** - **Data Analysis & Processing:** - Develop and optimize data analysis pipelines for large datasets. - Perform exploratory data analysis (EDA) and generate meaningful insights. - Improve performance and reliability of existing data workflows. - **Data Validation & Quality:** - Design and implement data validation frameworks and rule engines. - Ensure data accuracy, completeness, and consistency. - Investigate data discrepancies and fix data quality issues. - **Data Extraction & Integration:** - Build and maintain data extraction scripts from APIs, databases, files, and third-party systems. - Automate ingestion and transformation processes. - Handle structured, semi-structured, and unstructured data. - **Monitoring & Issue Resolution:** - Write monitoring scripts to track data pipelines, jobs, and process health. - Set up alerts and logs for failures, delays, and data anomalies. - Analyze root causes and fix production issues in data workflows. - Improve system stability through proactive monitoring and preventive fixes. - **Framework & Architecture:** - Design and maintain reusable Python frameworks, libraries, and utilities. - Ensure modular, maintainable, and scalable architecture. - Conduct code reviews and enforce coding best practices. - **Collaboration & Mentorship:** - Work closely with data analysts, QA, and business teams. - Mentor junior developers and support technical problem-solving. - Participate in technical design and solution discussions. **Required Technical Skills:** - **Core Python:** - Strong expertise in Python 3.x. - Exp