Python Developer
- Job Title
- Python Developer
- Company: iCapital
- Location: IN - Jaipur
About the Role iCapital is seeking an experienced Python Developer with expertise in web
scraping, automated portal interactions, and cloud-native deployment using AWS. The ideal
candidate will assist in architecting and building robust, secure, and scalable scraping solutions
that interact with complex web applications and secured portals.
Key Responsibilities
- Design and implement advanced scraping solutions utilizing Python, Playwright, and AWS
services.
- Automate interactions with authentication-secured and JavaScript-heavy websites.
- Handle multi-factor authentication (MFA), CAPTCHAs, and session/token-based login
flows.
- Architect serverless scraping pipelines using AWS components such as Lambda, Step
Functions, S3, CloudWatch, and Secrets Manager.
- Build highly scalable systems for data extraction that feature fault tolerance, intelligent
logging, and retries.
- Integrate and manage complex workflows across multiple portals, APIs, and data
sources.
- Contribute to architectural decisions, tooling, and best practices.
Qualifications
- Bachelor's or Master's degree in Computer Science, Software Engineering, a related field,
or equivalent professional experience.
- 5+ years of experience in Python development, strongly focused on data extraction and
automation.
- Proven web scraping expertise using tools such as Playwright, Selenium, Scrapy,
BeautifulSoup, and requests.
- In-depth experience handling multi-step authentication flows and session/cookie
management.
- Proficiency in managing and deploying scraping workloads in AWS.
- Experience with asynchronous programming, headless browsers, and
JavaScript-rendered content.
- Solid understanding of web protocols (HTTP, HTTPS, cookies, headers).
Confidential Data
For Internal Use Only Confidential Data
For Internal Use Only
- Ability to reverse-engineer network calls and authentication mechanisms.
- Comfortable working with APIs, JSON/XML, and data transformation.
- Preferred: Experience with CI/CD pipelines, Docker, infrastructure as code
(CloudFormation, Terraform), Apache Airflow, and secure portal scraping.
Work Arrangement \& Benefits
- Hybrid schedule requiring four days in the office with the flexibility to work remotely one
day (Friday).
- Comprehensive benefits package including a competitive salary, annual performance
bonus, and equity for all full-time employees.
- 100% employer-paid health and dental insurance, plus generous paid time off (PTO).
- Pay
- ₹3,800,000.00 per year
- Work Location
- In person
Never pay to get work. If a listing asks for a fee, it is a scam. The ten signs →