Data Engineer - Web Scraping (4 months contract)
CXG is hiring a Data Engineer for a 4-month remote contract to manage web scraping configurations and data pipelines. The role involves maintaining scraping infrastructure, ingesting data into the Datalake, and performing transformations. Candidates must have expertise in Python, SQL/NoSQL, Azure, and ETL tools like Airflow and DBT. You will collaborate with data scientists and stakeholders to optimize pipeline performance and reporting.
50k new jobs listed every day. Install TAL to find more jobs like this.
Experience
2+ years
Function
Engineering
Work mode
Remote, India
Company
Tier 2
What you will work on
CXG is hiring a Data Engineer for a 4-month remote contract to manage web scraping configurations and data pipelines. The role involves maintaining scraping infrastructure, ingesting data into the Datalake, and performing transformations. Candidates must have expertise in Python, SQL/NoSQL, Azure, and ETL tools like Airflow and DBT. You will collaborate with data scientists and stakeholders to optimize pipeline performance and reporting.
TAL's take
Solid mid-level role with clear stack and responsibilities, though limited by the 4-month contract duration.
The JD provides a very clear scope of responsibilities centered on web scraping, data pipeline management, and specific tools like Python, Airflow, and DBT.
Must haves
- Proven experience in data engineering
- Experience with ETL processes, data modeling, and data warehousing
- Expertise in relational and NoSQL databases
- Experience with Azure cloud platform
- Strong Python experience for data engineering
- Minimum 2 years of experience in a similar role
Tools and skills
About the company
Established international agency serving luxury brands with global operations.