Data Engineer (Night Shift - Remote)
India
2 - 5 years
Positions: Data Engineer I & II
Timings: 5:30 PM IST to 3:30 AM IST (Remote India)
Job Description :
As a Data Engineer , you will be responsible for designing, developing, and maintaining the data infrastructure that powers our advertising technology platform. You will work closely with cross-functional teams to build scalable data pipelines, optimize data workflows, and ensure the reliability and performance of our data systems.
Responsibilities:
● Design, develop, and maintain ETL pipelines to collect, process, and store data from various sources.
● Work with APIs, databases, and other data sources to integrate data into the data warehouse.
● Implement and maintain data validation and monitoring processes to ensure data accuracy and reliability.
● Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver solutions.
● Transform raw data into a form that is easily usable for analysis and business intelligence.
● Maintain comprehensive documentation of data pipelines, processes, and systems.
● Optimize data systems and pipelines for performance and scalability.
Requirements:
● Bachelor’s degree in Computer Science, Information Systems, or a related field.
● Minimum of 3 years of experience in data engineering or a related role.
● Proficiency in SQL and experience with at least one programming language such as Python.
● Experience with cloud-based data platforms (AWS, Azure, GCP) and services such as AWS Redshift or Google BigQuery.
● Knowledge of big data technologies like Hadoop, Spark, or Kafka is a plus.
● Experience with ETL tools such as Apache Airflow.
● Familiarity with data warehousing concepts and relational databases.
● Monitor and troubleshoot data pipeline issues, performance bottlenecks, and data quality issues in production environments.
● Implement data governance policies and procedures to ensure data integrity, security, and compliance with regulatory requirements.
● Understanding of data modeling and database design principles.
● Strong problem-solving and analytical skills.
● Excellent communication and collaboration skills.
● Ability to work independently and manage multiple tasks and projects simultaneously.
● Detail-oriented and committed to data quality.
No comments:
Post a Comment