Data Engineer
iConsultera
India
Job Summary
We are seeking a skilled and detail-oriented Data Engineer to design, build, and maintain scalable data pipelines and infrastructure that support business intelligence, analytics, and machine learning initiatives. In this fully remote role, you will collaborate with data scientists, analysts, software engineers, and business stakeholders to ensure reliable, secure, and high-quality data solutions. The ideal candidate has strong expertise in data engineering, cloud platforms, ETL processes, and big data technologies.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines for processing structured and unstructured data.
- Build and optimize data warehouses, data lakes, and data models.
- Integrate data from multiple sources, including APIs, databases, and third-party systems.
- Ensure data quality, integrity, consistency, and security across all platforms.
- Develop and maintain batch and real-time data processing workflows.
- Optimize database performance and query efficiency.
- Collaborate with data scientists and analysts to support reporting, analytics, and machine learning projects.
- Monitor data pipelines and troubleshoot performance or reliability issues.
- Implement data governance, backup, and disaster recovery strategies.
- Create technical documentation for data architecture, workflows, and processes.
- Stay updated on emerging data engineering technologies and industry best practices.
Qualifications
- Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related field.
- 3+ years of experience in data engineering or a similar role.
- Strong proficiency in Python, Java, or Scala.
- Advanced knowledge of SQL and relational databases.
- Experience with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform (GCP).
- Experience building scalable data pipelines and ETL workflows.
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration skills.
- Ability to work independently in a remote environment.
Preferred Qualifications
- Experience with big data technologies such as Apache Spark, Hadoop, or Kafka.
- Knowledge of data warehouse solutions such as Snowflake, Amazon Redshift, or Google BigQuery.
- Experience with workflow orchestration tools such as Apache Airflow.
- Familiarity with containerization technologies such as Docker and Kubernetes.
- Cloud certifications (AWS, Azure, or GCP) are a plus.