Data Engineer Lead
Big data & analytics
Senior
Bangalore

We are looking to hire Data Engineering Leads for our Big Data and Analytics Services. The candidates should have strong capabilities in data egineering along with a proven expertise in team management. Candidates should also be proficient in project and senior stakeholder management.


Responsibilities


Independently Lead & manage execution of data engineering projects

Engineer complete technical solutions to solve concrete business challenges in the areas of digital marketing, eCommerce, Business Intelligence and self-service analytics.

Collect functional and non-functional requirements, consider technical environments, business constraints and enterprise organizations

Support our clients in executing their Big Data strategies by designing and building operational data platforms: ETL pipelines, data anonymization pipelines, data lakes, near real-time streaming data hubs, web services, training and scoring machine learning models.

Troubleshoot and quality check work done by team members

Collaborate closely with partners, strategy consultants and data scientists in a flat and agile organization where personal initiative is highly valued

Share data engineering knowledge by giving technical trainings.

Communicate and interact with clients at the executive level

Guide and mentor team members.


Required Experience

A broad practice in multiple software engineering fields:
Experience on managing & leading data engineering / warehousing projects
Must have experience on Python, SQL and Distributed programming languages, preferable Spark
Experience working on Cloud, Azure is a plus
Experience working setting up data lakes using entire Big Data and DWH ecosystem
Experience on data workflows and ETL, Apache Airflow is a plus
Comfortable with Unix OS type systems, Bash and Linux
Basic knowledge of webservices and APIs
Basic knowledge of Containers and Docker as platform
Experience using Version Control, Testing and development cycle, preferable git (Gitlab or GitHub)
Knowledge of security practices
Software development practices (Agile)


A strong focus on data processing:
Object oriented programming
Data workflows, monitoring, architecture and security
Databases: theory and practice
Distributed data processing
Concepts of functional programming
Enterprise data warehousing, business intelligence and ETL principles


Good written and oral communication skills in English language

Apply to this positionWe are constantly looking for talented individuals who wish to become part of and help expand our platform.

Name*
Email*
Phone
Tell us why*
Please attach your Resume*Max. file size 5MB
Please attach your Cover Letter*Max. file size 5MB