The Math Company
The Math Company
0 Followers
Jobs / Data Engineer - Senior Associate

Data Engineer - Senior Associate
Posted on: 16th September, 2020 | Closed

Skills Python
Experience 4-6 years exp
Cost to Company INR 10.0L - INR 18.0L
Job Location Bangalore
Openings 10
How to apply Take a 4 hrs screening test organized by The Math Company.
  • Opening time: Oct 05, 2020 01:30 PM UTC
  • Closing time: Nov 01, 2020 06:25 PM UTC
Note: You can take the test anytime between the given duration

ROLE DESCRIPTION:

As a data engineer, you’ll have an opportunity to work on the universe of data and solve some very interesting problems by creating and maintaining scalable data pipelines dealing with petabytes of data. All our projects entail working on cutting edge technologies, petabyte-scale data processing systems, data warehouses and data lakes to help manage the ever-growing information needs of our customers.

The responsibilities are detailed as below:

  • Experience in understanding and translating data, analytic requirements and functional needs into technical requirements while working with global customers
  • Build and maintain data pipelines to support large scale data management in alignment with data strategy and data processing standards
  • Experience in Database programming using multiple flavors of SQL
  • Deploy scalable data pipelines for analytical needs
  • Experience in Big Data ecosystem - on-prem (Hortonworks/MapR) or Cloud (Dataproc/EMR/HDInsight)
  • Worked on query languages/tools such as Hadoop, Pig, SQL, Hive, Sqoop and SparkSQL.
  • Experience in any orchestration tool such as Airflow/Oozie for scheduling pipelines
  • Exposure to the latest cloud ETL tools such as Glue/ADF/Dataflow
  • Understand and execute IN memory distributed computing frameworks like Spark (and/or DataBricks) and its parameter tuning, writing optimized queries in Spark
  • Hands-on experience in using Spark Streaming, Kafka and Hbase
  • Experience in the latest cloud ETL tools such as Glue/ADF/Dataflow
  • Experience in any orchestration tool such as Airflow/Oozie
  • Experience working in an Agile/Scrum development process

REQUIRED QUALIFICATIONS:

We are looking for individuals who are curious, excited about learning and navigating through the uncertainties and complexities that are associated with growing a company. Some qualifications that we think would help you thrive in this role are:

  • BE/BS/MTech/MS in computer science or equivalent work experience.
  • 4 to 6 years of experience in building data processing applications using Hadoop, Spark, and NoSQL DB and Hadoop streaming

PREFERRED QUALIFICATIONS:

  • Expertise in data structures, distributed computing, manipulating and analyzing complex high-volume data from a variety of internal and external sources
  • Experience in developing ETL designs and data models for structured/ unstructured and streaming data sources
  • Experience in building large scale data pipelines in batch and real-time mode
  • Experience in data migration to cloud (AWS/GCP/Azure)
  • Proficient in a programming language such as Python/Scala
  • Good understanding of in relational/dimensional modeling and ETL concepts
  • Good understanding of data analysis techniques
  • Solid working knowledge of SQL and scripting
  • Understanding of any reporting tools such as Tableau, Qlikview or PowerBI
About The Math Company

We, at TheMathCompany, enable data analytics transformations for Fortune 500 organizations across the world. We enable our clients to build core capabilities that set them on a path to achieve analytics self-sufficiency.

  • Over the last four years, we have been consistently doubling in size year-on-year with 300 (and counting…) Data Scientists & Engineers, Consultants, and Visualization experts
  • TheMathCompany has won multiple awards recognizing us as a global Data and Analytics firm – We ranked #23 in the Deloitte Technology Fast 500™ Asia Pacific 2019 and #2 in Deloitte Technology Fast 50™ India 2019.
  • 35+ Fortune 500 Companies, from almost 10 different industries and countries, trust us to power their analytical transformation.

    Visit https://themathcompany.com/ to know more.

Notifications
View All Notifications

?