ThoughtWorks
ThoughtWorks
Bangalore
12931 Followers
Jobs / Senior Data Engineer

Senior Data Engineer
Posted on: 19th February, 2021 | Closed

Experience 2-4 years exp
Cost to Company Upto 22 LPA
Job Location Bangalore/Pune/Hyderabad/Gurgaon
How to apply Take a 3 hrs screening test organized by ThoughtWorks.
  • Opening time: Mar 19, 2021 12:30 PM UTC
  • Closing time: Mar 28, 2021 06:25 PM UTC
Note: You can take the test anytime between the given duration

Are you at your most vibrant when you’ve successfully distilled data into its simplest, most meaningful form?

ThoughtWorks is a global software consultancy with an aim to create a positive impact on the world through technology. Our community of technologists thinks disruptively to deliver pragmatic solutions for our clients' most complex challenges. We are curious minds who come together as collaborative and inclusive teams to push boundaries, free to be ourselves and make our mark in tech.

Our developers have been contributing code to major organizations and open source projects for over 25 years. They’ve also been writing books, speaking at conferences and helping push software development forward, changing companies and even industries along the way. We passionately believe that software quality is driven by open communication, review and collaboration. That’s why we’re such vehement supporters of open source and have made significant contributions to open source tools for testing, continuous delivery (GoCD), continuous integration (CruiseControl), machine learning and healthcare.

As consultants, we work onsite with our clients to ensure we’re evolving their technology and empowering adaptive mindsets to meet their business goals. You could influence the digital strategy of a retail giant, build a bold new mobile application for a bank or redesign platforms using event sourcing and intelligent data pipelines. You will learn to use the latest Lean and Agile thinking, create pragmatic solutions to solve mission-critical problems and challenge yourself every day.

Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.

You’ll spend time on the following:

  • You will partner with teammates to create complex data processing pipelines in order to solve our clients’ most ambitious challenges
  • You will collaborate with Data Scientists in order to design scalable implementations of their models
  • You will pair to write clean and iterative code based on TDD
  • Leverage various continuous delivery practices to deploy data pipelines
  • Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available
  • Develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
  • Create data models and speak to the tradeoffs of different modeling approaches

Here’s what we’re looking for:

  • You have a good understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop
  • You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting
  • Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions
  • You are comfortable taking data-driven approaches and applying data security strategy to solve business problems
  • Working with data excites you: you can build and operate data pipelines, and maintain data storage, all within distributed systems
  • Strong communication and client-facing skills with the ability to work in a consulting environment
About ThoughtWorks

About ThoughtWorks:

Founded over 25 years ago, we’ve grown from a small team in Chicago to a leading global software consultancy of more than 8000 employees across 48 offices in 17 countries. With our roots in custom systems and agile software delivery, we’re at the forefront of defining the tech principles used by some of the world’s most successful organizations.

We’re a community of passionate, purposeful individuals revolutionizing software design and delivery while advocating for positive social change. At our core, we’re geeky software engineers and consultants who love solving big, interesting problems.

ThoughtWorks challenges curious minds to make a real impact. Together, we’re creating a place where you are free to make your mark on the world through technology.

Mission: 

Our mission is to create an extraordinary impact on the world through our culture and technology excellence.

Culture:

Our culture is very intentional. We hire for it, nurture it, check on it, and if something isn’t working, we fix it. Here’s what you’ll find in every ThoughtWorks office around the world:

  • Building software is a social activity done by teams of brilliant and motivated people, not a mechanistic process. You’ll work on holistic, cross-functional teams focused on delivering business value early and greater business impact overall.

  • We genuinely strive to hire nice, honest, smart people. During the interview, you’ll find we focus more on aptitude, attitude, integrity and not whether or not you have the perfect CV.

Nurturing Inclusivity at ThoughtWorks:

We believe that no matter who you are or how you identify, you deserve respect, empathy, and equal opportunity to succeed. We work hard to ensure everyone at ThoughtWorks—and everyone we work with—is treated this way.

There are more than 60 active diversity and inclusivity programs and groups across our offices worldwide. They focus on everything from race, gender diversity, LGBTQIA+, mental health, caregivers, and neurodiversity. The goal for each is clear: to make ThoughtWorks a better home for all.

You are always welcome here. This is not just policy. This is practice.

Our award-winning initiative #TalkTechToHer is designed to create better career paths and opportunities for senior women technologists. Vapasi provides a platform for women developers to restart their careers. Udeti is a collection of stories about ThoughtWorkers who happen to be women. Each story is one of grit, of a passion for technology and of trust. Interning with Pride enables recently graduated techies from the LGBTQI+ community to grow their tech skills.

ThoughtWorks India has been awarded by NASSCOM for "Excellence in Diversity and Inclusion 2019”

The Anita Borg Institute has named ThoughtWorks to their list of  Top Companies for Women Technologists, twice. 

Vapasi was awarded the Most Innovative Returnee Program by JobsForHer DivHERsity awards at AccelHERate 2019.

ThoughtWorks has also been featured among the Top 100 Best Companies for Women in India by Avtar.

 

Notifications
View All Notifications

?