Aller au contenu principal

Recherchez nos emplois

Identifiant du poste
APAC00354
Emplacement(s)
Inde
Contract Type
Full Time
Unité opérationnelle
Pontoon
Département
Information Technology IT
Postuler

Databricks Engineer

About the role

The Data Engineer – Databricks is responsible for assembling large, complex sets of data from various data sources using APIs. Primary responsibilities include designing and developing new data pipelines, improve performance to existing data pipelines, support and maintain data pipelines, and provide expertise and best practices regarding data bricks. Partners with other BI team members to support data infrastructure needs while assisting with data-related technical issues. Responsible for identifying, designing, and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes. Maintains all tools and processes in conformance with the organization’s policies and objectives.

What you’ll be doing

• Partners with global team of BI Developers, SMEs and BI Leaders to evaluate the feasibility of and provide timetables for executing requirements to deliver data & API solutions in Agile manner.

• Translates business requirements into meaningful, clean, and scalable enterprise-grade data solutions built according to established Pontoon Business Intelligence & Analytics best practices.

• Design and build data integrations using APIs, REST APIs(JSON) and web services.Ingest, transform,and publish data from sources and to destinations via an API.Build out new API integrations to support continuing increases in data volume and complexity.

• Plan, design, develop, test, and maintain REST APIs.Propose Data load optimizations and continuously implement to improve the performance of the Data loads.

• Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.Performs data analysis required to troubleshoot data-related issues and assist in the resolution of data issues.

• Develop and maintain scalable data pipelines in data bricks to integrate with enterprise data streams. Build data pipelines that feed business intelligence tools and expose data to end users using Power-BI.

• Design and implement Data Architectures. Works closely with other team members to develop a strategy for long term data platform architecture. Responsible to develop data architecture that is modular and cloud centric for agile delivery.

• Develop POCs and other technical evaluations of technologies, designs,and solutions to influence platform architects. Drive system and platform thinking within BI development team.Assists in estimation and assessment of feasibility of features.

• Support the planning and implementation of data design services, providing sizing and configuration assistance and performing needs assessments.

• Analyze current business practices, processes, and procedures as well as identify future business opportunities for leveraging cloud services using Databricks.

• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

• Lead multiple activities including but not limited to data models, APIs, partner integrations, and cloud infrastructure.

About you

• Bachelor’s degree in computer science, statistics, applied math, or information systems with a minimum of three years of experience as Data Engineer, API Developer, Databricks Developer/Engineer, Software Engineer, or Backend software engineer/developer.

• Three plus (3+)years of experience with extracting and modeling data from API& JSON required. • Two plus (2+)years of working experience with SQL required.

• Three plus (3+)years of experience designing, developing, validating, and automating ETL/ELT processes.

• Three plus (3+)years of experience with Databricks platform and its tools including Platform (notebooks, clusters, Jobs, Databricks SQL, relational entities, Repos) Apache Spark (PySpark, DataFrame API, basic architecture) Delta Lake (SQL-based Delta APIs, basic architecture, core functions) Databricks CLI (deploying notebook-based workflows) Databricks REST API (configure and trigger production pipelines) required.

• Three plus (3+)years of experience in Python and common python libraries required.

• Experience working with Power BI and/or other Business Intelligence visualization tools preferred.

• Experience managing multiple development projects at one time is required.

• Skilled in communicating effectively verbally and in writing.

• Ability to establish and maintain effective working relationships.

• Ability to work effectively both independently and in a group or team environment.

• Ability to prioritize, organize and perform multiple work assignments simultaneously while meeting assigned deadlines.

• Ability to understand end-user needs and assist in the development of data products. • Experience designing and building modern data pipelines and data streams.

• Experience with API (JSON) and Streaming technologies.

• Experience with Databricks (Azure Databricks REST API, Delta Tables).

• Experience with Python.

• Experience indata architecture for transformation and modernizationof enterprise data solutions using cloud data technologies.

• Advanced SQL Programming with structured and unstructured data and object-oriented/object function scripting languages (Scala).

• Strong knowledge of DataIntegration (e.g.,Streaming, Batch, Error,and Replay) and data analysis techniques.

• Experience with Security Concepts (e.g.,Encryption, Identity, etc.).

• Good problem-solving skills. Attention to detail.

• Self-directed and can stand on their own two feet and get stuff done.

• Experience with agile development methodologies.

• Proficient with Microsoft Office products such as Word, Excel, PowerPoint, and Outlook.

• Open to working in US hours ( 8am EST - 5pm EST)

Why choose us?

It’s an exciting time to be part of our team. We’re proud to be a global thought-leader and care about doing the best job we can to ensure better futures for everyone. We do this by building our Future@Work strategy as a united team of 30,000+ colleagues with a collective spirit working in over 60 countries globally. You’ll have the opportunity to grow across a variety of interesting jobs and careers over our extensive portfolio of global brands. We empower our colleagues to work in the smartest, most efficient ways to achieve total balance between the demands of their jobs and their lives. That’s why we give you the autonomy and support you need to work in the way that makes you most productive, agile, confident, and insightful. Putting people first, pioneering with a collective spirit and always advancing with a growth mindset -that’s what we stand for at the AdeccoGroup. Here, we are all individuals with a unique perspective on the world we live in. That’s what makes us stronger. Whoever you are and whatever your background, you can be yourself. So, we aim to build on the attributes that make you, you. We offer a range of world-class resources for upskilling and development, satisfying your curiosity while the sharing skills, knowledge, and expertise to grow together. Make an impact where it matters most.

A journey to bring out the best in you

We believe that having an understanding of the hiring process helps you to prepare, feel, and be, at your best. As a global, multibrand organization with multiple different roles, our application process can vary. On our career site, you will find some of the key steps you can expect to guide you along the way. As one of the world’s largest employers we believe in talent, not labels, and focus on the diverse and unique skills our people bring. We seek to foster a culture of belonging and purpose, an environment where everyone can thrive and feel engaged, and where difference is respected and valued. Our commitment to equity, equal opportunity, inclusion, and diversity is part of our broader commitment to respecting fundamental human rights across our value chain. The Adecco Group is proud to be an Equal Opportunity Employer.

Posting date: 25-02-2024

Postuler

Apprenez à nous connaître

Nous ne cochons pas de cases - nous pensons en dehors d'elles. Nous proposons des solutions de talents innovantes, contribuant à alimenter la prospérité des économies, des sociétés et des marchés de nos clients. En planifiant constamment des solutions plus intelligentes, meilleures et plus grandes pour aider à gérer la main-d'œuvre de nos clients. Réinventez votre chemin avec Pontoon.

Diversité et inclusion chez Pontoon

Nous nous engageons à créer un avenir positif pour tous en favorisant une culture d'appartenance, de confiance et de participation. Notre objectif est de reconnaître et de valoriser la diversité de la pensée, en permettant des processus et des prises de décision inclusifs pour s'assurer que chaque collègue est évalué en fonction de ses contributions, compétences, expériences et potentiels. Notre approche de la diversité et de l'inclusion englobe plusieurs piliers qui structurent nos efforts à travers l'inclusion structurelle et consciente, le leadership et la responsabilité. Nous donnons à chaque individu le pouvoir d'être responsable de la diversité et de l'inclusion afin que lorsque vous parlez, nous écoutions.

Culture

Notre approche « les personnes d'abord » signifie que le bien-être de nos collègues est toujours une priorité. Le bien-être des employés n'a jamais été aussi important, et nous sommes fiers de montrer l'exemple en soutenant nos employés pour être holistiquement en bonne santé dans les moments difficiles.

En savoir plus sur Pontoon

En savoir plus sur Pontoon Pontoon fournit des solutions de talents stratégiques à nos clients du monde entier. Nous sommes un fournisseur de services gérés (MSP) responsable de la gestion de la main-d'œuvre temporaire de nos clients. Cela inclut la collaboration avec des partenaires fournisseurs qui sourcent des talents pour gérer l'intégration, le suivi des travailleurs et la conformité pour nos clients MSP. Nous proposons également des services de sous-traitance de l'expérience de recrutement (RXO), ce qui signifie que nous gérons l'ensemble de l'expérience d'embauche de bout en bout pour les besoins en recrutement permanent de nos clients. Nous avons l'expertise pour faciliter l'attraction de talents, la recherche, la sélection, les entretiens, les décisions d'embauche et l'intégration pour nos clients RXO. De plus, nous soutenons les besoins d'embauche de nos clients en matière de recrutement direct, de talent total et d'approvisionnement en services.

  • Vous êtes une révolution. Soyez la force créative derrière l'innovation et le changement.

    10
  • Vous débloquez un potentiel illimité. Soyez le penseur en avant pour nos clients et piratez leurs besoins en évolution constante.

    8
  • Vous êtes responsable et orienté vers les résultats, capable de penser en dehors du cadre.

    10
  • Vous êtes indispensable à notre excellence collective, en étant un joueur d'équipe qui rend l'atteinte des objectifs amusante.

    9
  • Vous êtes le défenseur de l'inclusivité. Soyez un modèle qui mène avec compassion et soin.

    9
Traits are on a scale of 0 to 10

Profil de réussite

Sommes-nous faits l'un pour l'autre ? Découvrez les traits que nous recherchons.

Récompenses

Flexibilité pour travailler de la manière qui vous rend le plus productif, agile, confiant et perspicace.

Autonomie pour prendre des décisions professionnelles et informées.

Travail significatif qui fait une différence dans la vie des gens

Apprentissage continu, mentorat et parcours professionnels diversifiés et dynamiques.

Avantages et récompenses locaux spécifiques adaptés à chaque pays (congés, soins de santé et plus encore).

Emplois similaires

Ce que signifie rejoindre le Groupe Adecco.

Rejoignez notre communauté mondiale de talents

Lorsque l'occasion se présente, assurez-vous de l’entendre ! Entrez vos coordonnées pour rejoindre notre communauté de talents et inscrivez-vous aux alertes d'emploi automatiques.

En renseignant vos informations, vous reconnaissez avoir pris connaissance de notre politique de confidentialité, nos conditions d''utilisations, notre police de cookies et consentez à recevoir des e-mails de la part du groupe Adecco.

Déjà inscrit? Cliquez ici