Data Engineer-6336

Data Engineer-6336

itD is seeking an experienced Data Engineer to build and modify high-complexity data pipelines, monitoring, and alerting systems supporting a legal-focused infrastructure team. The ideal candidate will bring deep expertise in SQL, Python, ETL/data pipelines, and data warehousing, along with a proven track record of leading complex, cross-functional data engineering initiatives from planning through delivery.

Location: Remote, with preference for candidates based in California and ideally the Bay Area. Candidates open to occasional onsite work in San Francisco should indicate this in their skills matrix.
Contract: 3Months

Pay Rate: depending on experience and market rate.
We provide comprehensive medical benefits, a 401k plan, paid holidays, and more.
Please note that we are only considering direct W2 candidates at this time, as we are unable to offer sponsorship.

Responsibilities

• Build and modify high-complexity ETL and data pipelines to efficiently extract, transform, and process data from large-scale datasets.

• Develop and maintain monitoring and alerting systems that proactively identify data, infrastructure, and workflow issues.

• Design data warehousing solutions and optimize queries and pipelines for large-scale data processing.

• Collaborate with attorneys, data scientists, engineers, and other technical and non-technical stakeholders to understand data requirements, sources, dependencies, and timelines.

• Lead end-to-end data engineering initiatives across cross-functional teams, including planning, documentation, stakeholder coordination, system design, and execution.

• Identify potential data and system issues early and implement solutions that improve reliability, efficiency, and operational visibility.

• Communicate technical concepts and project status clearly and concisely to both technical and non-technical audiences.

Internal Responsibilities

• Attend regular internal practice community meetings.

• Collaborate with your itD practice team on industry thought leadership.

• Complete client case studies and learning material, including blogs and media material.

• Build material to contribute to the Digital Transformation practice.

• Attend internal itD networking events, both in person and virtually.

• Work with leadership on career fast-track opportunities.

Required Qualifications and Skills

• 5–7+ years of experience in data engineering or a closely related field.

• Expert-level SQL experience, including experience with relational or distributed query engines such as Presto, PostgreSQL, or MySQL.

• Expert-level Python programming experience.

• Expert-level experience building and managing ETL/data pipelines using pipeline orchestration tools such as Airflow or comparable technologies.

• Demonstrated experience leading data engineering efforts on large, cross-functional projects involving both technical and non-technical stakeholders.

• Demonstrated ability to design and deliver high-complexity monitoring and alerting systems.

• Strong written and verbal communication skills, with the ability to communicate concisely and effectively.

• Experience working independently while collaborating effectively across multiple stakeholder groups.

• Strong understanding of data privacy and security considerations in data engineering environments.

Preferred Qualifications and Skills

• Experience using AI to accelerate project delivery or building AI-enabled components to automate workflows for non-technical stakeholders.

• Experience supporting highly regulated industries, such as legal, compliance, finance, security, or privacy.

• Experience mentoring junior data engineers or other technical team members.

• Experience working in startups, small organizations, or ambiguous environments with broad ownership and scope.

• Experience with data loss remediation or related data protection initiatives.

• Volunteer or internship experience with a law firm or experience working in privacy-related environments.

• Startup, entrepreneurial, or self-employed experience demonstrating broad ownership and initiative.

• Candidates from non-traditional backgrounds are welcome; big-tech experience is not required.

Education

Bachelor’s degree in a relevant field or equivalent work experience required.

Originally posted on Himalayas