M
Marktine Technology Solutions Pvt LtdListed on Himalayas
Bigdata Engineer -Spark
Remote · United States
Source: Himalayas. This job was published on Himalayas; you apply there.
RemoteFull-timeMid levelData Science
This job was removed from Marktine Technology Solutions Pvt Ltd's hiring system and is no longer accepting applications. See open jobs like this one.
No longer accepting applications
Listed on Himalayas. You apply through their page. We never charge applicants.
Estimated pay
Estimate$129K–$224K/yr
Estimate — the employer hasn't published pay.
Based on 60 similar mid-level Data Engineering jobs in United States that show pay. The range is the middle half of their posted pay (25th to 75th percentile), not an offer — ask the employer for the real range.
Data Engineering salaries →Prepare for this job
Free on every jobLikely interview questions
At a glance
- Education
- Master's
Skills mentioned
hadoopsparksqlagileelasticsearchmongodbnosql
About the role
Category: Technology
Location:
Details
Location:
Responsibilities:
- As a developer, possess excellent Knowledge of distributed computing architecture, core hadoop component (HDFS, Spark, Yarn, Map-Reduce, H base, HIVE, Impala) and related technologies.
- Technical Design and development of ETL/Hadoop and Analytics services /components
- Contribute in end to end architecture and process flow
- Understand Business requirement and publish reusable designs
- Result oriented approach with ability to provide apt solutions.
- Proficient in performance improvement & fine-tuning ETL and Hadoop implementations
- Conduct code reviews across projects. Takes responsibility for ensuring that build and code adhere to architectural and quality standards and policies.
- Can work independently with minimum supervision.
- Strong analytical and problem solving skills
- Experience/Exposure to SQL, advanced SQL skills
Requirements
Skills Set:
- Strong understanding of distributed computing architecture, core hadoop component (HDFS, Spark, Yarn, Map-Reuduce, H base, HIVE, Impala) and related technologies.
- Hands on experience with batch data ingestion (Sqoop)
- Expert level understanding of relational data structure and RDBMS as well as NoSQL databases (Cassandra, MongoDB, Elasticsearch)
- Experience with automation/Scheduling of workflows/jobs (via shell-scripting, Tivoli)
- Solid Grasp of data storage formats (Parquet, Avro, HBase, Cassandra)
- Understanding of Agile methodologies as well as SDLC life-cycles and processes.
- Strong Understanding of Data warehousing and lakes
Details
Originally posted on Himalayas