Все вакансии / Big Data Engineer / Санкт-Петербург

Our client:

International engineering services company develops architecture of the e-commerce services for the largest retailers in the US, enterprise high-load services with millisecond response time. They improve development processes by introducing Agile, test automation, and CI/CD processes. The company focuses on Big Data analytics, scalable omni-channel services, DevOps, and cloud enablement.

 Looking for an enthusiastic and technology-proficient Big Data Developer, who is eager to participate in design and implementation of a top-notch Big Data solution to be deployed at massive scale.

 Responsibilities:

·         Participate in design and development of Big Data analytical applications

·         Design, support and continuously enhance the project code base, continuous integration pipeline, etc.

·         Write complex ETL processes and frameworks for analytics and data management

·         Implement large-scale near real-time streaming data processing pipelines

·         Work inside the team of industry experts on the cutting edge Big Data technologies to develop solutions for deployment at massive scale

Requirements:

·         Strong knowledge of Scala/Python

·         In-depth knowledge of Hadoop and Spark, experience with data mining and stream processing technologies (Kafka, Spark Streaming, Akka Streams)

·         Understanding of the best practices in data quality and quality engineering

·         Experience with version control systems, Git in particular

·         Desire and ability for quick learning of new tools and technologies

Will be a plus:

·         Knowledge of Unix-based operating systems (bash/ssh/ps/grep etc.)

·         Experience with Github-based development processes

·         Experience with JVM build systems (SBT, Maven, Gradle)

Company offers:

·         Opportunity to work on bleeding-edge projects

·         Work with a highly motivated and dedicated team

·         Competitive salary

·         Flexible schedule

·         Benefits program

·         Social package - medical insurance, sports

·         Corporate social events

·         Professional development opportunities

·         Opportunity for long trips to the US or Europe and possibility for relocation

 

Тэги:

Big Data Engineer