Senior Scala Big Data Engineer

  • Full time
  • Prague
  • Posted 1 week ago
Hadoop or Cloud solutions (regular)
English (regular)
Scala (advanced)
Spark (advanced)
Would you like to wrangle terabytes of data in minutes using cutting-edge technologies? 
Would you like to join a team of talented and passionate Software Engineers? 
Developing your programming skills, building and maintaining data lakes, data platforms and applications for various modern and highly-funded companies? 
Using FP and type safety to make sure your applications are correct and do that in a company developing Scala 3?
 
If you are a Scala developer who would like to get into Big Data or a Data Engineer who wants to learn more about Scala (or both!) then we are looking for someone just like you.
 
 
You’ll join the Data department  at Virtuslab where we are providing Big Data and Machine Learning consulting services for various UK, EU and US clients.

Available project:

1. A huge retailer, with tons of data stored in a large, on-prem Hadoop Cluster, which we’re extending with cutting edge, flexible, cloud-based solutions. We’re responsible for creating large business aggregates for different e-commerce domains. Additionally, we cooperate with data scientists to optimise operations across a number of business areas (from van deliveries to in-store security).
Tech stack: Scala, Spark, Hadoop, Kafka, Kubernetes, Azure

2. Our main goal is to develop a generic Big Data ingestion and transformation framework for a new, highly funded, UK-based, insurance company. We work across two teams: one responsible for developing the framework and extending the capabilities of the platform and another one focusing on using the framework to ingest hundreds of datasets from various data sources. There are lots of greenfield areas and possibilities to impact the whole company. 
Tech stack: Scala, Spark (mostly Core, some SQL), AWS (EMR, EC2, S3, Codebuild)

 

What & how? 

  • On premise and cloud based infrastructures (project dependent, but Scala and Spark are the main technologies)
  • Professional and comprehensive monitoring, logging and alerting
  • Evolutionary Agile approach to software delivery
  • Great teamwork and knowledge sharing
  • Contributions to the open-source software communities

What we expect?

  • Ability and eager to lead by example
  • Hands-on experience in designing and development of scalable, distributed, highly available solutions
  • Interest in solving challenging data engineering problems using state-of-the-art techniques
  • Grounded knowledge and understanding of data structures, algorithms and distributed computing
  • Fluent with Scala and/or Spark
  • Functional Programming mind-set is a nice to have
  • Able to develop and maintain high-quality code
  • Can communicate with the business using good English (both written and verbal)
  • Experienced in using big data and cloud solutions (eg Hadoop, AWS, Azure)
  • Has a deep understanding of data-intensive distributed systems

What’s on offer?

  • Flexible hybrid work model – you decide where & when to start the work. You can work remotely or join us in one of our modern offices (Krakow, Rzeszow, Kielce; Wroclaw, Katowice, Warsaw and Gdansk – soon!), always located in the city centres. Just choose what suits you best! 
  • Language lessons – we refund up to 500 PLN (per quarter) for learning all languages you would like to take! What’s more, we refund up to 1 000 PLN (per quarter) for learning the English language.
  • Virtusity – our training division – we really value the personal growth of our #VLteam. That’s why we have a rich offer of internal courses, workshops etc. (technical, as well as soft skills training) conducted by our employees. 
  • Training Package – use our training budget of up to 2 500 PLN (yearly) and 24 paid work hours for your development. You can choose the training from our Virtusity portfolio or external conferences, courses, workshops etc. 
  • Home office reimbursement – you can rent all the necessary equipment from our offices, but you can also get up to 800 PLN financial support to set up your WFH.
  • Multisport card or MyBenefit points – do you like sports and want free unlimited admission to sports facilities in your city? Or maybe you prefer the cinema, SPA in the mountains, delicious dinner or Allegro shopping? At VirtusLab, you decide whether you choose a sports card or vouchers for countless attractions. 
  • Private healthcare – our insurer’s offer allows you to have free health advice, treatments, diagnostic tests etc., in more than 1,500 clinics operating all over the country.
  • Stretching – feeling tense or tired? Take a break from work and join our online stretching sessions.
  • Building tech community – we run 9 meetup groups in Kraków, Kielce, and Rzeszów and support many other local initiatives. We also contribute to numerous open-source projects (world-famous solutions and create our own ones). Check out also Sphere.it – our unique platform with tech videos and online events. 
  • Having fun together – cycling tours, kayaking, fun at rope park, pizza party or a mountain trip with SPA? Yes, we’ve got it all. It’s never boring with #VLteam!
We do not expect you to qualify for all of the above points. A good understanding of some of these areas and a willingness to develop expertise in others may be sufficient. We are not concerned with your education or any other formalism. What we are concerned with are your passion, knowledge and experience.

To apply for this job please visit cz.talent.com.