#16620 | 2020-05-15 Warszawa, Gdynia, Poland

Hadoop/Big Data Developer

PROJECT INFORMATION:
  • Industry: Finance / Banking
  • Location: Warszawa or Gdynia
  • Business trips: Occasional
  • Project language: English, Polish
  • Remuneration: 140-150 PLN/H + VAT
  • Project length: 12 months +

PROJECT REQUIREMENTS:

Role description:
  • Responsible for Database
  • Reporting development in the agile team

Scope: We are building a new customer account reporting engine to (over the coming years) replace our existing legacy customer account reporting solutions across our home markets. A pre-requisite is that we consolidate all account and payment transaction data to Hadoop, so we have dozens of data formats and integration points both upstream and downstream. The project has two delivery streams: CA that deliver new reports to Corporate customers in ISO XML format and CBP that will deliver old legacy reports to all 10M customers in the Nordics.

Responsibilities:
  • As an expert Big Data Developer you will be responsible for a successful design and implementation of a high-performing, flexible, robust, scalable and easily maintainable global reporting solution.

Required skills/competencies:
  • Hadoop; Hive; Impala; Kafka; Splunk

Other skills/competencies:
  • Deep understanding of the principles of distributed systems
  • Knowledge and experience with: Apache Hadoop, Hive, Oozie, Pig, Sqoop, Impala, Kafka
  • Experience with NoSQL databases: MongoDB, Cassandra, HBase or similar
  • Experience with building ETL/ETL pipelines
  • Production experience with performance tuning of Hadoop/Spark solutions
  • Familiar with OOD and design patterns
  • Experience from large-scale system integration projects
  • Working with RDBMS and knowledge of SQL
  • Integration towards RESTful and SOAP/OSB-services
  • Knowledge and experience with web servers such as Tomcat, Jetty or Weblogic
  • Knowledge and experience with tools like Maven, Git, and the Atlassian suite (Stash/Bitbucket, Jira, Confluence)
  • Hands on experience with Redhat, Linux shell scripting
  • Hands-on experience with writing Apache Spark-based applications in Scala
  • 7+ years of software development

WE OFFER:
  • Challenging international projects in a Scandinavian business culture.
  • Transparently built relations based on trust and fair play.
  • Benefits: Medicover card, Multisport card.
  • Internal reference bonus.


Start: ASAP
Duration: 12 months+
Work location: Warszawa, Gdynia, Poland
Requirements: Min. 5 years of professional IT experience.
Job type: Freelance

Projekt avslutat

Tyvärr söker vi inte längre konsulter till det här projektet.

Klicka på ”Till uppdragslistan” för att visa aktuella projekt.

Om du är kund och letar efter den här typen av profil kan du använda formuläret "Visa konsult-CV" på vår andra webbplats.

ProData Consult lagrar data i din webbläsare / enhet med hjälp av cookies i syfte att framställa statistik och optimera våra webbplatser och eventuellt för riktade annonser. Genom att acceptera, ger du oss ditt samtycke till denna användning av cookies. Läs vår sekretesspolicy för mer information. Du kan alltid återkalla ditt samtycke här: Integritetspolicy & cookies

Webbplatsen kräver användning av "Nödvändiga cookies". Våra nödvändiga cookies används bara för att leverera en fungerande webbplats och webbservice.

Valda tredjepartstjänster kan lagra cookies för att placera relevanta annonser som ska levereras till dig på tredje parts webbplatser.